Apr 15 15:47:23 devstack cinder-volume[72766]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 15 15:47:23 devstack cinder-volume[72766]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 15 15:47:23 devstack cinder-volume[72766]: we strongly recommend against using it for new projects.
Apr 15 15:47:23 devstack cinder-volume[72766]: If you are already using Eventlet, we recommend migrating to a different
Apr 15 15:47:23 devstack cinder-volume[72766]: framework.  For more detail see
Apr 15 15:47:23 devstack cinder-volume[72766]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 15 15:47:23 devstack cinder-volume[72766]:   import eventlet  # noqa
Apr 15 15:47:25 devstack cinder-volume[72766]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 15 15:47:25 devstack cinder-volume[72766]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 15 15:47:25 devstack cinder-volume[72766]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 15 15:47:25 devstack cinder-volume[72766]: INFO dbcounter [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] Registered counter for database cinder
Apr 15 15:47:25 devstack cinder-volume[72766]: DEBUG oslo_db.sqlalchemy.engines [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72766) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 15 15:47:25 devstack cinder-volume[72766]: DEBUG dbcounter [-] [72766] Writer thread running {{(pid=72766) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 15 15:47:25 devstack cinder-volume[72766]: INFO cinder.rpc [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 15 15:47:25 devstack cinder-volume[72766]: INFO cinder.rpc [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 15 15:47:25 devstack cinder-volume[72766]: DEBUG oslo_db.sqlalchemy.engines [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72766) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 15 15:47:26 devstack cinder-volume[72766]: INFO cinder.volume.manager [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] Determined volume DB was empty at startup.
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG cinder.volume.manager [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72766) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 15 15:47:26 devstack cinder-volume[72766]: INFO cinder.volume.manager [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 15 15:47:26 devstack cinder-volume[72766]: WARNING stevedore.named [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 15 15:47:26 devstack cinder-volume[72766]: WARNING castellan.key_manager [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 15 15:47:26 devstack cinder-volume[72766]: WARNING cinder.keymgr.conf_key_mgr [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG cinder.volume.drivers.lvm [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72766) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_concurrency.processutils [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_concurrency.processutils [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] CMD "cinder-rtstool verify" returned: 0 in 0.252s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_db.sqlalchemy.engines [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72766) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 15 15:47:26 devstack cinder-volume[72766]: INFO cinder.rpc [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Apr 15 15:47:26 devstack cinder-volume[72766]: INFO cinder.rpc [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Apr 15 15:47:26 devstack cinder-volume[72766]: WARNING stevedore.named [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 15 15:47:26 devstack cinder-volume[72766]: WARNING castellan.key_manager [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 15 15:47:26 devstack cinder-volume[72766]: INFO cinder.volume.manager [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_db.sqlalchemy.engines [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72766) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 15 15:47:26 devstack cinder-volume[72766]: INFO oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] Starting 1 workers
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] Started child 72869 {{(pid=72766) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] Full set of CONF: {{(pid=72766) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] ******************************************************************************** {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] Configuration options gathered from: {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] ================================================================================ {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] allow_availability_zone_fallback = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] allow_compression_on_image_upload = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72869]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] allowed_direct_url_schemes     = [] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] api_rate_limit                 = True {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] auth_strategy                  = keystone {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] az_cache_duration              = 3600 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_availability_zone      = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_host                   = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_name                   = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_stats_polling_interval = 60 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backup_api_class               = cinder.backup.api.API {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backup_name_template           = backup-%s {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backup_use_same_host           = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backup_use_temp_snapshot       = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] chap_password                  = **** {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] chap_username                  =  {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] cinder_internal_tenant_project_id = 51caa844382f4aacb25925787331cfbe {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] cinder_internal_tenant_user_id = 2c3f02f90361444288150fa1c935f3c6 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] cloned_volume_same_az          = True {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] cluster                        = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] compression_format             = gzip {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] compute_api_class              = cinder.compute.nova.API {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] config_dir                     = [] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] config_source                  = [] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] control_exchange               = openstack {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] debug                          = True {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] default_availability_zone      = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] default_group_type             = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] default_volume_type            = lvmdriver-1 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] disk_geometry                  = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] driver_client_cert             = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] driver_client_cert_key         = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] driver_data_namespace          = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] driver_ssl_cert_path           = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] driver_ssl_cert_verify         = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] driver_use_ssl                 = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] enable_force_upload            = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] enable_new_services            = True {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] enable_unsupported_driver      = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] enforce_multipath_for_image_xfer = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] filter_function                = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] glance_api_insecure            = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] glance_api_servers             = ['http://192.168.122.32/image'] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] glance_api_ssl_compression     = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] glance_ca_certificates_file    = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] glance_catalog_info            = image:glance:publicURL {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] glance_certfile                = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] glance_keyfile                 = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] glance_num_retries             = 3 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] glance_request_timeout         = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] goodness_function              = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] graceful_shutdown_timeout      = 5 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] group_api_class                = cinder.group.api.API {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] host                           = devstack {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] image_compress_on_upload       = True {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] image_conversion_address_space_limit = 1 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] image_conversion_cpu_limit     = 60 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] image_conversion_disable       = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] image_upload_use_cinder_backend = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] image_upload_use_internal_tenant = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] image_volume_cache_enabled     = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] image_volume_cache_max_count   = 0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] image_volume_cache_max_size_gb = 0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] init_host_max_objects_retrieval = 0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] instance_format                = [instance: %(uuid)s]  {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] iscsi_target_flags             =  {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] iscsi_write_cache              = on {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] iser_helper                    = tgtadm {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] iser_ip_address                = 192.168.122.32 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] iser_port                      = 3260 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] log_color                      = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] log_config_append              = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] log_dir                        = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] log_file                       = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] log_options                    = True {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] log_rotate_interval            = 1 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] log_rotate_interval_type       = days {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] log_rotation_type              = none {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] max_age                        = 0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] max_logfile_count              = 30 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] max_logfile_size_mb            = 200 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] max_over_subscription_ratio    = 20.0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] message_reap_interval          = 86400 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] message_ttl                    = 2592000 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] migration_create_volume_timeout_secs = 300 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] monkey_patch                   = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] monkey_patch_modules           = [] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] my_ip                          = 192.168.122.32 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] no_snapshot_gb_quota           = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72869]: INFO cinder.volume.manager [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] Starting volume driver LVMVolumeDriver (3.0.0)
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] num_iser_scan_tries            = 3 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] num_shell_tries                = 3 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] num_volume_device_scan_tries   = 3 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] nvmeof_conn_info_version       = 1 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] nvmet_ns_id                    = 10 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] nvmet_port_id                  = 1 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] osapi_max_limit                = 1000 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] osapi_volume_ext_list          = [] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] osapi_volume_listen_port       = 8776 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] osapi_volume_use_ssl           = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] osapi_volume_workers           = 2 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] per_volume_size_limit          = -1 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] periodic_fuzzy_delay           = 60 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] periodic_interval              = 60 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] public_endpoint                = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] publish_errors                 = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] quota_backup_gigabytes         = 1000 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] quota_backups                  = 10 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] quota_gigabytes                = 1000 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] quota_groups                   = 10 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] quota_snapshots                = 10 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] quota_volumes                  = 10 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] rate_limit_burst               = 0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] rate_limit_except_level        = CRITICAL {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] rate_limit_interval            = 0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] reinit_driver_count            = 3 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] replication_device             = **** {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] report_discard_supported       = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] report_interval                = 120 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] reservation_clean_interval     = 86400 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] reservation_expire             = 86400 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] reserved_image_namespaces      = [] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] reserved_percentage            = 0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] rpc_response_timeout           = 120 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] run_external_periodic_tasks    = True {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] scst_target_driver             = iscsi {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] scst_target_iqn_name           = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] service_down_time              = 720 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] shell_completion               = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] snapshot_name_template         = snapshot-%s {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] snapshot_same_host             = True {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] split_loggers                  = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] state_path                     = /opt/stack/data/cinder {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] storage_availability_zone      = nova {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] storage_protocol               = iSCSI {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] syslog_log_facility            = LOG_USER {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] target_helper                  = lioadm {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] target_ip_address              = 192.168.122.32 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] target_port                    = 3260 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] target_protocol                = iscsi {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] target_secondary_ip_addresses  = [] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] trace_flags                    = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] transport_url                  = **** {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] until_refresh                  = 0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] use_chap_auth                  = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] use_default_quota_class        = True {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] use_journal                    = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] use_json                       = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] use_multipath_for_image_xfer   = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] use_stderr                     = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] use_syslog                     = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] verify_glance_signatures       = enabled {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] volume_api_class               = cinder.volume.api.API {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] volume_backend_name            = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] volume_clear                   = zero {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] volume_clear_ionice            = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] volume_clear_size              = 0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] volume_copy_bps_limit          = 0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] volume_dd_blocksize            = 1M {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] volume_name_template           = volume-%s {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] volume_service_inithost_offload = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] volume_usage_audit_period      = month {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] zoning_mode                    = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] oslo_concurrency.disable_process_locking = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] keystone_authtoken.admin_password = **** {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] keystone_authtoken.admin_token = **** {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] keystone_authtoken.admin_user  = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] keystone_authtoken.auth_port   = 35357 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] keystone_authtoken.auth_protocol = https {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] keystone_authtoken.auth_section = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] keystone_authtoken.auth_type   = password {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] keystone_authtoken.auth_uri    = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] keystone_authtoken.auth_version = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] keystone_authtoken.cache       = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] keystone_authtoken.certfile    = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] keystone_authtoken.delay_auth_decision = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] keystone_authtoken.http_connect_timeout = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] keystone_authtoken.identity_uri = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] keystone_authtoken.include_service_catalog = True {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] keystone_authtoken.insecure    = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] keystone_authtoken.interface   = public {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] keystone_authtoken.keyfile     = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] keystone_authtoken.memcache_password =  {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] keystone_authtoken.memcache_username =  {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] keystone_authtoken.region_name = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] keystone_authtoken.service_token_roles_required = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] keystone_authtoken.service_type = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] keystone_authtoken.token_cache_time = 300 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.32/identity {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] cache.backend                  = dogpile.cache.null {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] cache.backend_argument         = **** {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] cache.backend_expiration_time  = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] cache.config_prefix            = cache.oslo {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] cache.debug_cache_backend      = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] cache.enable_retry_client      = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] cache.enable_socket_keepalive  = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] cache.enabled                  = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] cache.enforce_fips_mode        = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] cache.expiration_time          = 600 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] cache.hashclient_retry_attempts = 2 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] cache.memcache_dead_retry      = 300 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] cache.memcache_pool_maxsize    = 10 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] cache.memcache_sasl_enabled    = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] cache.password                 = **** {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] cache.proxies                  = [] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] cache.redis_db                 = 0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] cache.redis_sentinel_service_name = mymaster {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] cache.redis_server             = localhost:6379 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] cache.retry_attempts           = 2 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] cache.retry_delay              = 0.0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] cache.socket_keepalive_count   = 1 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] cache.socket_keepalive_idle    = 1 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] cache.socket_keepalive_interval = 1 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] cache.socket_timeout           = 1.0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] cache.tls_allowed_ciphers      = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] cache.tls_cafile               = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] cache.tls_certfile             = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] cache.tls_enabled              = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] cache.tls_keyfile              = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] cache.username                 = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] coordination.backend_url       = **** {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] database.asyncio_connection    = **** {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] database.asyncio_slave_connection = **** {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] database.backend               = sqlalchemy {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] database.connection            = **** {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] database.connection_debug      = 0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] database.connection_parameters =  {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] database.connection_recycle_time = 3600 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] database.connection_trace      = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] database.db_inc_retry_interval = True {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] database.db_max_retries        = 20 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] database.db_max_retry_interval = 10 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] database.db_retry_interval     = 1 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] database.max_overflow          = 50 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] database.max_pool_size         = 5 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] database.max_retries           = 10 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] database.mysql_wsrep_sync_wait = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] database.pool_timeout          = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] database.retry_interval        = 10 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] database.slave_connection      = **** {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] database.sqlite_synchronous    = True {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] database.synchronous_reader    = True {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] database.use_db_reconnect      = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] profiler.connection_string     = messaging:// {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] profiler.enabled               = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] profiler.es_doc_type           = notification {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] profiler.es_scroll_size        = 10000 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] profiler.es_scroll_time        = 2m {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] profiler.filter_error_trace    = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] profiler.hmac_keys             = **** {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] profiler.sentinel_service_name = mymaster {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] profiler.socket_timeout        = 0.1 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] profiler.trace_requests        = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] profiler.trace_sqlalchemy      = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] profiler_jaeger.process_tags   = {} {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] profiler_jaeger.service_name_prefix = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] profiler_otlp.service_name_prefix = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] oslo_policy.enforce_new_defaults = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: WARNING oslo_config.cfg [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] oslo_policy.enforce_scope      = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] oslo_policy.policy_default_rule = default {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] oslo_policy.policy_file        = policy.yaml {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] privsep_osbrick.group          = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] privsep_osbrick.helper_command = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] privsep_osbrick.user           = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] cinder_sys_admin.group         = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] cinder_sys_admin.helper_command = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] cinder_sys_admin.user          = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] service_user.auth_section      = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] service_user.auth_type         = password {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] service_user.cafile            = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] service_user.certfile          = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] service_user.collect_timing    = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] service_user.insecure          = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] service_user.keyfile           = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] service_user.send_service_user_token = True {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] service_user.split_loggers     = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] service_user.timeout           = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] glance.auth_section            = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] glance.auth_type               = password {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] glance.certfile                = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] glance.collect_timing          = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] glance.insecure                = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] glance.keyfile                 = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] glance.region_name             = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] glance.split_loggers           = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] glance.timeout                 = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_defaults.backend_availability_zone = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_defaults.chap_password = **** {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_defaults.chap_username =  {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_defaults.disk_geometry = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_defaults.driver_client_cert = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_defaults.driver_client_cert_key = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_defaults.driver_data_namespace = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_defaults.driver_use_ssl = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_defaults.enable_unsupported_driver = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_defaults.extra_capabilities = {} {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_defaults.filter_function = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_defaults.goodness_function = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_defaults.iscsi_target_flags =  {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_defaults.iscsi_write_cache = on {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_defaults.iser_helper   = tgtadm {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_defaults.iser_ip_address = 192.168.122.32 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_defaults.iser_port     = 3260 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_defaults.lvm_share_target = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_defaults.lvm_type      = auto {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_defaults.num_shell_tries = 3 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_defaults.nvmet_port_id = 1 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_defaults.replication_device = **** {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_defaults.report_discard_supported = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_defaults.reserved_percentage = 0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_defaults.scst_target_driver = iscsi {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_defaults.scst_target_iqn_name = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_defaults.storage_protocol = iSCSI {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_defaults.target_helper = tgtadm {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_defaults.target_ip_address = 192.168.122.32 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_defaults.target_port   = 3260 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_defaults.target_protocol = iscsi {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_defaults.trace_flags   = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_defaults.unique_fqdn_network = True {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_defaults.use_chap_auth = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_defaults.volume_backend_name = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_defaults.volume_clear  = zero {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_defaults.volume_clear_ionice = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_defaults.volume_clear_size = 0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] oslo_reports.file_event_handler = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] oslo_reports.log_dir           = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.backend_availability_zone = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.backend_host       = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.chap_password      = **** {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.chap_username      = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.disk_geometry      = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.driver_client_cert = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.driver_data_namespace = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.extra_capabilities = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.filter_function    = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.goodness_function  = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.iser_helper        = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.iser_ip_address    = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.iser_port          = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.iser_target_prefix = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.lvm_share_target   = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.lvm_type           = auto {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.num_shell_tries    = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.replication_device = **** {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.report_discard_supported = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.reserved_percentage = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.scst_target_driver = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.storage_protocol   = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.target_helper      = lioadm {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.target_ip_address  = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.target_port        = 3260 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.trace_flags        = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.use_chap_auth      = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.volume_clear       = zero {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.volume_clear_size  = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] lvmdriver-1.volumes_dir        = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] oslo_messaging_rabbit.ssl      = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack sudo[72873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack sudo[72873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] oslo_messaging_notifications.driver = [] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] oslo_messaging_notifications.retry = -1 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] key_manager.fixed_key          = **** {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] barbican.barbican_api_version  = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] barbican.barbican_endpoint     = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] barbican.barbican_endpoint_type = public {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] barbican.barbican_region_name  = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] barbican.cafile                = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] barbican.certfile              = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] barbican.collect_timing        = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] barbican.insecure              = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] barbican.keyfile               = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] barbican.number_of_retries     = 60 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] barbican.retry_delay           = 1 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] barbican.send_service_user_token = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] barbican.split_loggers         = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] barbican.timeout               = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] barbican.verify_ssl            = True {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] barbican.verify_ssl_path       = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] barbican_service_user.auth_section = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] barbican_service_user.auth_type = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] barbican_service_user.cafile   = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] barbican_service_user.certfile = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] barbican_service_user.collect_timing = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] barbican_service_user.insecure = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] barbican_service_user.keyfile  = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] barbican_service_user.split_loggers = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] barbican_service_user.timeout  = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] vault.approle_role_id          = **** {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] vault.approle_secret_id        = **** {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] vault.kv_mountpoint            = secret {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] vault.kv_path                  = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] vault.kv_version               = 2 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] vault.namespace                = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] vault.root_token_id            = **** {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] vault.ssl_ca_crt_file          = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] vault.timeout                  = 60.0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] vault.use_ssl                  = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:47:26 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] ******************************************************************************** {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 15 15:47:26 devstack sudo[72873]: pam_unix(sudo:session): session closed for user root
Apr 15 15:47:26 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.499s {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:47:26 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:47:26 devstack sudo[72879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 15 15:47:26 devstack sudo[72879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:47:27 devstack sudo[72879]: pam_unix(sudo:session): session closed for user root
Apr 15 15:47:27 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.458s {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:47:27 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 15:47:27 devstack cinder-volume[72869]: INFO cinder.brick.local_dev.lvm [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Apr 15 15:47:27 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:47:27 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:47:27 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:47:27 devstack sudo[73078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 15 15:47:27 devstack sudo[73078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:47:27 devstack sudo[73078]: pam_unix(sudo:session): session closed for user root
Apr 15 15:47:27 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.539s {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:47:27 devstack cinder-volume[72869]: DEBUG cinder.brick.local_dev.lvm [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72869) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Apr 15 15:47:27 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:47:28 devstack sudo[73293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 15 15:47:28 devstack sudo[73293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:47:28 devstack sudo[73293]: pam_unix(sudo:session): session closed for user root
Apr 15 15:47:28 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.791s {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:47:28 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:47:28 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.013s {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:47:28 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:47:28 devstack sudo[73476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 15 15:47:28 devstack sudo[73476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:47:29 devstack sudo[73476]: pam_unix(sudo:session): session closed for user root
Apr 15 15:47:29 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.519s {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:47:29 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:47:29 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.013s {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:47:29 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:47:29 devstack sudo[73565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Apr 15 15:47:29 devstack sudo[73565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:47:29 devstack sudo[73565]: pam_unix(sudo:session): session closed for user root
Apr 15 15:47:29 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.445s {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:47:29 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:47:29 devstack sudo[73571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 15 15:47:29 devstack sudo[73571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:47:30 devstack sudo[73571]: pam_unix(sudo:session): session closed for user root
Apr 15 15:47:30 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.448s {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:47:30 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:47:30 devstack sudo[73574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 15 15:47:30 devstack sudo[73574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:47:30 devstack sudo[73574]: pam_unix(sudo:session): session closed for user root
Apr 15 15:47:30 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.434s {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:47:30 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:47:30 devstack sudo[73579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 15 15:47:30 devstack sudo[73579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:47:31 devstack sudo[73579]: pam_unix(sudo:session): session closed for user root
Apr 15 15:47:31 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.447s {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:47:31 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:47:31 devstack sudo[73582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 15 15:47:31 devstack sudo[73582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:47:31 devstack sudo[73582]: pam_unix(sudo:session): session closed for user root
Apr 15 15:47:31 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.461s {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:47:31 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:47:31 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:47:31 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:47:31 devstack sudo[73591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 15 15:47:31 devstack sudo[73591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:47:32 devstack sudo[73591]: pam_unix(sudo:session): session closed for user root
Apr 15 15:47:32 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.431s {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:47:32 devstack cinder-volume[72869]: INFO cinder.volume.drivers.lvm [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] Enabling LVM thin provisioning by default because a thin pool exists.
Apr 15 15:47:32 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:47:32 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:47:32 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:47:32 devstack sudo[73595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 15 15:47:32 devstack sudo[73595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:47:32 devstack sudo[73595]: pam_unix(sudo:session): session closed for user root
Apr 15 15:47:32 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.449s {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:47:32 devstack cinder-volume[72869]: DEBUG cinder.volume.drivers.lvm [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] Updating volume stats {{(pid=72869) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 15 15:47:32 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:47:32 devstack sudo[73604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 15 15:47:32 devstack sudo[73604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:47:32 devstack sudo[73604]: pam_unix(sudo:session): session closed for user root
Apr 15 15:47:32 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.487s {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:47:32 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:47:33 devstack sudo[73716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 15 15:47:33 devstack sudo[73716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:47:33 devstack sudo[73716]: pam_unix(sudo:session): session closed for user root
Apr 15 15:47:33 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.460s {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:47:33 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:47:33 devstack sudo[73858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 15 15:47:33 devstack sudo[73858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:47:33 devstack sudo[73858]: pam_unix(sudo:session): session closed for user root
Apr 15 15:47:33 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.432s {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:47:33 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:47:33 devstack sudo[73861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 15 15:47:33 devstack sudo[73861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:47:34 devstack sudo[73861]: pam_unix(sudo:session): session closed for user root
Apr 15 15:47:34 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.429s {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:47:34 devstack cinder-volume[72869]: INFO cinder.volume.driver [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] Driver hasn't implemented _init_vendor_properties()
Apr 15 15:47:34 devstack cinder-volume[72869]: DEBUG cinder.volume.driver [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72869) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 15 15:47:34 devstack cinder-volume[72869]: DEBUG oslo_db.sqlalchemy.engines [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72869) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 15 15:47:34 devstack cinder-volume[72869]: DEBUG dbcounter [-] [72869] Writer thread running {{(pid=72869) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 15 15:47:34 devstack cinder-volume[72869]: DEBUG cinder.db.sqlalchemy.api [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] Building query based on filter {{(pid=72869) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 15 15:47:34 devstack cinder-volume[72869]: DEBUG cinder.image.image_utils [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72869) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 15 15:47:34 devstack cinder-volume[72869]: INFO cinder.keymgr.migration [None req-396d7e04-8de6-4db7-9920-8cf1542e5db6 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 15 15:47:34 devstack cinder-volume[72869]: DEBUG cinder.volume.drivers.lvm [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] Updating volume stats {{(pid=72869) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 15 15:47:34 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:47:34 devstack sudo[73867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 15 15:47:34 devstack sudo[73867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:47:34 devstack sudo[73867]: pam_unix(sudo:session): session closed for user root
Apr 15 15:47:34 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.436s {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:47:34 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:47:34 devstack sudo[73877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 15 15:47:34 devstack sudo[73877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:47:35 devstack sudo[73877]: pam_unix(sudo:session): session closed for user root
Apr 15 15:47:35 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.475s {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:47:35 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:47:35 devstack sudo[73880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 15 15:47:35 devstack sudo[73880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:47:35 devstack sudo[73880]: pam_unix(sudo:session): session closed for user root
Apr 15 15:47:35 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.509s {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:47:35 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:47:35 devstack sudo[73887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 15 15:47:35 devstack sudo[73887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:47:36 devstack sudo[73887]: pam_unix(sudo:session): session closed for user root
Apr 15 15:47:36 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.485s {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:47:36 devstack cinder-volume[72869]: DEBUG cinder.manager [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] Notifying Schedulers of capabilities ... {{(pid=72869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:47:36 devstack cinder-volume[72869]: INFO cinder.volume.manager [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] Driver initialization completed successfully.
Apr 15 15:47:36 devstack cinder-volume[72869]: INFO cinder.manager [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] Initiating service 2 cleanup
Apr 15 15:47:36 devstack cinder-volume[72869]: INFO cinder.manager [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] Service 2 cleanup completed.
Apr 15 15:47:36 devstack cinder-volume[72869]: DEBUG cinder.service [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] Creating RPC server for service cinder-volume {{(pid=72869) start /opt/stack/cinder/cinder/service.py:231}}
Apr 15 15:47:36 devstack cinder-volume[72869]: DEBUG cinder.service [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72869) start /opt/stack/cinder/cinder/service.py:237}}
Apr 15 15:47:36 devstack cinder-volume[72766]: DEBUG dbcounter [-] [72766] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72766) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 15:47:36 devstack cinder-volume[72869]: INFO cinder.volume.manager [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Apr 15 15:47:36 devstack cinder-volume[72869]: DEBUG cinder.volume.drivers.lvm [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] Updating volume stats {{(pid=72869) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 15 15:47:36 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:47:36 devstack sudo[73893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 15 15:47:36 devstack sudo[73893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:47:36 devstack sudo[73893]: pam_unix(sudo:session): session closed for user root
Apr 15 15:47:36 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.441s {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:47:36 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:47:36 devstack sudo[73897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 15 15:47:36 devstack sudo[73897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:47:37 devstack sudo[73897]: pam_unix(sudo:session): session closed for user root
Apr 15 15:47:37 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.500s {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:47:37 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:47:37 devstack sudo[73901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 15 15:47:37 devstack sudo[73901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:47:37 devstack sudo[73901]: pam_unix(sudo:session): session closed for user root
Apr 15 15:47:37 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.460s {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:47:37 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:47:37 devstack sudo[73988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 15 15:47:37 devstack sudo[73988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:47:38 devstack sudo[73988]: pam_unix(sudo:session): session closed for user root
Apr 15 15:47:38 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.425s {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:47:38 devstack cinder-volume[72869]: INFO cinder.volume.manager [None req-154373e5-3590-4810-9e1c-14e0331f9eae None None] Driver post RPC initialization completed successfully.
Apr 15 15:47:48 devstack cinder-volume[72869]: DEBUG dbcounter [-] [72869] Writing DB stats cinder:SELECT=4 {{(pid=72869) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 15:47:48 devstack cinder-volume[72869]: DEBUG dbcounter [-] [72869] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=72869) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 15:48:32 devstack cinder-volume[72869]: DEBUG oslo_service.periodic_task [None req-4dad1414-548d-4875-ae34-835e773c7da9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72869) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 15 15:48:32 devstack cinder-volume[72869]: DEBUG cinder.volume.drivers.lvm [None req-4dad1414-548d-4875-ae34-835e773c7da9 None None] Updating volume stats {{(pid=72869) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 15 15:48:32 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-4dad1414-548d-4875-ae34-835e773c7da9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:48:32 devstack sudo[77455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 15 15:48:32 devstack sudo[77455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:48:32 devstack sudo[77455]: pam_unix(sudo:session): session closed for user root
Apr 15 15:48:32 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-4dad1414-548d-4875-ae34-835e773c7da9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.429s {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:48:32 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-4dad1414-548d-4875-ae34-835e773c7da9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:48:32 devstack sudo[77818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 15 15:48:32 devstack sudo[77818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:48:33 devstack sudo[77818]: pam_unix(sudo:session): session closed for user root
Apr 15 15:48:33 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-4dad1414-548d-4875-ae34-835e773c7da9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.438s {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:48:33 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-4dad1414-548d-4875-ae34-835e773c7da9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:48:33 devstack sudo[78196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 15 15:48:33 devstack sudo[78196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:48:33 devstack sudo[78196]: pam_unix(sudo:session): session closed for user root
Apr 15 15:48:33 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-4dad1414-548d-4875-ae34-835e773c7da9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.444s {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:48:33 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-4dad1414-548d-4875-ae34-835e773c7da9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:48:33 devstack sudo[78586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 15 15:48:33 devstack sudo[78586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:48:33 devstack sudo[78586]: pam_unix(sudo:session): session closed for user root
Apr 15 15:48:34 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-4dad1414-548d-4875-ae34-835e773c7da9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.451s {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:48:34 devstack cinder-volume[72869]: DEBUG cinder.manager [None req-4dad1414-548d-4875-ae34-835e773c7da9 None None] Notifying Schedulers of capabilities ... {{(pid=72869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:49:32 devstack cinder-volume[72869]: DEBUG oslo_service.periodic_task [None req-4dad1414-548d-4875-ae34-835e773c7da9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72869) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 15 15:49:32 devstack cinder-volume[72869]: DEBUG cinder.volume.drivers.lvm [None req-4dad1414-548d-4875-ae34-835e773c7da9 None None] Updating volume stats {{(pid=72869) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 15 15:49:32 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-4dad1414-548d-4875-ae34-835e773c7da9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:49:32 devstack sudo[79347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 15 15:49:32 devstack sudo[79347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:49:32 devstack sudo[79347]: pam_unix(sudo:session): session closed for user root
Apr 15 15:49:32 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-4dad1414-548d-4875-ae34-835e773c7da9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.425s {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:49:32 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-4dad1414-548d-4875-ae34-835e773c7da9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:49:32 devstack sudo[79466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 15 15:49:32 devstack sudo[79466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:49:33 devstack sudo[79466]: pam_unix(sudo:session): session closed for user root
Apr 15 15:49:33 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-4dad1414-548d-4875-ae34-835e773c7da9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.427s {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:49:33 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-4dad1414-548d-4875-ae34-835e773c7da9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:49:33 devstack sudo[79633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 15 15:49:33 devstack sudo[79633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:49:33 devstack sudo[79633]: pam_unix(sudo:session): session closed for user root
Apr 15 15:49:33 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-4dad1414-548d-4875-ae34-835e773c7da9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.431s {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:49:33 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-4dad1414-548d-4875-ae34-835e773c7da9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:49:33 devstack sudo[79649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 15 15:49:33 devstack sudo[79649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:49:33 devstack sudo[79649]: pam_unix(sudo:session): session closed for user root
Apr 15 15:49:33 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-4dad1414-548d-4875-ae34-835e773c7da9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.429s {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:49:33 devstack cinder-volume[72869]: DEBUG cinder.manager [None req-4dad1414-548d-4875-ae34-835e773c7da9 None None] Notifying Schedulers of capabilities ... {{(pid=72869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:49:48 devstack cinder-volume[72869]: DEBUG dbcounter [-] [72869] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=72869) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 15:50:32 devstack cinder-volume[72869]: DEBUG oslo_service.periodic_task [None req-4dad1414-548d-4875-ae34-835e773c7da9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72869) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 15 15:50:32 devstack cinder-volume[72869]: DEBUG cinder.volume.drivers.lvm [None req-4dad1414-548d-4875-ae34-835e773c7da9 None None] Updating volume stats {{(pid=72869) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 15 15:50:32 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-4dad1414-548d-4875-ae34-835e773c7da9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:50:32 devstack sudo[81420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 15 15:50:32 devstack sudo[81420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:50:32 devstack sudo[81420]: pam_unix(sudo:session): session closed for user root
Apr 15 15:50:32 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-4dad1414-548d-4875-ae34-835e773c7da9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.423s {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:50:32 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-4dad1414-548d-4875-ae34-835e773c7da9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:50:32 devstack sudo[81423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 15 15:50:32 devstack sudo[81423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:50:33 devstack sudo[81423]: pam_unix(sudo:session): session closed for user root
Apr 15 15:50:33 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-4dad1414-548d-4875-ae34-835e773c7da9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.469s {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:50:33 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-4dad1414-548d-4875-ae34-835e773c7da9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:50:33 devstack sudo[81449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 15 15:50:33 devstack sudo[81449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:50:33 devstack sudo[81449]: pam_unix(sudo:session): session closed for user root
Apr 15 15:50:33 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-4dad1414-548d-4875-ae34-835e773c7da9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.416s {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:50:33 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-4dad1414-548d-4875-ae34-835e773c7da9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:50:33 devstack sudo[81455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 15 15:50:33 devstack sudo[81455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:50:33 devstack sudo[81455]: pam_unix(sudo:session): session closed for user root
Apr 15 15:50:33 devstack cinder-volume[72869]: DEBUG oslo_concurrency.processutils [None req-4dad1414-548d-4875-ae34-835e773c7da9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.440s {{(pid=72869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:50:33 devstack cinder-volume[72869]: DEBUG cinder.manager [None req-4dad1414-548d-4875-ae34-835e773c7da9 None None] Notifying Schedulers of capabilities ... {{(pid=72869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:50:49 devstack cinder-volume[72766]: INFO oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] Caught SIGTERM, stopping children
Apr 15 15:50:49 devstack cinder-volume[72766]: DEBUG oslo_concurrency.lockutils [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] Acquiring lock "singleton_lock" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 15 15:50:49 devstack cinder-volume[72766]: DEBUG oslo_concurrency.lockutils [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] Acquired lock "singleton_lock" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 15 15:50:49 devstack cinder-volume[72766]: DEBUG oslo_concurrency.lockutils [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] Releasing lock "singleton_lock" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 15 15:50:49 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] Stop services. {{(pid=72766) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 15 15:50:49 devstack cinder-volume[72766]: DEBUG oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] Killing children. {{(pid=72766) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 15 15:50:49 devstack cinder-volume[72766]: INFO oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] Waiting on 1 children to exit
Apr 15 15:50:51 devstack cinder-volume[72869]: DEBUG oslo_concurrency.lockutils [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] Acquiring lock "singleton_lock" {{(pid=72869) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 15 15:50:51 devstack cinder-volume[72869]: DEBUG oslo_concurrency.lockutils [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] Acquired lock "singleton_lock" {{(pid=72869) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 15 15:50:51 devstack cinder-volume[72869]: DEBUG oslo_concurrency.lockutils [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] Releasing lock "singleton_lock" {{(pid=72869) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 15 15:50:51 devstack cinder-volume[72869]: WARNING amqp [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 15 15:50:51 devstack cinder-volume[72869]: WARNING amqp [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 15 15:50:51 devstack cinder-volume[72766]: INFO oslo_service.backend._eventlet.service [None req-0755d229-3efa-4c60-8e77-55ba15cd3671 None None] Child 72869 exited with status 0
Apr 15 15:50:51 devstack cinder-volume[81968]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 15 15:50:51 devstack cinder-volume[81968]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 15 15:50:51 devstack cinder-volume[81968]: we strongly recommend against using it for new projects.
Apr 15 15:50:51 devstack cinder-volume[81968]: If you are already using Eventlet, we recommend migrating to a different
Apr 15 15:50:51 devstack cinder-volume[81968]: framework.  For more detail see
Apr 15 15:50:51 devstack cinder-volume[81968]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 15 15:50:51 devstack cinder-volume[81968]:   import eventlet  # noqa
Apr 15 15:50:53 devstack cinder-volume[81968]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81968) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 15 15:50:53 devstack cinder-volume[81968]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81968) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 15 15:50:53 devstack cinder-volume[81968]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81968) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 15 15:50:54 devstack cinder-volume[81968]: INFO dbcounter [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] Registered counter for database cinder
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_db.sqlalchemy.engines [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81968) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG dbcounter [-] [81968] Writer thread running {{(pid=81968) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 15 15:50:54 devstack cinder-volume[81968]: INFO cinder.rpc [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 15 15:50:54 devstack cinder-volume[81968]: INFO cinder.rpc [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_db.sqlalchemy.engines [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81968) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 15 15:50:54 devstack cinder-volume[81968]: INFO cinder.volume.manager [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] Determined volume DB was empty at startup.
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG cinder.volume.manager [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81968) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 15 15:50:54 devstack cinder-volume[81968]: INFO cinder.volume.manager [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 15 15:50:54 devstack cinder-volume[81968]: WARNING stevedore.named [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 15 15:50:54 devstack cinder-volume[81968]: WARNING castellan.key_manager [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 15 15:50:54 devstack cinder-volume[81968]: WARNING cinder.keymgr.conf_key_mgr [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 15 15:50:54 devstack cinder-volume[81968]: INFO cinder.volume.manager [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_db.sqlalchemy.engines [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81968) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 15 15:50:54 devstack cinder-volume[81968]: INFO oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] Starting 1 workers
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] Started child 82087 {{(pid=81968) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] Full set of CONF: {{(pid=81968) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] ******************************************************************************** {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] Configuration options gathered from: {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] ================================================================================ {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] allow_availability_zone_fallback = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] allow_compression_on_image_upload = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] allowed_direct_url_schemes     = [] {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] api_rate_limit                 = True {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] auth_strategy                  = keystone {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_availability_zone      = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_host                   = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_name                   = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_stats_polling_interval = 60 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backup_api_class               = cinder.backup.api.API {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backup_name_template           = backup-%s {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backup_use_same_host           = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backup_use_temp_snapshot       = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] chap_password                  = **** {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] chap_username                  =  {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] cinder_internal_tenant_project_id = 51caa844382f4aacb25925787331cfbe {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] cinder_internal_tenant_user_id = 2c3f02f90361444288150fa1c935f3c6 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] cluster                        = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] compression_format             = gzip {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] compute_api_class              = cinder.compute.nova.API {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] config_dir                     = [] {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] config_source                  = [] {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] control_exchange               = openstack {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] debug                          = True {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] default_availability_zone      = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] default_group_type             = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] default_volume_type            = QuobyteHD {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] disk_geometry                  = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] driver_client_cert             = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] driver_client_cert_key         = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] driver_data_namespace          = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] driver_ssl_cert_path           = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] driver_ssl_cert_verify         = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] driver_use_ssl                 = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] enable_new_services            = True {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] enable_unsupported_driver      = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] enabled_backends               = ['QuobyteHD'] {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] enforce_multipath_for_image_xfer = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] filter_function                = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] glance_api_insecure            = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] glance_api_servers             = ['http://192.168.122.32/image'] {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] glance_api_ssl_compression     = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] glance_ca_certificates_file    = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] glance_catalog_info            = image:glance:publicURL {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] glance_certfile                = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] glance_keyfile                 = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] glance_num_retries             = 3 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] glance_request_timeout         = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] goodness_function              = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] graceful_shutdown_timeout      = 5 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] group_api_class                = cinder.group.api.API {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] host                           = devstack {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] image_compress_on_upload       = True {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] image_conversion_address_space_limit = 1 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] image_conversion_cpu_limit     = 60 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] image_conversion_disable       = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] image_upload_use_cinder_backend = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] image_upload_use_internal_tenant = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] image_volume_cache_enabled     = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] image_volume_cache_max_count   = 0 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] image_volume_cache_max_size_gb = 0 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] init_host_max_objects_retrieval = 0 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] instance_format                = [instance: %(uuid)s]  {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] iscsi_target_flags             =  {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] iscsi_write_cache              = on {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] iser_helper                    = tgtadm {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[82087]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] iser_ip_address                = 192.168.122.32 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] iser_port                      = 3260 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] log_color                      = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] log_config_append              = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] log_dir                        = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] log_file                       = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] log_options                    = True {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] log_rotate_interval            = 1 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] log_rotate_interval_type       = days {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] log_rotation_type              = none {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] max_age                        = 0 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] max_logfile_count              = 30 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] max_logfile_size_mb            = 200 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] max_over_subscription_ratio    = 20.0 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] message_reap_interval          = 86400 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] message_ttl                    = 2592000 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] migration_create_volume_timeout_secs = 300 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] monkey_patch                   = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] monkey_patch_modules           = [] {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] my_ip                          = 192.168.122.32 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] no_snapshot_gb_quota           = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] num_iser_scan_tries            = 3 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] num_shell_tries                = 3 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] num_volume_device_scan_tries   = 3 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] nvmeof_conn_info_version       = 1 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] nvmet_ns_id                    = 10 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] nvmet_port_id                  = 1 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] osapi_max_limit                = 1000 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] osapi_volume_ext_list          = [] {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] osapi_volume_listen_port       = 8776 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] osapi_volume_use_ssl           = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] osapi_volume_workers           = 2 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] per_volume_size_limit          = -1 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] periodic_fuzzy_delay           = 60 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] periodic_interval              = 60 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] public_endpoint                = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] publish_errors                 = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] quota_backup_gigabytes         = 1000 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] quota_backups                  = 10 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] quota_gigabytes                = 1000 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] quota_groups                   = 10 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] quota_snapshots                = 10 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] quota_volumes                  = 10 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] rate_limit_burst               = 0 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] rate_limit_except_level        = CRITICAL {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] rate_limit_interval            = 0 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] reinit_driver_count            = 3 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] replication_device             = **** {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] report_discard_supported       = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] report_interval                = 120 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] reservation_clean_interval     = 86400 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] reservation_expire             = 86400 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] reserved_image_namespaces      = [] {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] reserved_percentage            = 0 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] rpc_response_timeout           = 120 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] run_external_periodic_tasks    = True {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] scst_target_driver             = iscsi {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] scst_target_iqn_name           = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] service_down_time              = 720 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] shell_completion               = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] snapshot_name_template         = snapshot-%s {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] split_loggers                  = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] state_path                     = /opt/stack/data/cinder {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] storage_availability_zone      = nova {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] storage_protocol               = iSCSI {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] syslog_log_facility            = LOG_USER {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] target_helper                  = lioadm {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] target_ip_address              = 192.168.122.32 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] target_port                    = 3260 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] target_protocol                = iscsi {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] target_secondary_ip_addresses  = [] {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] trace_flags                    = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] transport_url                  = **** {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] until_refresh                  = 0 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] use_chap_auth                  = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] use_default_quota_class        = True {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] use_journal                    = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] use_json                       = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] use_multipath_for_image_xfer   = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] use_stderr                     = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] use_syslog                     = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] verify_glance_signatures       = enabled {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] volume_api_class               = cinder.volume.api.API {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] volume_backend_name            = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] volume_clear                   = zero {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] volume_clear_ionice            = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] volume_clear_size              = 0 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] volume_copy_bps_limit          = 0 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] volume_dd_blocksize            = 1M {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] volume_name_template           = volume-%s {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] volume_service_inithost_offload = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] volume_usage_audit_period      = month {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] zoning_mode                    = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] oslo_concurrency.disable_process_locking = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] keystone_authtoken.admin_password = **** {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] keystone_authtoken.admin_token = **** {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] keystone_authtoken.admin_user  = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] keystone_authtoken.auth_port   = 35357 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] keystone_authtoken.auth_protocol = https {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] keystone_authtoken.auth_section = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] keystone_authtoken.auth_type   = password {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] keystone_authtoken.auth_uri    = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] keystone_authtoken.auth_version = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] keystone_authtoken.cache       = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] keystone_authtoken.certfile    = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] keystone_authtoken.delay_auth_decision = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] keystone_authtoken.http_connect_timeout = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] keystone_authtoken.identity_uri = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] keystone_authtoken.include_service_catalog = True {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] keystone_authtoken.insecure    = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] keystone_authtoken.interface   = public {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] keystone_authtoken.keyfile     = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] keystone_authtoken.memcache_password =  {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] keystone_authtoken.memcache_username =  {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] keystone_authtoken.region_name = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] keystone_authtoken.service_token_roles_required = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] keystone_authtoken.service_type = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] keystone_authtoken.token_cache_time = 300 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.32/identity {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] cache.backend                  = dogpile.cache.null {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] cache.backend_argument         = **** {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] cache.backend_expiration_time  = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] cache.config_prefix            = cache.oslo {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] cache.debug_cache_backend      = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] cache.enable_retry_client      = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] cache.enable_socket_keepalive  = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] cache.enabled                  = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] cache.enforce_fips_mode        = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] cache.expiration_time          = 600 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] cache.hashclient_retry_attempts = 2 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] cache.memcache_dead_retry      = 300 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] cache.memcache_pool_maxsize    = 10 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] cache.memcache_sasl_enabled    = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] cache.password                 = **** {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] cache.proxies                  = [] {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] cache.redis_db                 = 0 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] cache.redis_sentinel_service_name = mymaster {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] cache.redis_server             = localhost:6379 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] cache.retry_attempts           = 2 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] cache.retry_delay              = 0.0 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] cache.socket_keepalive_count   = 1 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] cache.socket_keepalive_idle    = 1 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] cache.socket_keepalive_interval = 1 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] cache.socket_timeout           = 1.0 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] cache.tls_allowed_ciphers      = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] cache.tls_cafile               = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] cache.tls_certfile             = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] cache.tls_enabled              = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] cache.tls_keyfile              = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] cache.username                 = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] coordination.backend_url       = **** {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] database.asyncio_connection    = **** {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] database.asyncio_slave_connection = **** {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] database.backend               = sqlalchemy {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] database.connection            = **** {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] database.connection_debug      = 0 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] database.connection_parameters =  {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] database.connection_recycle_time = 3600 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] database.connection_trace      = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] database.db_inc_retry_interval = True {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] database.db_max_retries        = 20 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] database.db_max_retry_interval = 10 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] database.db_retry_interval     = 1 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] database.max_overflow          = 50 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] database.max_pool_size         = 5 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] database.max_retries           = 10 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] database.mysql_wsrep_sync_wait = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] database.pool_timeout          = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] database.retry_interval        = 10 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] database.slave_connection      = **** {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] database.sqlite_synchronous    = True {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] database.synchronous_reader    = True {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] database.use_db_reconnect      = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] profiler.connection_string     = messaging:// {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] profiler.enabled               = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] profiler.es_doc_type           = notification {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] profiler.es_scroll_size        = 10000 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] profiler.es_scroll_time        = 2m {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] profiler.filter_error_trace    = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] profiler.hmac_keys             = **** {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] profiler.sentinel_service_name = mymaster {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] profiler.socket_timeout        = 0.1 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] profiler.trace_requests        = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] profiler.trace_sqlalchemy      = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] profiler_jaeger.process_tags   = {} {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] profiler_jaeger.service_name_prefix = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] profiler_otlp.service_name_prefix = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] oslo_policy.enforce_new_defaults = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: WARNING oslo_config.cfg [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] oslo_policy.enforce_scope      = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] oslo_policy.policy_default_rule = default {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] oslo_policy.policy_file        = policy.yaml {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] privsep_osbrick.group          = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] privsep_osbrick.helper_command = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] privsep_osbrick.user           = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] cinder_sys_admin.group         = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] cinder_sys_admin.helper_command = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] cinder_sys_admin.user          = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] service_user.auth_section      = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] service_user.auth_type         = password {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] service_user.cafile            = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] service_user.certfile          = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] service_user.collect_timing    = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] service_user.insecure          = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] service_user.keyfile           = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] service_user.send_service_user_token = True {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] service_user.split_loggers     = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] service_user.timeout           = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] glance.auth_section            = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] glance.auth_type               = password {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] glance.certfile                = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] glance.collect_timing          = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] glance.insecure                = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] glance.keyfile                 = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] glance.region_name             = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] glance.split_loggers           = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] glance.timeout                 = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.backend_availability_zone = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.chap_password = **** {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.chap_username =  {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.disk_geometry = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.driver_client_cert = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.driver_client_cert_key = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.driver_data_namespace = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.driver_use_ssl = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.enable_unsupported_driver = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.extra_capabilities = {} {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.filter_function = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.goodness_function = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.iscsi_target_flags =  {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.iscsi_write_cache = on {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.iser_helper   = tgtadm {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.iser_ip_address = 192.168.122.32 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.iser_port     = 3260 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.nas_host      =  {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.nas_login     = admin {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.nas_mount_options = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.nas_password  = **** {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.nas_private_key =  {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.nas_share_path =  {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.num_shell_tries = 3 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.nvmet_port_id = 1 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.quobyte_client_cfg = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.quobyte_volume_url = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.replication_device = **** {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.report_discard_supported = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.reserved_percentage = 0 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.scst_target_driver = iscsi {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.scst_target_iqn_name = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.storage_protocol = iSCSI {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.target_helper = tgtadm {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.target_ip_address = 192.168.122.32 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.target_port   = 3260 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.target_protocol = iscsi {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.trace_flags   = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.unique_fqdn_network = True {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.use_chap_auth = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.volume_backend_name = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.volume_clear  = zero {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.volume_clear_ionice = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.volume_clear_size = 0 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] oslo_reports.file_event_handler = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] oslo_reports.log_dir           = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.backend_availability_zone = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.backend_host         = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.chap_password        = **** {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.chap_username        = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.chiscsi_conf         = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.disk_geometry        = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.driver_client_cert   = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.driver_client_cert_key = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.driver_data_namespace = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.driver_use_ssl       = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.extra_capabilities   = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.filter_function      = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.goodness_function    = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.iser_helper          = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.iser_ip_address      = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.iser_port            = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.iser_target_prefix   = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.nas_host             = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.nas_login            = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.nas_mount_options    = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.nas_password         = **** {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.nas_private_key      = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.nas_share_path       = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.nas_ssh_port         = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.num_shell_tries      = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.nvmet_port_id        = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.replication_device   = **** {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.report_discard_supported = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.reserved_percentage  = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.scst_target_driver   = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.storage_protocol     = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.target_helper        = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.target_ip_address    = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.target_port          = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.target_prefix        = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.target_protocol      = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.trace_flags          = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.use_chap_auth        = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.volume_clear         = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.volume_clear_size    = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] QuobyteHD.volumes_dir          = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] oslo_messaging_rabbit.ssl      = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] oslo_messaging_notifications.driver = [] {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] oslo_messaging_notifications.retry = -1 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] oslo_messaging_notifications.transport_url = **** {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] key_manager.fixed_key          = **** {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] barbican.barbican_api_version  = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] barbican.barbican_endpoint     = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] barbican.barbican_endpoint_type = public {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] barbican.barbican_region_name  = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] barbican.cafile                = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] barbican.certfile              = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] barbican.collect_timing        = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] barbican.insecure              = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] barbican.keyfile               = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] barbican.number_of_retries     = 60 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] barbican.retry_delay           = 1 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] barbican.send_service_user_token = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] barbican.split_loggers         = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] barbican.timeout               = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] barbican.verify_ssl            = True {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] barbican.verify_ssl_path       = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] barbican_service_user.auth_section = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] barbican_service_user.auth_type = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] barbican_service_user.cafile   = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] barbican_service_user.certfile = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] barbican_service_user.collect_timing = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] barbican_service_user.insecure = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] barbican_service_user.keyfile  = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] barbican_service_user.split_loggers = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] barbican_service_user.timeout  = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] vault.approle_role_id          = **** {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] vault.approle_secret_id        = **** {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] vault.kv_mountpoint            = secret {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] vault.kv_path                  = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] vault.kv_version               = 2 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] vault.namespace                = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] vault.root_token_id            = **** {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] vault.ssl_ca_crt_file          = None {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] vault.timeout                  = 60.0 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] vault.use_ssl                  = False {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:50:54 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] ******************************************************************************** {{(pid=81968) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 15 15:50:54 devstack cinder-volume[82087]: INFO cinder.volume.manager [None req-39768087-8d73-4bda-b9d1-7b665fa88198 None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 15 15:50:54 devstack cinder-volume[82087]: DEBUG cinder.volume.drivers.remotefs [None req-39768087-8d73-4bda-b9d1-7b665fa88198 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82087) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 15 15:50:54 devstack cinder-volume[82087]: DEBUG cinder.volume.drivers.quobyte [None req-39768087-8d73-4bda-b9d1-7b665fa88198 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82087) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 15 15:50:54 devstack cinder-volume[82087]: WARNING cinder.volume.drivers.quobyte [None req-39768087-8d73-4bda-b9d1-7b665fa88198 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 15 15:50:54 devstack cinder-volume[82087]: WARNING cinder.volume.drivers.quobyte [None req-39768087-8d73-4bda-b9d1-7b665fa88198 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 15 15:50:54 devstack cinder-volume[82087]: DEBUG oslo_concurrency.processutils [None req-39768087-8d73-4bda-b9d1-7b665fa88198 None None] Running cmd (subprocess): mount.quobyte {{(pid=82087) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:50:54 devstack quobyte-client[82088]: Reading configuration file: /etc/quobyte/client.cfg
Apr 15 15:50:54 devstack quobyte-client[82088]: Invalid parameters found, error: missing mount point.
Apr 15 15:50:54 devstack quobyte-client[82088]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 15 15:50:54 devstack quobyte-client[82088]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 15 15:50:54 devstack cinder-volume[82087]: DEBUG oslo_concurrency.processutils [None req-39768087-8d73-4bda-b9d1-7b665fa88198 None None] CMD "mount.quobyte" returned: 1 in 0.061s {{(pid=82087) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:50:54 devstack cinder-volume[82087]: DEBUG oslo_concurrency.lockutils [None req-39768087-8d73-4bda-b9d1-7b665fa88198 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82087) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:50:54 devstack cinder-volume[82087]: DEBUG oslo_concurrency.lockutils [None req-39768087-8d73-4bda-b9d1-7b665fa88198 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82087) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:50:54 devstack cinder-volume[82087]: DEBUG cinder.volume.drivers.quobyte [None req-39768087-8d73-4bda-b9d1-7b665fa88198 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:50:54 devstack cinder-volume[82087]: INFO cinder.volume.drivers.quobyte [None req-39768087-8d73-4bda-b9d1-7b665fa88198 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c ...
Apr 15 15:50:54 devstack cinder-volume[82087]: DEBUG oslo_concurrency.processutils [None req-39768087-8d73-4bda-b9d1-7b665fa88198 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 -c /etc/quobyte/client-cinder.cfg {{(pid=82087) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:50:54 devstack sudo[82089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 -c /etc/quobyte/client-cinder.cfg
Apr 15 15:50:54 devstack sudo[82089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:50:55 devstack sudo[82089]: pam_unix(sudo:session): session closed for user root
Apr 15 15:50:55 devstack cinder-volume[82087]: DEBUG oslo_concurrency.processutils [None req-39768087-8d73-4bda-b9d1-7b665fa88198 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.492s {{(pid=82087) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:50:55 devstack cinder-volume[82087]: INFO cinder.volume.drivers.quobyte [None req-39768087-8d73-4bda-b9d1-7b665fa88198 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c succeeded
Apr 15 15:50:55 devstack cinder-volume[82087]: DEBUG cinder.volume.drivers.quobyte [None req-39768087-8d73-4bda-b9d1-7b665fa88198 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:50:55 devstack cinder-volume[82087]: DEBUG oslo_concurrency.lockutils [None req-39768087-8d73-4bda-b9d1-7b665fa88198 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.501s {{(pid=82087) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:50:55 devstack cinder-volume[82087]: DEBUG oslo_concurrency.processutils [None req-39768087-8d73-4bda-b9d1-7b665fa88198 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82087) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:50:55 devstack sudo[82160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:50:55 devstack sudo[82160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:50:55 devstack sudo[82160]: pam_unix(sudo:session): session closed for user root
Apr 15 15:50:55 devstack cinder-volume[82087]: DEBUG oslo_concurrency.processutils [None req-39768087-8d73-4bda-b9d1-7b665fa88198 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.381s {{(pid=82087) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:50:55 devstack cinder-volume[82087]: INFO cinder.volume.driver [None req-39768087-8d73-4bda-b9d1-7b665fa88198 None None] Driver hasn't implemented _init_vendor_properties()
Apr 15 15:50:55 devstack cinder-volume[82087]: DEBUG cinder.volume.driver [None req-39768087-8d73-4bda-b9d1-7b665fa88198 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.732810974121, 'free_capacity_gb': 1775.732810974121, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82087) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 15 15:50:55 devstack cinder-volume[82087]: DEBUG oslo_db.sqlalchemy.engines [None req-39768087-8d73-4bda-b9d1-7b665fa88198 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82087) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 15 15:50:55 devstack cinder-volume[82087]: DEBUG dbcounter [-] [82087] Writer thread running {{(pid=82087) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 15 15:50:55 devstack cinder-volume[82087]: DEBUG cinder.db.sqlalchemy.api [None req-39768087-8d73-4bda-b9d1-7b665fa88198 None None] Building query based on filter {{(pid=82087) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 15 15:50:55 devstack cinder-volume[82087]: DEBUG cinder.image.image_utils [None req-39768087-8d73-4bda-b9d1-7b665fa88198 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82087) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 15 15:50:55 devstack cinder-volume[82087]: INFO cinder.keymgr.migration [None req-25780cc3-092d-4a49-b9bd-e6ec358c3a28 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 15 15:50:55 devstack cinder-volume[82087]: DEBUG oslo_concurrency.lockutils [None req-39768087-8d73-4bda-b9d1-7b665fa88198 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82087) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:50:55 devstack cinder-volume[82087]: DEBUG oslo_concurrency.lockutils [None req-39768087-8d73-4bda-b9d1-7b665fa88198 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82087) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:50:55 devstack cinder-volume[82087]: DEBUG cinder.volume.drivers.quobyte [None req-39768087-8d73-4bda-b9d1-7b665fa88198 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:50:55 devstack cinder-volume[82087]: DEBUG cinder.volume.drivers.quobyte [None req-39768087-8d73-4bda-b9d1-7b665fa88198 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:50:55 devstack cinder-volume[82087]: DEBUG oslo_concurrency.lockutils [None req-39768087-8d73-4bda-b9d1-7b665fa88198 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82087) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:50:55 devstack cinder-volume[82087]: DEBUG oslo_concurrency.processutils [None req-39768087-8d73-4bda-b9d1-7b665fa88198 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82087) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:50:55 devstack sudo[82163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:50:55 devstack sudo[82163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:50:56 devstack sudo[82163]: pam_unix(sudo:session): session closed for user root
Apr 15 15:50:56 devstack cinder-volume[82087]: DEBUG oslo_concurrency.processutils [None req-39768087-8d73-4bda-b9d1-7b665fa88198 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.382s {{(pid=82087) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:50:56 devstack cinder-volume[82087]: DEBUG cinder.manager [None req-39768087-8d73-4bda-b9d1-7b665fa88198 None None] Notifying Schedulers of capabilities ... {{(pid=82087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:50:56 devstack cinder-volume[82087]: INFO cinder.volume.manager [None req-39768087-8d73-4bda-b9d1-7b665fa88198 None None] Driver initialization completed successfully.
Apr 15 15:50:56 devstack cinder-volume[82087]: INFO cinder.manager [None req-39768087-8d73-4bda-b9d1-7b665fa88198 None None] Initiating service 3 cleanup
Apr 15 15:50:56 devstack cinder-volume[82087]: INFO cinder.manager [None req-39768087-8d73-4bda-b9d1-7b665fa88198 None None] Service 3 cleanup completed.
Apr 15 15:50:56 devstack cinder-volume[82087]: DEBUG cinder.service [None req-39768087-8d73-4bda-b9d1-7b665fa88198 None None] Creating RPC server for service cinder-volume {{(pid=82087) start /opt/stack/cinder/cinder/service.py:231}}
Apr 15 15:50:56 devstack cinder-volume[82087]: DEBUG cinder.service [None req-39768087-8d73-4bda-b9d1-7b665fa88198 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82087) start /opt/stack/cinder/cinder/service.py:237}}
Apr 15 15:50:56 devstack cinder-volume[82087]: INFO cinder.volume.manager [None req-39768087-8d73-4bda-b9d1-7b665fa88198 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 15 15:50:56 devstack cinder-volume[82087]: DEBUG oslo_concurrency.lockutils [None req-39768087-8d73-4bda-b9d1-7b665fa88198 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82087) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:50:56 devstack cinder-volume[82087]: DEBUG oslo_concurrency.lockutils [None req-39768087-8d73-4bda-b9d1-7b665fa88198 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82087) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:50:56 devstack cinder-volume[82087]: DEBUG cinder.volume.drivers.quobyte [None req-39768087-8d73-4bda-b9d1-7b665fa88198 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:50:56 devstack cinder-volume[82087]: DEBUG cinder.volume.drivers.quobyte [None req-39768087-8d73-4bda-b9d1-7b665fa88198 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:50:56 devstack cinder-volume[82087]: DEBUG oslo_concurrency.lockutils [None req-39768087-8d73-4bda-b9d1-7b665fa88198 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82087) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:50:56 devstack cinder-volume[82087]: DEBUG oslo_concurrency.processutils [None req-39768087-8d73-4bda-b9d1-7b665fa88198 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82087) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:50:56 devstack sudo[82168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:50:56 devstack sudo[82168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:50:56 devstack sudo[82168]: pam_unix(sudo:session): session closed for user root
Apr 15 15:50:56 devstack cinder-volume[82087]: DEBUG oslo_concurrency.processutils [None req-39768087-8d73-4bda-b9d1-7b665fa88198 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.443s {{(pid=82087) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:50:56 devstack cinder-volume[82087]: INFO cinder.volume.manager [None req-39768087-8d73-4bda-b9d1-7b665fa88198 None None] Driver post RPC initialization completed successfully.
Apr 15 15:50:59 devstack cinder-volume[82087]: DEBUG oslo_concurrency.lockutils [None req-8245f342-745b-4883-a284-1144ab9c29d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82087) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:50:59 devstack cinder-volume[82087]: DEBUG oslo_concurrency.lockutils [None req-8245f342-745b-4883-a284-1144ab9c29d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82087) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:50:59 devstack cinder-volume[82087]: DEBUG cinder.volume.drivers.quobyte [None req-8245f342-745b-4883-a284-1144ab9c29d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:50:59 devstack cinder-volume[82087]: DEBUG cinder.volume.drivers.quobyte [None req-8245f342-745b-4883-a284-1144ab9c29d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:50:59 devstack cinder-volume[82087]: DEBUG oslo_concurrency.lockutils [None req-8245f342-745b-4883-a284-1144ab9c29d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82087) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:50:59 devstack cinder-volume[82087]: DEBUG oslo_concurrency.processutils [None req-8245f342-745b-4883-a284-1144ab9c29d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82087) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:50:59 devstack sudo[82233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:50:59 devstack sudo[82233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:50:59 devstack sudo[82233]: pam_unix(sudo:session): session closed for user root
Apr 15 15:50:59 devstack cinder-volume[82087]: DEBUG oslo_concurrency.processutils [None req-8245f342-745b-4883-a284-1144ab9c29d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.373s {{(pid=82087) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:50:59 devstack cinder-volume[82087]: DEBUG cinder.manager [None req-8245f342-745b-4883-a284-1144ab9c29d3 None None] Notifying Schedulers of capabilities ... {{(pid=82087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:51:03 devstack cinder-volume[81968]: INFO oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] Caught SIGTERM, stopping children
Apr 15 15:51:03 devstack cinder-volume[81968]: DEBUG oslo_concurrency.lockutils [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] Acquiring lock "singleton_lock" {{(pid=81968) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 15 15:51:03 devstack cinder-volume[81968]: DEBUG oslo_concurrency.lockutils [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] Acquired lock "singleton_lock" {{(pid=81968) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 15 15:51:03 devstack cinder-volume[81968]: DEBUG oslo_concurrency.lockutils [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] Releasing lock "singleton_lock" {{(pid=81968) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 15 15:51:03 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] Stop services. {{(pid=81968) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 15 15:51:03 devstack cinder-volume[81968]: DEBUG oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] Killing children. {{(pid=81968) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 15 15:51:03 devstack cinder-volume[81968]: INFO oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] Waiting on 1 children to exit
Apr 15 15:51:04 devstack cinder-volume[82087]: DEBUG oslo_concurrency.lockutils [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] Acquiring lock "singleton_lock" {{(pid=82087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 15 15:51:04 devstack cinder-volume[82087]: DEBUG oslo_concurrency.lockutils [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] Acquired lock "singleton_lock" {{(pid=82087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 15 15:51:04 devstack cinder-volume[82087]: DEBUG oslo_concurrency.lockutils [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] Releasing lock "singleton_lock" {{(pid=82087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 15 15:51:04 devstack cinder-volume[82087]: WARNING amqp [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 15 15:51:04 devstack cinder-volume[82087]: WARNING amqp [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 15 15:51:04 devstack cinder-volume[81968]: INFO oslo_service.backend._eventlet.service [None req-86f44408-40b7-412b-96e3-af907bf4b561 None None] Child 82087 exited with status 0
Apr 15 15:51:04 devstack cinder-volume[82305]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 15 15:51:04 devstack cinder-volume[82305]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 15 15:51:04 devstack cinder-volume[82305]: we strongly recommend against using it for new projects.
Apr 15 15:51:04 devstack cinder-volume[82305]: If you are already using Eventlet, we recommend migrating to a different
Apr 15 15:51:04 devstack cinder-volume[82305]: framework.  For more detail see
Apr 15 15:51:04 devstack cinder-volume[82305]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 15 15:51:04 devstack cinder-volume[82305]:   import eventlet  # noqa
Apr 15 15:51:06 devstack cinder-volume[82305]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 15 15:51:06 devstack cinder-volume[82305]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 15 15:51:06 devstack cinder-volume[82305]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 15 15:51:06 devstack cinder-volume[82305]: INFO dbcounter [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] Registered counter for database cinder
Apr 15 15:51:06 devstack cinder-volume[82305]: DEBUG oslo_db.sqlalchemy.engines [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82305) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG dbcounter [-] [82305] Writer thread running {{(pid=82305) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 15 15:51:07 devstack cinder-volume[82305]: INFO cinder.rpc [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 15 15:51:07 devstack cinder-volume[82305]: INFO cinder.rpc [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_db.sqlalchemy.engines [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82305) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 15 15:51:07 devstack cinder-volume[82305]: INFO cinder.volume.manager [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] Determined volume DB was empty at startup.
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG cinder.volume.manager [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82305) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 15 15:51:07 devstack cinder-volume[82305]: WARNING stevedore.named [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 15 15:51:07 devstack cinder-volume[82305]: WARNING castellan.key_manager [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 15 15:51:07 devstack cinder-volume[82305]: WARNING cinder.keymgr.conf_key_mgr [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 15 15:51:07 devstack cinder-volume[82305]: INFO cinder.volume.manager [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_db.sqlalchemy.engines [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82305) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 15 15:51:07 devstack cinder-volume[82305]: INFO oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] Starting 1 workers
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] Started child 82485 {{(pid=82305) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] Full set of CONF: {{(pid=82305) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] ******************************************************************************** {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] Configuration options gathered from: {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] ================================================================================ {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] allow_availability_zone_fallback = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] allow_compression_on_image_upload = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] allowed_direct_url_schemes     = [] {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] api_rate_limit                 = True {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] auth_strategy                  = keystone {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_availability_zone      = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_host                   = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_name                   = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_stats_polling_interval = 60 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backup_api_class               = cinder.backup.api.API {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backup_name_template           = backup-%s {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backup_use_same_host           = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backup_use_temp_snapshot       = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] chap_password                  = **** {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] chap_username                  =  {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] cinder_internal_tenant_project_id = 51caa844382f4aacb25925787331cfbe {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] cinder_internal_tenant_user_id = 2c3f02f90361444288150fa1c935f3c6 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] cluster                        = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] compression_format             = gzip {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] compute_api_class              = cinder.compute.nova.API {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] config_dir                     = [] {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] config_source                  = [] {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] control_exchange               = openstack {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] debug                          = True {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] default_availability_zone      = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] default_group_type             = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] default_volume_type            = QuobyteHD {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] disk_geometry                  = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] driver_client_cert             = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] driver_client_cert_key         = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] driver_data_namespace          = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] driver_ssl_cert_path           = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] driver_ssl_cert_verify         = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] driver_use_ssl                 = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] enable_new_services            = True {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] enable_unsupported_driver      = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] enabled_backends               = ['QuobyteHD'] {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] enforce_multipath_for_image_xfer = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] filter_function                = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] glance_api_insecure            = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] glance_api_servers             = ['http://192.168.122.32/image'] {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] glance_api_ssl_compression     = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] glance_ca_certificates_file    = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] glance_catalog_info            = image:glance:publicURL {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] glance_certfile                = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82485]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] glance_keyfile                 = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] glance_num_retries             = 3 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] glance_request_timeout         = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] goodness_function              = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] graceful_shutdown_timeout      = 5 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] group_api_class                = cinder.group.api.API {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] host                           = devstack {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] image_compress_on_upload       = True {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] image_conversion_address_space_limit = 1 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] image_conversion_cpu_limit     = 60 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] image_conversion_disable       = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] image_upload_use_cinder_backend = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] image_upload_use_internal_tenant = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] image_volume_cache_enabled     = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] image_volume_cache_max_count   = 0 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] image_volume_cache_max_size_gb = 0 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] init_host_max_objects_retrieval = 0 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] instance_format                = [instance: %(uuid)s]  {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] iscsi_target_flags             =  {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] iscsi_write_cache              = on {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] iser_helper                    = tgtadm {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] iser_ip_address                = 192.168.122.32 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] iser_port                      = 3260 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] log_color                      = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] log_config_append              = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] log_dir                        = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] log_file                       = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] log_options                    = True {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] log_rotate_interval            = 1 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] log_rotate_interval_type       = days {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] log_rotation_type              = none {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] max_age                        = 0 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] max_logfile_count              = 30 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] max_logfile_size_mb            = 200 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] max_over_subscription_ratio    = 20.0 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] message_reap_interval          = 86400 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] message_ttl                    = 2592000 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] migration_create_volume_timeout_secs = 300 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] monkey_patch                   = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] monkey_patch_modules           = [] {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] my_ip                          = 192.168.122.32 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] no_snapshot_gb_quota           = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] num_iser_scan_tries            = 3 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] num_shell_tries                = 3 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] num_volume_device_scan_tries   = 3 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] nvmeof_conn_info_version       = 1 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] nvmet_ns_id                    = 10 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] nvmet_port_id                  = 1 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] osapi_max_limit                = 1000 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] osapi_volume_ext_list          = [] {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] osapi_volume_listen_port       = 8776 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] osapi_volume_use_ssl           = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] osapi_volume_workers           = 2 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] per_volume_size_limit          = -1 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] periodic_fuzzy_delay           = 60 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] periodic_interval              = 60 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] public_endpoint                = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] publish_errors                 = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] quota_backup_gigabytes         = 1000 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-546f1397-ea9b-4215-be09-ba31b3281f1c None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 15 15:51:07 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-546f1397-ea9b-4215-be09-ba31b3281f1c None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82485) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] quota_backups                  = 10 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] quota_gigabytes                = 1000 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] quota_groups                   = 10 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] quota_snapshots                = 10 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] quota_volumes                  = 10 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] rate_limit_burst               = 0 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] rate_limit_except_level        = CRITICAL {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] rate_limit_interval            = 0 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] reinit_driver_count            = 3 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] replication_device             = **** {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] report_discard_supported       = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] report_interval                = 120 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] reservation_clean_interval     = 86400 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] reservation_expire             = 86400 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] reserved_image_namespaces      = [] {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] reserved_percentage            = 0 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] rpc_response_timeout           = 120 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] run_external_periodic_tasks    = True {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] scst_target_driver             = iscsi {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] scst_target_iqn_name           = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] service_down_time              = 720 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] shell_completion               = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] snapshot_name_template         = snapshot-%s {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] split_loggers                  = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] state_path                     = /opt/stack/data/cinder {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] storage_availability_zone      = nova {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] storage_protocol               = iSCSI {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] syslog_log_facility            = LOG_USER {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] target_helper                  = lioadm {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] target_ip_address              = 192.168.122.32 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] target_port                    = 3260 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] target_protocol                = iscsi {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] target_secondary_ip_addresses  = [] {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] trace_flags                    = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] transport_url                  = **** {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] until_refresh                  = 0 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] use_chap_auth                  = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] use_default_quota_class        = True {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] use_journal                    = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] use_json                       = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] use_multipath_for_image_xfer   = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] use_stderr                     = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] use_syslog                     = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] verify_glance_signatures       = enabled {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] volume_api_class               = cinder.volume.api.API {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] volume_backend_name            = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] volume_clear                   = zero {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] volume_clear_ionice            = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] volume_clear_size              = 0 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] volume_copy_bps_limit          = 0 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] volume_dd_blocksize            = 1M {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] volume_name_template           = volume-%s {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] volume_service_inithost_offload = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] volume_usage_audit_period      = month {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] zoning_mode                    = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] oslo_concurrency.disable_process_locking = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] keystone_authtoken.admin_password = **** {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] keystone_authtoken.admin_token = **** {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] keystone_authtoken.admin_user  = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] keystone_authtoken.auth_port   = 35357 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] keystone_authtoken.auth_protocol = https {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] keystone_authtoken.auth_section = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] keystone_authtoken.auth_type   = password {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] keystone_authtoken.auth_uri    = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] keystone_authtoken.auth_version = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] keystone_authtoken.cache       = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] keystone_authtoken.certfile    = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] keystone_authtoken.identity_uri = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] keystone_authtoken.include_service_catalog = True {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] keystone_authtoken.insecure    = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] keystone_authtoken.interface   = public {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] keystone_authtoken.keyfile     = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] keystone_authtoken.memcache_password =  {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] keystone_authtoken.memcache_username =  {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] keystone_authtoken.region_name = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] keystone_authtoken.service_type = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.32/identity {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] cache.backend                  = dogpile.cache.null {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] cache.backend_argument         = **** {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] cache.backend_expiration_time  = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] cache.config_prefix            = cache.oslo {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] cache.debug_cache_backend      = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] cache.enable_retry_client      = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] cache.enable_socket_keepalive  = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] cache.enabled                  = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] cache.enforce_fips_mode        = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] cache.expiration_time          = 600 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] cache.hashclient_retry_attempts = 2 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] cache.memcache_dead_retry      = 300 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] cache.memcache_pool_maxsize    = 10 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] cache.memcache_sasl_enabled    = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] cache.password                 = **** {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] cache.proxies                  = [] {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] cache.redis_db                 = 0 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] cache.redis_server             = localhost:6379 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] cache.retry_attempts           = 2 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] cache.retry_delay              = 0.0 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] cache.socket_keepalive_count   = 1 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] cache.socket_keepalive_idle    = 1 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] cache.socket_keepalive_interval = 1 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] cache.socket_timeout           = 1.0 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] cache.tls_allowed_ciphers      = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] cache.tls_cafile               = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] cache.tls_certfile             = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] cache.tls_enabled              = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] cache.tls_keyfile              = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] cache.username                 = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] coordination.backend_url       = **** {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] database.asyncio_connection    = **** {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] database.asyncio_slave_connection = **** {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] database.backend               = sqlalchemy {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] database.connection            = **** {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] database.connection_debug      = 0 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] database.connection_parameters =  {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] database.connection_recycle_time = 3600 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] database.connection_trace      = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] database.db_inc_retry_interval = True {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] database.db_max_retries        = 20 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] database.db_max_retry_interval = 10 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] database.db_retry_interval     = 1 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] database.max_overflow          = 50 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] database.max_pool_size         = 5 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] database.max_retries           = 10 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] database.mysql_wsrep_sync_wait = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] database.pool_timeout          = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] database.retry_interval        = 10 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] database.slave_connection      = **** {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] database.sqlite_synchronous    = True {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] database.synchronous_reader    = True {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] database.use_db_reconnect      = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] profiler.connection_string     = messaging:// {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] profiler.enabled               = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] profiler.es_doc_type           = notification {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] profiler.es_scroll_size        = 10000 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] profiler.es_scroll_time        = 2m {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] profiler.filter_error_trace    = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] profiler.hmac_keys             = **** {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-546f1397-ea9b-4215-be09-ba31b3281f1c None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82485) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 15 15:51:07 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.quobyte [None req-546f1397-ea9b-4215-be09-ba31b3281f1c None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 15 15:51:07 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.quobyte [None req-546f1397-ea9b-4215-be09-ba31b3281f1c None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 15 15:51:07 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-546f1397-ea9b-4215-be09-ba31b3281f1c None None] Running cmd (subprocess): mount.quobyte {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] profiler.sentinel_service_name = mymaster {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] profiler.socket_timeout        = 0.1 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] profiler.trace_requests        = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] profiler.trace_sqlalchemy      = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] profiler_jaeger.process_tags   = {} {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] profiler_jaeger.service_name_prefix = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] profiler_otlp.service_name_prefix = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] oslo_policy.enforce_new_defaults = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: WARNING oslo_config.cfg [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] oslo_policy.enforce_scope      = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] oslo_policy.policy_default_rule = default {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] oslo_policy.policy_file        = policy.yaml {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] privsep_osbrick.group          = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] privsep_osbrick.helper_command = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] privsep_osbrick.user           = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] cinder_sys_admin.group         = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] cinder_sys_admin.helper_command = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] cinder_sys_admin.user          = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] service_user.auth_section      = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] service_user.auth_type         = password {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] service_user.cafile            = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] service_user.certfile          = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] service_user.collect_timing    = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] service_user.insecure          = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] service_user.keyfile           = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] service_user.send_service_user_token = True {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] service_user.split_loggers     = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] service_user.timeout           = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] glance.auth_section            = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] glance.auth_type               = password {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] glance.certfile                = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] glance.collect_timing          = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] glance.insecure                = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] glance.keyfile                 = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] glance.region_name             = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] glance.split_loggers           = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] glance.timeout                 = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.backend_availability_zone = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.chap_password = **** {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.chap_username =  {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.disk_geometry = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.driver_client_cert = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.driver_client_cert_key = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.driver_data_namespace = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.driver_use_ssl = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.extra_capabilities = {} {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.filter_function = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.goodness_function = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.iscsi_target_flags =  {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.iscsi_write_cache = on {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.iser_helper   = tgtadm {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.iser_ip_address = 192.168.122.32 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.iser_port     = 3260 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.nas_host      =  {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.nas_login     = admin {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.nas_mount_options = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.nas_password  = **** {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.nas_private_key =  {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.nas_share_path =  {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.num_shell_tries = 3 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.quobyte_volume_url = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.replication_device = **** {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.report_discard_supported = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.reserved_percentage = 0 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.target_helper = tgtadm {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.target_ip_address = 192.168.122.32 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.target_port   = 3260 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.target_protocol = iscsi {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.trace_flags   = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.unique_fqdn_network = True {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.use_chap_auth = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.volume_backend_name = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.volume_clear  = zero {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.volume_clear_ionice = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.volume_clear_size = 0 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] oslo_reports.file_event_handler = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] oslo_reports.log_dir           = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.backend_availability_zone = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.backend_host         = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.chap_password        = **** {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.chap_username        = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.chiscsi_conf         = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.disk_geometry        = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.driver_client_cert   = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.driver_data_namespace = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.driver_use_ssl       = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.extra_capabilities   = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.filter_function      = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.goodness_function    = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.iser_helper          = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.iser_ip_address      = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.iser_port            = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.iser_target_prefix   = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.nas_host             = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.nas_login            = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.nas_mount_options    = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.nas_password         = **** {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.nas_private_key      = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.nas_share_path       = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.nas_ssh_port         = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.num_shell_tries      = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.nvmet_port_id        = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.replication_device   = **** {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.report_discard_supported = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.reserved_percentage  = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.scst_target_driver   = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.storage_protocol     = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.target_helper        = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.target_ip_address    = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.target_port          = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.target_prefix        = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.target_protocol      = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.trace_flags          = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.use_chap_auth        = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.volume_clear         = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.volume_clear_size    = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] QuobyteHD.volumes_dir          = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] oslo_messaging_rabbit.ssl      = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] oslo_messaging_notifications.driver = [] {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] oslo_messaging_notifications.retry = -1 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] key_manager.fixed_key          = **** {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] barbican.barbican_api_version  = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] barbican.barbican_endpoint     = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] barbican.barbican_endpoint_type = public {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] barbican.barbican_region_name  = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] barbican.cafile                = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] barbican.certfile              = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] barbican.collect_timing        = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] barbican.insecure              = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] barbican.keyfile               = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] barbican.number_of_retries     = 60 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] barbican.retry_delay           = 1 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] barbican.send_service_user_token = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] barbican.split_loggers         = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] barbican.timeout               = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] barbican.verify_ssl            = True {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] barbican.verify_ssl_path       = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] barbican_service_user.auth_section = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] barbican_service_user.auth_type = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] barbican_service_user.cafile   = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] barbican_service_user.certfile = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] barbican_service_user.collect_timing = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] barbican_service_user.insecure = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] barbican_service_user.keyfile  = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] barbican_service_user.split_loggers = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] barbican_service_user.timeout  = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] vault.approle_role_id          = **** {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] vault.approle_secret_id        = **** {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] vault.kv_mountpoint            = secret {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] vault.kv_path                  = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] vault.kv_version               = 2 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] vault.namespace                = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] vault.root_token_id            = **** {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] vault.ssl_ca_crt_file          = None {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] vault.timeout                  = 60.0 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] vault.use_ssl                  = False {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 15:51:07 devstack cinder-volume[82305]: DEBUG oslo_service.backend._eventlet.service [None req-dc515b37-9b6a-450a-a27f-d66bb5cc4c60 None None] ******************************************************************************** {{(pid=82305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 15 15:51:07 devstack quobyte-client[82494]: Reading configuration file: /etc/quobyte/client.cfg
Apr 15 15:51:07 devstack quobyte-client[82494]: Invalid parameters found, error: missing mount point.
Apr 15 15:51:07 devstack quobyte-client[82494]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 15 15:51:07 devstack quobyte-client[82494]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 15 15:51:07 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-546f1397-ea9b-4215-be09-ba31b3281f1c None None] CMD "mount.quobyte" returned: 1 in 0.181s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:51:07 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-546f1397-ea9b-4215-be09-ba31b3281f1c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:51:07 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-546f1397-ea9b-4215-be09-ba31b3281f1c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:51:07 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-546f1397-ea9b-4215-be09-ba31b3281f1c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:51:07 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-546f1397-ea9b-4215-be09-ba31b3281f1c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:51:07 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-546f1397-ea9b-4215-be09-ba31b3281f1c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:51:07 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-546f1397-ea9b-4215-be09-ba31b3281f1c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:51:07 devstack sudo[82520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:51:07 devstack sudo[82520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:51:08 devstack sudo[82520]: pam_unix(sudo:session): session closed for user root
Apr 15 15:51:08 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-546f1397-ea9b-4215-be09-ba31b3281f1c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.634s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:51:08 devstack cinder-volume[82485]: INFO cinder.volume.driver [None req-546f1397-ea9b-4215-be09-ba31b3281f1c None None] Driver hasn't implemented _init_vendor_properties()
Apr 15 15:51:08 devstack cinder-volume[82485]: DEBUG cinder.volume.driver [None req-546f1397-ea9b-4215-be09-ba31b3281f1c None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.732810974121, 'free_capacity_gb': 1775.732810974121, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82485) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 15 15:51:08 devstack cinder-volume[82485]: DEBUG oslo_db.sqlalchemy.engines [None req-546f1397-ea9b-4215-be09-ba31b3281f1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82485) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 15 15:51:08 devstack cinder-volume[82485]: DEBUG dbcounter [-] [82485] Writer thread running {{(pid=82485) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 15 15:51:08 devstack cinder-volume[82485]: DEBUG cinder.db.sqlalchemy.api [None req-546f1397-ea9b-4215-be09-ba31b3281f1c None None] Building query based on filter {{(pid=82485) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 15 15:51:08 devstack cinder-volume[82485]: DEBUG cinder.image.image_utils [None req-546f1397-ea9b-4215-be09-ba31b3281f1c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82485) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 15 15:51:08 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-546f1397-ea9b-4215-be09-ba31b3281f1c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:51:08 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-546f1397-ea9b-4215-be09-ba31b3281f1c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:51:08 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-546f1397-ea9b-4215-be09-ba31b3281f1c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:51:08 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-546f1397-ea9b-4215-be09-ba31b3281f1c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:51:08 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-546f1397-ea9b-4215-be09-ba31b3281f1c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:51:08 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-546f1397-ea9b-4215-be09-ba31b3281f1c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:51:08 devstack cinder-volume[82485]: INFO cinder.keymgr.migration [None req-eca8f6f4-3703-470d-b298-dee2df8b3c10 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 15 15:51:08 devstack sudo[82548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:51:08 devstack sudo[82548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:51:08 devstack sudo[82548]: pam_unix(sudo:session): session closed for user root
Apr 15 15:51:08 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-546f1397-ea9b-4215-be09-ba31b3281f1c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.462s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:51:08 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-546f1397-ea9b-4215-be09-ba31b3281f1c None None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:51:08 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-546f1397-ea9b-4215-be09-ba31b3281f1c None None] Driver initialization completed successfully.
Apr 15 15:51:08 devstack cinder-volume[82485]: INFO cinder.manager [None req-546f1397-ea9b-4215-be09-ba31b3281f1c None None] Initiating service 3 cleanup
Apr 15 15:51:08 devstack cinder-volume[82485]: INFO cinder.manager [None req-546f1397-ea9b-4215-be09-ba31b3281f1c None None] Service 3 cleanup completed.
Apr 15 15:51:08 devstack cinder-volume[82485]: DEBUG cinder.service [None req-546f1397-ea9b-4215-be09-ba31b3281f1c None None] Creating RPC server for service cinder-volume {{(pid=82485) start /opt/stack/cinder/cinder/service.py:231}}
Apr 15 15:51:08 devstack cinder-volume[82485]: DEBUG cinder.service [None req-546f1397-ea9b-4215-be09-ba31b3281f1c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82485) start /opt/stack/cinder/cinder/service.py:237}}
Apr 15 15:51:08 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-546f1397-ea9b-4215-be09-ba31b3281f1c None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 15 15:51:08 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-546f1397-ea9b-4215-be09-ba31b3281f1c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:51:08 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-546f1397-ea9b-4215-be09-ba31b3281f1c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:51:08 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-546f1397-ea9b-4215-be09-ba31b3281f1c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:51:08 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-546f1397-ea9b-4215-be09-ba31b3281f1c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:51:08 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-546f1397-ea9b-4215-be09-ba31b3281f1c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:51:08 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-546f1397-ea9b-4215-be09-ba31b3281f1c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:51:08 devstack sudo[82555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:51:08 devstack sudo[82555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:51:09 devstack sudo[82555]: pam_unix(sudo:session): session closed for user root
Apr 15 15:51:09 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-546f1397-ea9b-4215-be09-ba31b3281f1c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.434s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:51:09 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-546f1397-ea9b-4215-be09-ba31b3281f1c None None] Driver post RPC initialization completed successfully.
Apr 15 15:51:17 devstack cinder-volume[82305]: DEBUG dbcounter [-] [82305] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82305) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 15:51:18 devstack cinder-volume[82485]: DEBUG dbcounter [-] [82485] Writing DB stats cinder:SELECT=3 {{(pid=82485) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 15:51:19 devstack cinder-volume[82485]: DEBUG dbcounter [-] [82485] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=82485) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 15:52:09 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-d35dc0c9-0520-48de-9b8f-bbe02aa08a51 tempest-DeleteServersTestJSON-1828455710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:52:09 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d35dc0c9-0520-48de-9b8f-bbe02aa08a51 tempest-DeleteServersTestJSON-1828455710 None] Flow 'volume_create_manager' (3a50cc22-afd6-425e-b179-c0b31a0e7e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:52:09 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d35dc0c9-0520-48de-9b8f-bbe02aa08a51 tempest-DeleteServersTestJSON-1828455710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd21ef54-3ff9-4ef6-a78d-c9c7d5185b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:52:09 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d35dc0c9-0520-48de-9b8f-bbe02aa08a51 tempest-DeleteServersTestJSON-1828455710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd21ef54-3ff9-4ef6-a78d-c9c7d5185b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:52:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-766398131',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e00767e-04be-49e5-8213-b307cd6ef366,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e4b5d8210fb45a3a11bd4465fe7d11b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:52:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:52:09Z,use_quota=True,user_id='e1bffb7af0484977b603a0f4d0400c02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:52:09 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d35dc0c9-0520-48de-9b8f-bbe02aa08a51 tempest-DeleteServersTestJSON-1828455710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b446b6ec-741a-41db-8293-cb2dcf24be29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:52:09 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d35dc0c9-0520-48de-9b8f-bbe02aa08a51 tempest-DeleteServersTestJSON-1828455710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b446b6ec-741a-41db-8293-cb2dcf24be29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:52:09 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d35dc0c9-0520-48de-9b8f-bbe02aa08a51 tempest-DeleteServersTestJSON-1828455710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f8d28a2-c693-4a98-a78a-0eef47eba7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:52:09 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d35dc0c9-0520-48de-9b8f-bbe02aa08a51 tempest-DeleteServersTestJSON-1828455710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f8d28a2-c693-4a98-a78a-0eef47eba7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e00767e-04be-49e5-8213-b307cd6ef366', 'volume_name': 'volume-9e00767e-04be-49e5-8213-b307cd6ef366', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:52:09 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d35dc0c9-0520-48de-9b8f-bbe02aa08a51 tempest-DeleteServersTestJSON-1828455710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b319ef3-6564-4616-b05a-7ebb9868495c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:52:09 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d35dc0c9-0520-48de-9b8f-bbe02aa08a51 tempest-DeleteServersTestJSON-1828455710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b319ef3-6564-4616-b05a-7ebb9868495c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:52:09 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d35dc0c9-0520-48de-9b8f-bbe02aa08a51 tempest-DeleteServersTestJSON-1828455710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (859cf9de-311a-4403-8866-a7ec5e055dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:52:09 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-d35dc0c9-0520-48de-9b8f-bbe02aa08a51 tempest-DeleteServersTestJSON-1828455710 None] Volume 9e00767e-04be-49e5-8213-b307cd6ef366: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e00767e-04be-49e5-8213-b307cd6ef366', 'volume_size': 1}
Apr 15 15:52:09 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-d35dc0c9-0520-48de-9b8f-bbe02aa08a51 tempest-DeleteServersTestJSON-1828455710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:52:09 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-d35dc0c9-0520-48de-9b8f-bbe02aa08a51 tempest-DeleteServersTestJSON-1828455710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:52:09 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-d35dc0c9-0520-48de-9b8f-bbe02aa08a51 tempest-DeleteServersTestJSON-1828455710 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:52:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-766398131',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e00767e-04be-49e5-8213-b307cd6ef366,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e4b5d8210fb45a3a11bd4465fe7d11b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:52:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:52:09Z,use_quota=True,user_id='e1bffb7af0484977b603a0f4d0400c02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:52:09 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-d35dc0c9-0520-48de-9b8f-bbe02aa08a51 tempest-DeleteServersTestJSON-1828455710 None] Creating volume 9e00767e-04be-49e5-8213-b307cd6ef366 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:52:09 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-d35dc0c9-0520-48de-9b8f-bbe02aa08a51 tempest-DeleteServersTestJSON-1828455710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:52:09 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-d35dc0c9-0520-48de-9b8f-bbe02aa08a51 tempest-DeleteServersTestJSON-1828455710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:52:09 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-d35dc0c9-0520-48de-9b8f-bbe02aa08a51 tempest-DeleteServersTestJSON-1828455710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:52:09 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-d35dc0c9-0520-48de-9b8f-bbe02aa08a51 tempest-DeleteServersTestJSON-1828455710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:52:09 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-d35dc0c9-0520-48de-9b8f-bbe02aa08a51 tempest-DeleteServersTestJSON-1828455710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:52:09 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-d35dc0c9-0520-48de-9b8f-bbe02aa08a51 tempest-DeleteServersTestJSON-1828455710 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:52:09 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-d35dc0c9-0520-48de-9b8f-bbe02aa08a51 tempest-DeleteServersTestJSON-1828455710 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:52:09 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-d35dc0c9-0520-48de-9b8f-bbe02aa08a51 tempest-DeleteServersTestJSON-1828455710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-9e00767e-04be-49e5-8213-b307cd6ef366 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:52:09 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e181cf1-bd25-4e33-bf5a-56a33250a1b0 tempest-VolumesAdminNegativeTest-813659168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:52:09 devstack sudo[83044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-9e00767e-04be-49e5-8213-b307cd6ef366 1073741824
Apr 15 15:52:09 devstack sudo[83044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:52:09 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-8e181cf1-bd25-4e33-bf5a-56a33250a1b0 tempest-VolumesAdminNegativeTest-813659168 None] Flow 'volume_create_manager' (06847459-71a6-446d-b3ff-6967153b7d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:52:09 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-8e181cf1-bd25-4e33-bf5a-56a33250a1b0 tempest-VolumesAdminNegativeTest-813659168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e34810bb-5b52-4ef3-9742-04ebec755e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:52:09 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-8e181cf1-bd25-4e33-bf5a-56a33250a1b0 tempest-VolumesAdminNegativeTest-813659168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e34810bb-5b52-4ef3-9742-04ebec755e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:52:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-620232104',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fd056ff-8aea-4f79-90f2-c4956ba1dc59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71e5f8f1556c4bb28a144f0624beb992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:52:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:52:09Z,use_quota=True,user_id='27cf87b0c1b74c1c8ce891b70a4fcddf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:52:09 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-8e181cf1-bd25-4e33-bf5a-56a33250a1b0 tempest-VolumesAdminNegativeTest-813659168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2c58681-9a57-435a-8c12-1aaf1946b5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:52:09 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-8e181cf1-bd25-4e33-bf5a-56a33250a1b0 tempest-VolumesAdminNegativeTest-813659168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2c58681-9a57-435a-8c12-1aaf1946b5e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:52:09 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-8e181cf1-bd25-4e33-bf5a-56a33250a1b0 tempest-VolumesAdminNegativeTest-813659168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3439c05f-95bb-4130-8d7d-6ffa26387b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:52:09 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-8e181cf1-bd25-4e33-bf5a-56a33250a1b0 tempest-VolumesAdminNegativeTest-813659168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3439c05f-95bb-4130-8d7d-6ffa26387b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fd056ff-8aea-4f79-90f2-c4956ba1dc59', 'volume_name': 'volume-1fd056ff-8aea-4f79-90f2-c4956ba1dc59', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:52:09 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-8e181cf1-bd25-4e33-bf5a-56a33250a1b0 tempest-VolumesAdminNegativeTest-813659168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a90251c-5491-4023-b91e-c09adbdd83b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:52:09 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-8e181cf1-bd25-4e33-bf5a-56a33250a1b0 tempest-VolumesAdminNegativeTest-813659168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a90251c-5491-4023-b91e-c09adbdd83b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:52:09 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-8e181cf1-bd25-4e33-bf5a-56a33250a1b0 tempest-VolumesAdminNegativeTest-813659168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (143f0800-916a-4728-90c8-72d25b98e10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:52:09 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-8e181cf1-bd25-4e33-bf5a-56a33250a1b0 tempest-VolumesAdminNegativeTest-813659168 None] Volume 1fd056ff-8aea-4f79-90f2-c4956ba1dc59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fd056ff-8aea-4f79-90f2-c4956ba1dc59', 'volume_size': 1}
Apr 15 15:52:09 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-8e181cf1-bd25-4e33-bf5a-56a33250a1b0 tempest-VolumesAdminNegativeTest-813659168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:52:11 devstack sudo[83044]: pam_unix(sudo:session): session closed for user root
Apr 15 15:52:11 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-d35dc0c9-0520-48de-9b8f-bbe02aa08a51 tempest-DeleteServersTestJSON-1828455710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-9e00767e-04be-49e5-8213-b307cd6ef366 1073741824" returned: 0 in 1.947s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:52:11 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-d35dc0c9-0520-48de-9b8f-bbe02aa08a51 tempest-DeleteServersTestJSON-1828455710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-9e00767e-04be-49e5-8213-b307cd6ef366 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:52:11 devstack sudo[83367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-9e00767e-04be-49e5-8213-b307cd6ef366
Apr 15 15:52:11 devstack sudo[83367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:52:12 devstack sudo[83367]: pam_unix(sudo:session): session closed for user root
Apr 15 15:52:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-d35dc0c9-0520-48de-9b8f-bbe02aa08a51 tempest-DeleteServersTestJSON-1828455710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-9e00767e-04be-49e5-8213-b307cd6ef366" returned: 0 in 1.081s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:52:12 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-d35dc0c9-0520-48de-9b8f-bbe02aa08a51 tempest-DeleteServersTestJSON-1828455710 None] <== create_volume: return (3093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:52:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-d35dc0c9-0520-48de-9b8f-bbe02aa08a51 tempest-DeleteServersTestJSON-1828455710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.097s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:52:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-8e181cf1-bd25-4e33-bf5a-56a33250a1b0 tempest-VolumesAdminNegativeTest-813659168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.861s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:52:12 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-8e181cf1-bd25-4e33-bf5a-56a33250a1b0 tempest-VolumesAdminNegativeTest-813659168 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:52:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-620232104',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fd056ff-8aea-4f79-90f2-c4956ba1dc59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71e5f8f1556c4bb28a144f0624beb992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:52:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:52:09Z,use_quota=True,user_id='27cf87b0c1b74c1c8ce891b70a4fcddf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:52:12 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-8e181cf1-bd25-4e33-bf5a-56a33250a1b0 tempest-VolumesAdminNegativeTest-813659168 None] Creating volume 1fd056ff-8aea-4f79-90f2-c4956ba1dc59 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:52:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-8e181cf1-bd25-4e33-bf5a-56a33250a1b0 tempest-VolumesAdminNegativeTest-813659168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:52:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-8e181cf1-bd25-4e33-bf5a-56a33250a1b0 tempest-VolumesAdminNegativeTest-813659168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:52:12 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-8e181cf1-bd25-4e33-bf5a-56a33250a1b0 tempest-VolumesAdminNegativeTest-813659168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:52:12 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-8e181cf1-bd25-4e33-bf5a-56a33250a1b0 tempest-VolumesAdminNegativeTest-813659168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:52:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-8e181cf1-bd25-4e33-bf5a-56a33250a1b0 tempest-VolumesAdminNegativeTest-813659168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:52:12 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-8e181cf1-bd25-4e33-bf5a-56a33250a1b0 tempest-VolumesAdminNegativeTest-813659168 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:52:12 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-8e181cf1-bd25-4e33-bf5a-56a33250a1b0 tempest-VolumesAdminNegativeTest-813659168 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:52:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-8e181cf1-bd25-4e33-bf5a-56a33250a1b0 tempest-VolumesAdminNegativeTest-813659168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd056ff-8aea-4f79-90f2-c4956ba1dc59 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:52:12 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d35dc0c9-0520-48de-9b8f-bbe02aa08a51 tempest-DeleteServersTestJSON-1828455710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (859cf9de-311a-4403-8866-a7ec5e055dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e00767e-04be-49e5-8213-b307cd6ef366', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:52:12 devstack sudo[83371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd056ff-8aea-4f79-90f2-c4956ba1dc59 1073741824
Apr 15 15:52:12 devstack sudo[83371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:52:12 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d35dc0c9-0520-48de-9b8f-bbe02aa08a51 tempest-DeleteServersTestJSON-1828455710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67cb47f8-9fec-4b72-b746-708411846a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:52:12 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-d35dc0c9-0520-48de-9b8f-bbe02aa08a51 tempest-DeleteServersTestJSON-1828455710 None] Volume volume-9e00767e-04be-49e5-8213-b307cd6ef366 (9e00767e-04be-49e5-8213-b307cd6ef366): created successfully
Apr 15 15:52:12 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d35dc0c9-0520-48de-9b8f-bbe02aa08a51 tempest-DeleteServersTestJSON-1828455710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67cb47f8-9fec-4b72-b746-708411846a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:52:12 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d35dc0c9-0520-48de-9b8f-bbe02aa08a51 tempest-DeleteServersTestJSON-1828455710 None] Flow 'volume_create_manager' (3a50cc22-afd6-425e-b179-c0b31a0e7e02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:52:12 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-d35dc0c9-0520-48de-9b8f-bbe02aa08a51 tempest-DeleteServersTestJSON-1828455710 None] Created volume successfully.
Apr 15 15:52:14 devstack sudo[83371]: pam_unix(sudo:session): session closed for user root
Apr 15 15:52:14 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-8e181cf1-bd25-4e33-bf5a-56a33250a1b0 tempest-VolumesAdminNegativeTest-813659168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd056ff-8aea-4f79-90f2-c4956ba1dc59 1073741824" returned: 0 in 1.430s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:52:14 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-8e181cf1-bd25-4e33-bf5a-56a33250a1b0 tempest-VolumesAdminNegativeTest-813659168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd056ff-8aea-4f79-90f2-c4956ba1dc59 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:52:14 devstack sudo[83381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd056ff-8aea-4f79-90f2-c4956ba1dc59
Apr 15 15:52:14 devstack sudo[83381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:52:15 devstack sudo[83381]: pam_unix(sudo:session): session closed for user root
Apr 15 15:52:15 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-8e181cf1-bd25-4e33-bf5a-56a33250a1b0 tempest-VolumesAdminNegativeTest-813659168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd056ff-8aea-4f79-90f2-c4956ba1dc59" returned: 0 in 1.296s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:52:15 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-8e181cf1-bd25-4e33-bf5a-56a33250a1b0 tempest-VolumesAdminNegativeTest-813659168 None] <== create_volume: return (2791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:52:15 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-8e181cf1-bd25-4e33-bf5a-56a33250a1b0 tempest-VolumesAdminNegativeTest-813659168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.796s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:52:15 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-8e181cf1-bd25-4e33-bf5a-56a33250a1b0 tempest-VolumesAdminNegativeTest-813659168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (143f0800-916a-4728-90c8-72d25b98e10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fd056ff-8aea-4f79-90f2-c4956ba1dc59', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:52:15 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-8e181cf1-bd25-4e33-bf5a-56a33250a1b0 tempest-VolumesAdminNegativeTest-813659168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a5e5018-3ae1-43d3-abc5-144a9100d76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:52:15 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-8e181cf1-bd25-4e33-bf5a-56a33250a1b0 tempest-VolumesAdminNegativeTest-813659168 None] Volume volume-1fd056ff-8aea-4f79-90f2-c4956ba1dc59 (1fd056ff-8aea-4f79-90f2-c4956ba1dc59): created successfully
Apr 15 15:52:15 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-8e181cf1-bd25-4e33-bf5a-56a33250a1b0 tempest-VolumesAdminNegativeTest-813659168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a5e5018-3ae1-43d3-abc5-144a9100d76a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:52:15 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-8e181cf1-bd25-4e33-bf5a-56a33250a1b0 tempest-VolumesAdminNegativeTest-813659168 None] Flow 'volume_create_manager' (06847459-71a6-446d-b3ff-6967153b7d45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:52:15 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-8e181cf1-bd25-4e33-bf5a-56a33250a1b0 tempest-VolumesAdminNegativeTest-813659168 None] Created volume successfully.
Apr 15 15:52:16 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-938acf42-132e-442d-91dc-6f500c24611c tempest-VolumesAdminNegativeTest-813659168 None] Acquiring lock "cinder-1fd056ff-8aea-4f79-90f2-c4956ba1dc59-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:52:16 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-938acf42-132e-442d-91dc-6f500c24611c tempest-VolumesAdminNegativeTest-813659168 None] Lock "cinder-1fd056ff-8aea-4f79-90f2-c4956ba1dc59-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:52:16 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-938acf42-132e-442d-91dc-6f500c24611c tempest-VolumesAdminNegativeTest-813659168 None] Acquiring lock "cinder-quobyte-1fd056ff-8aea-4f79-90f2-c4956ba1dc59" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:52:16 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-938acf42-132e-442d-91dc-6f500c24611c tempest-VolumesAdminNegativeTest-813659168 None] Lock "cinder-quobyte-1fd056ff-8aea-4f79-90f2-c4956ba1dc59" acquired by "delete_volume" :: waited 0.029s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:52:16 devstack cinder-volume[82485]: INFO oslo.privsep.daemon [None req-938acf42-132e-442d-91dc-6f500c24611c tempest-VolumesAdminNegativeTest-813659168 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmptut5wknt/privsep.sock']
Apr 15 15:52:16 devstack sudo[83394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmptut5wknt/privsep.sock
Apr 15 15:52:16 devstack sudo[83394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:52:17 devstack cinder-volume[82485]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
Apr 15 15:52:17 devstack cinder-volume[82485]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 15 15:52:17 devstack cinder-volume[82485]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Apr 15 15:52:17 devstack cinder-volume[82485]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 15 15:52:17 devstack cinder-volume[82485]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Apr 15 15:52:17 devstack cinder-volume[82485]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Apr 15 15:52:17 devstack cinder-volume[82485]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 15 15:52:17 devstack cinder-volume[82485]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 15 15:52:17 devstack cinder-volume[82485]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
Apr 15 15:52:18 devstack cinder-volume[82485]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning:
Apr 15 15:52:18 devstack cinder-volume[82485]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 15 15:52:18 devstack cinder-volume[82485]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Apr 15 15:52:18 devstack cinder-volume[82485]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 15 15:52:18 devstack cinder-volume[82485]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Apr 15 15:52:18 devstack cinder-volume[82485]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Apr 15 15:52:18 devstack cinder-volume[82485]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 15 15:52:18 devstack cinder-volume[82485]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 15 15:52:18 devstack cinder-volume[82485]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Apr 15 15:52:19 devstack sudo[83394]: pam_unix(sudo:session): session closed for user root
Apr 15 15:52:19 devstack cinder-volume[82485]: INFO oslo.privsep.daemon [None req-938acf42-132e-442d-91dc-6f500c24611c tempest-VolumesAdminNegativeTest-813659168 None] Spawned new privsep daemon via rootwrap
Apr 15 15:52:19 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [None req-938acf42-132e-442d-91dc-6f500c24611c tempest-VolumesAdminNegativeTest-813659168 None] Accepted privsep connection to /tmp/tmptut5wknt/privsep.sock {{(pid=82485) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}}
Apr 15 15:52:19 devstack cinder-volume[82485]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 15 15:52:19 devstack cinder-volume[82485]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 15 15:52:19 devstack cinder-volume[82485]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 15 15:52:19 devstack cinder-volume[82485]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83401
Apr 15 15:52:19 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[c983bd75-f92b-4c16-a04b-86ebc6be2b18]: (2,) {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:52:19 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d781408-1951-46bf-8665-842f9f14930a]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:52:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-938acf42-132e-442d-91dc-6f500c24611c tempest-VolumesAdminNegativeTest-813659168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd056ff-8aea-4f79-90f2-c4956ba1dc59 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:52:19 devstack sudo[83405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd056ff-8aea-4f79-90f2-c4956ba1dc59
Apr 15 15:52:19 devstack sudo[83405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:52:20 devstack sudo[83405]: pam_unix(sudo:session): session closed for user root
Apr 15 15:52:20 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-938acf42-132e-442d-91dc-6f500c24611c tempest-VolumesAdminNegativeTest-813659168 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd056ff-8aea-4f79-90f2-c4956ba1dc59" returned: 0 in 0.912s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:52:20 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-938acf42-132e-442d-91dc-6f500c24611c tempest-VolumesAdminNegativeTest-813659168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd056ff-8aea-4f79-90f2-c4956ba1dc59 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:52:20 devstack sudo[83410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd056ff-8aea-4f79-90f2-c4956ba1dc59
Apr 15 15:52:20 devstack sudo[83410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:52:21 devstack sudo[83410]: pam_unix(sudo:session): session closed for user root
Apr 15 15:52:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-938acf42-132e-442d-91dc-6f500c24611c tempest-VolumesAdminNegativeTest-813659168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd056ff-8aea-4f79-90f2-c4956ba1dc59" returned: 0 in 1.276s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:52:21 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-938acf42-132e-442d-91dc-6f500c24611c tempest-VolumesAdminNegativeTest-813659168 None] Lock "cinder-quobyte-1fd056ff-8aea-4f79-90f2-c4956ba1dc59" released by "delete_volume" :: held 4.704s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:52:21 devstack cinder-volume[82485]: WARNING cinder.quota [None req-938acf42-132e-442d-91dc-6f500c24611c tempest-VolumesAdminNegativeTest-813659168 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 15 15:52:21 devstack cinder-volume[82485]: WARNING cinder.quota [None req-938acf42-132e-442d-91dc-6f500c24611c tempest-VolumesAdminNegativeTest-813659168 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 15 15:52:21 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-938acf42-132e-442d-91dc-6f500c24611c tempest-VolumesAdminNegativeTest-813659168 None] Created reservations ['4a0c7cd5-cb27-4f1b-b2ea-b0f7042498b6', 'df6c2d9f-4c62-4cd0-95e5-c8096dd7ac69', 'd3536091-4258-4665-8403-0e3e8553904a', '9d64c5aa-1534-4693-8ed5-f773a4b42eb3'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:52:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-938acf42-132e-442d-91dc-6f500c24611c tempest-VolumesAdminNegativeTest-813659168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:52:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-938acf42-132e-442d-91dc-6f500c24611c tempest-VolumesAdminNegativeTest-813659168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:52:21 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-938acf42-132e-442d-91dc-6f500c24611c tempest-VolumesAdminNegativeTest-813659168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:52:21 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-938acf42-132e-442d-91dc-6f500c24611c tempest-VolumesAdminNegativeTest-813659168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:52:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-938acf42-132e-442d-91dc-6f500c24611c tempest-VolumesAdminNegativeTest-813659168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:52:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-938acf42-132e-442d-91dc-6f500c24611c tempest-VolumesAdminNegativeTest-813659168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:52:21 devstack sudo[83441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:52:21 devstack sudo[83441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:52:21 devstack cinder-volume[82485]: WARNING py.warnings [req-d4a537e1-cb7b-4f25-af4d-69b95d694aff req-ef4a3d4b-2eeb-4f80-8fce-fd206359fa95 tempest-DeleteServersTestJSON-1828455710 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1".  Apply join condition(s) between each element to resolve.
Apr 15 15:52:21 devstack cinder-volume[82485]:   .first()
Apr 15 15:52:21 devstack cinder-volume[82485]: 
Apr 15 15:52:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [req-d4a537e1-cb7b-4f25-af4d-69b95d694aff req-ef4a3d4b-2eeb-4f80-8fce-fd206359fa95 tempest-DeleteServersTestJSON-1828455710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:52:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [req-d4a537e1-cb7b-4f25-af4d-69b95d694aff req-ef4a3d4b-2eeb-4f80-8fce-fd206359fa95 tempest-DeleteServersTestJSON-1828455710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:52:21 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e580be-0c19-4c5a-8562-d203f5c0dd3a]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:52:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-d4a537e1-cb7b-4f25-af4d-69b95d694aff req-ef4a3d4b-2eeb-4f80-8fce-fd206359fa95 tempest-DeleteServersTestJSON-1828455710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-9e00767e-04be-49e5-8213-b307cd6ef366 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:52:22 devstack sudo[83444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-9e00767e-04be-49e5-8213-b307cd6ef366
Apr 15 15:52:22 devstack sudo[83444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:52:23 devstack sudo[83441]: pam_unix(sudo:session): session closed for user root
Apr 15 15:52:23 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-938acf42-132e-442d-91dc-6f500c24611c tempest-VolumesAdminNegativeTest-813659168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 1.291s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:52:23 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-938acf42-132e-442d-91dc-6f500c24611c tempest-VolumesAdminNegativeTest-813659168 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:52:23 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-938acf42-132e-442d-91dc-6f500c24611c tempest-VolumesAdminNegativeTest-813659168 None] Deleted volume successfully.
Apr 15 15:52:23 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-938acf42-132e-442d-91dc-6f500c24611c tempest-VolumesAdminNegativeTest-813659168 None] Lock "cinder-1fd056ff-8aea-4f79-90f2-c4956ba1dc59-delete_volume" released by "delete_volume" :: held 6.602s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:52:23 devstack sudo[83444]: pam_unix(sudo:session): session closed for user root
Apr 15 15:52:23 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-d4a537e1-cb7b-4f25-af4d-69b95d694aff req-ef4a3d4b-2eeb-4f80-8fce-fd206359fa95 tempest-DeleteServersTestJSON-1828455710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-9e00767e-04be-49e5-8213-b307cd6ef366" returned: 0 in 1.707s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:52:23 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [req-d4a537e1-cb7b-4f25-af4d-69b95d694aff req-ef4a3d4b-2eeb-4f80-8fce-fd206359fa95 tempest-DeleteServersTestJSON-1828455710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.751s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:52:23 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [req-d4a537e1-cb7b-4f25-af4d-69b95d694aff req-ef4a3d4b-2eeb-4f80-8fce-fd206359fa95 tempest-DeleteServersTestJSON-1828455710 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c', 'name': 'volume-9e00767e-04be-49e5-8213-b307cd6ef366', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cadbcd02-009f-4c84-959a-e41fe936ce4a', 'enforce_multipath': True} {{(pid=82485) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 15 15:52:23 devstack cinder-volume[82485]: INFO cinder.volume.manager [req-d4a537e1-cb7b-4f25-af4d-69b95d694aff req-ef4a3d4b-2eeb-4f80-8fce-fd206359fa95 tempest-DeleteServersTestJSON-1828455710 None] attachment_update completed successfully.
Apr 15 15:52:33 devstack cinder-volume[82485]: DEBUG dbcounter [-] [82485] Writing DB stats cinder:UPDATE=10,cinder:SELECT=12,cinder:DELETE=2 {{(pid=82485) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 15:52:33 devstack cinder-volume[82485]: DEBUG dbcounter [-] [82485] Writing DB stats cinder:SELECT=17,cinder:UPDATE=21,cinder:INSERT=6,cinder:DELETE=1 {{(pid=82485) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 15:52:34 devstack cinder-volume[82485]: INFO cinder.volume.manager [req-6168fad1-10a6-44c1-985b-65869543ff45 req-b013e7e2-ee1f-46d3-b811-2b1fb615d047 tempest-DeleteServersTestJSON-1828455710 None] Terminate volume connection completed successfully.
Apr 15 15:52:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [req-6168fad1-10a6-44c1-985b-65869543ff45 req-b013e7e2-ee1f-46d3-b811-2b1fb615d047 tempest-DeleteServersTestJSON-1828455710 None] Deleting attachment cadbcd02-009f-4c84-959a-e41fe936ce4a. {{(pid=82485) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 15 15:52:37 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-7641b4a7-169c-42a2-a5a3-ec6728831a3d tempest-DeleteServersTestJSON-1828455710 None] Acquiring lock "cinder-9e00767e-04be-49e5-8213-b307cd6ef366-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:52:38 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-7641b4a7-169c-42a2-a5a3-ec6728831a3d tempest-DeleteServersTestJSON-1828455710 None] Lock "cinder-9e00767e-04be-49e5-8213-b307cd6ef366-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:52:38 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-7641b4a7-169c-42a2-a5a3-ec6728831a3d tempest-DeleteServersTestJSON-1828455710 None] Acquiring lock "cinder-quobyte-9e00767e-04be-49e5-8213-b307cd6ef366" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:52:38 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-7641b4a7-169c-42a2-a5a3-ec6728831a3d tempest-DeleteServersTestJSON-1828455710 None] Lock "cinder-quobyte-9e00767e-04be-49e5-8213-b307cd6ef366" acquired by "delete_volume" :: waited 0.020s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:52:38 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[f080d1b3-82ed-4531-8d93-1fd109aaf295]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:52:38 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7641b4a7-169c-42a2-a5a3-ec6728831a3d tempest-DeleteServersTestJSON-1828455710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-9e00767e-04be-49e5-8213-b307cd6ef366 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:52:38 devstack sudo[84107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-9e00767e-04be-49e5-8213-b307cd6ef366
Apr 15 15:52:38 devstack sudo[84107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:52:38 devstack sudo[84107]: pam_unix(sudo:session): session closed for user root
Apr 15 15:52:38 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7641b4a7-169c-42a2-a5a3-ec6728831a3d tempest-DeleteServersTestJSON-1828455710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-9e00767e-04be-49e5-8213-b307cd6ef366" returned: 0 in 0.705s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:52:38 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7641b4a7-169c-42a2-a5a3-ec6728831a3d tempest-DeleteServersTestJSON-1828455710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-9e00767e-04be-49e5-8213-b307cd6ef366 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:52:38 devstack sudo[84171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-9e00767e-04be-49e5-8213-b307cd6ef366
Apr 15 15:52:38 devstack sudo[84171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:52:39 devstack sudo[84171]: pam_unix(sudo:session): session closed for user root
Apr 15 15:52:39 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7641b4a7-169c-42a2-a5a3-ec6728831a3d tempest-DeleteServersTestJSON-1828455710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-9e00767e-04be-49e5-8213-b307cd6ef366" returned: 0 in 0.998s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:52:39 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-7641b4a7-169c-42a2-a5a3-ec6728831a3d tempest-DeleteServersTestJSON-1828455710 None] Lock "cinder-quobyte-9e00767e-04be-49e5-8213-b307cd6ef366" released by "delete_volume" :: held 1.748s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:52:39 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-7641b4a7-169c-42a2-a5a3-ec6728831a3d tempest-DeleteServersTestJSON-1828455710 None] Created reservations ['27f991cc-a111-47dc-b806-a6764cd797cd', '2535800c-eba9-4716-9021-1d0c38ad68e9', '6e9b3eab-3b12-4aa7-8af1-f70208f2d616', '75177b4e-0659-41e8-8365-4c6deb7ce88c'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:52:39 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7641b4a7-169c-42a2-a5a3-ec6728831a3d tempest-DeleteServersTestJSON-1828455710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:52:39 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7641b4a7-169c-42a2-a5a3-ec6728831a3d tempest-DeleteServersTestJSON-1828455710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:52:39 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-7641b4a7-169c-42a2-a5a3-ec6728831a3d tempest-DeleteServersTestJSON-1828455710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:52:39 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-7641b4a7-169c-42a2-a5a3-ec6728831a3d tempest-DeleteServersTestJSON-1828455710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:52:39 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7641b4a7-169c-42a2-a5a3-ec6728831a3d tempest-DeleteServersTestJSON-1828455710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:52:39 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7641b4a7-169c-42a2-a5a3-ec6728831a3d tempest-DeleteServersTestJSON-1828455710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:52:39 devstack sudo[84188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:52:39 devstack sudo[84188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:52:40 devstack sudo[84188]: pam_unix(sudo:session): session closed for user root
Apr 15 15:52:40 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7641b4a7-169c-42a2-a5a3-ec6728831a3d tempest-DeleteServersTestJSON-1828455710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.615s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:52:40 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-7641b4a7-169c-42a2-a5a3-ec6728831a3d tempest-DeleteServersTestJSON-1828455710 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:52:40 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-7641b4a7-169c-42a2-a5a3-ec6728831a3d tempest-DeleteServersTestJSON-1828455710 None] Deleted volume successfully.
Apr 15 15:52:40 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-7641b4a7-169c-42a2-a5a3-ec6728831a3d tempest-DeleteServersTestJSON-1828455710 None] Lock "cinder-9e00767e-04be-49e5-8213-b307cd6ef366-delete_volume" released by "delete_volume" :: held 2.578s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:52:42 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-171f76b3-e0b4-4cf8-9671-610e6f432435 tempest-ServersNegativeTestJSON-792739514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:52:42 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-171f76b3-e0b4-4cf8-9671-610e6f432435 tempest-ServersNegativeTestJSON-792739514 None] Flow 'volume_create_manager' (0357230c-a838-4773-8511-6878f4d34950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:52:42 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-171f76b3-e0b4-4cf8-9671-610e6f432435 tempest-ServersNegativeTestJSON-792739514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3477f727-4a72-4036-8cb6-9568859e9a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:52:42 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-171f76b3-e0b4-4cf8-9671-610e6f432435 tempest-ServersNegativeTestJSON-792739514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3477f727-4a72-4036-8cb6-9568859e9a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:52:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1011366321',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27fadd52-92c8-4f36-8214-93dc46b5ad21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbe47a23b0814ba08e43ecd1ecb1a505',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:52:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:52:43Z,use_quota=True,user_id='11e0d1b2d0d449f0a18bd03482fc9836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:52:42 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-171f76b3-e0b4-4cf8-9671-610e6f432435 tempest-ServersNegativeTestJSON-792739514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (328598a5-608e-4e7e-9d4a-627a138cc655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:52:42 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-171f76b3-e0b4-4cf8-9671-610e6f432435 tempest-ServersNegativeTestJSON-792739514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (328598a5-608e-4e7e-9d4a-627a138cc655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:52:42 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-171f76b3-e0b4-4cf8-9671-610e6f432435 tempest-ServersNegativeTestJSON-792739514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (933acfa2-9e24-4c11-9154-301deaf0267c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:52:42 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-171f76b3-e0b4-4cf8-9671-610e6f432435 tempest-ServersNegativeTestJSON-792739514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (933acfa2-9e24-4c11-9154-301deaf0267c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27fadd52-92c8-4f36-8214-93dc46b5ad21', 'volume_name': 'volume-27fadd52-92c8-4f36-8214-93dc46b5ad21', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:52:42 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-171f76b3-e0b4-4cf8-9671-610e6f432435 tempest-ServersNegativeTestJSON-792739514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e68c2ecc-a16a-4648-9754-ceef931e6925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:52:42 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-171f76b3-e0b4-4cf8-9671-610e6f432435 tempest-ServersNegativeTestJSON-792739514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e68c2ecc-a16a-4648-9754-ceef931e6925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:52:42 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-171f76b3-e0b4-4cf8-9671-610e6f432435 tempest-ServersNegativeTestJSON-792739514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0439927-d02e-4fc3-a63e-6edbbfa2e568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:52:42 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-171f76b3-e0b4-4cf8-9671-610e6f432435 tempest-ServersNegativeTestJSON-792739514 None] Volume 27fadd52-92c8-4f36-8214-93dc46b5ad21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27fadd52-92c8-4f36-8214-93dc46b5ad21', 'volume_size': 1}
Apr 15 15:52:42 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-171f76b3-e0b4-4cf8-9671-610e6f432435 tempest-ServersNegativeTestJSON-792739514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:52:42 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-171f76b3-e0b4-4cf8-9671-610e6f432435 tempest-ServersNegativeTestJSON-792739514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:52:42 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-171f76b3-e0b4-4cf8-9671-610e6f432435 tempest-ServersNegativeTestJSON-792739514 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:52:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1011366321',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27fadd52-92c8-4f36-8214-93dc46b5ad21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbe47a23b0814ba08e43ecd1ecb1a505',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:52:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:52:43Z,use_quota=True,user_id='11e0d1b2d0d449f0a18bd03482fc9836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:52:42 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-171f76b3-e0b4-4cf8-9671-610e6f432435 tempest-ServersNegativeTestJSON-792739514 None] Creating volume 27fadd52-92c8-4f36-8214-93dc46b5ad21 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:52:42 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-171f76b3-e0b4-4cf8-9671-610e6f432435 tempest-ServersNegativeTestJSON-792739514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:52:42 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-171f76b3-e0b4-4cf8-9671-610e6f432435 tempest-ServersNegativeTestJSON-792739514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:52:42 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-171f76b3-e0b4-4cf8-9671-610e6f432435 tempest-ServersNegativeTestJSON-792739514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:52:42 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-171f76b3-e0b4-4cf8-9671-610e6f432435 tempest-ServersNegativeTestJSON-792739514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:52:42 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-171f76b3-e0b4-4cf8-9671-610e6f432435 tempest-ServersNegativeTestJSON-792739514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:52:42 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-171f76b3-e0b4-4cf8-9671-610e6f432435 tempest-ServersNegativeTestJSON-792739514 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:52:42 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-171f76b3-e0b4-4cf8-9671-610e6f432435 tempest-ServersNegativeTestJSON-792739514 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:52:42 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-171f76b3-e0b4-4cf8-9671-610e6f432435 tempest-ServersNegativeTestJSON-792739514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-27fadd52-92c8-4f36-8214-93dc46b5ad21 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:52:42 devstack sudo[84197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-27fadd52-92c8-4f36-8214-93dc46b5ad21 1073741824
Apr 15 15:52:42 devstack sudo[84197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:52:44 devstack sudo[84197]: pam_unix(sudo:session): session closed for user root
Apr 15 15:52:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-171f76b3-e0b4-4cf8-9671-610e6f432435 tempest-ServersNegativeTestJSON-792739514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-27fadd52-92c8-4f36-8214-93dc46b5ad21 1073741824" returned: 0 in 1.358s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:52:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-171f76b3-e0b4-4cf8-9671-610e6f432435 tempest-ServersNegativeTestJSON-792739514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-27fadd52-92c8-4f36-8214-93dc46b5ad21 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:52:44 devstack sudo[84202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-27fadd52-92c8-4f36-8214-93dc46b5ad21
Apr 15 15:52:44 devstack sudo[84202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:52:44 devstack cinder-volume[82485]: DEBUG oslo_service.periodic_task [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82485) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 15 15:52:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:52:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:52:44 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:52:44 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:52:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:52:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:52:44 devstack sudo[84205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:52:44 devstack sudo[84205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:52:45 devstack sudo[84205]: pam_unix(sudo:session): session closed for user root
Apr 15 15:52:45 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.784s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:52:45 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:52:45 devstack sudo[84202]: pam_unix(sudo:session): session closed for user root
Apr 15 15:52:45 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-171f76b3-e0b4-4cf8-9671-610e6f432435 tempest-ServersNegativeTestJSON-792739514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-27fadd52-92c8-4f36-8214-93dc46b5ad21" returned: 0 in 1.245s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:52:45 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-171f76b3-e0b4-4cf8-9671-610e6f432435 tempest-ServersNegativeTestJSON-792739514 None] <== create_volume: return (2662ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:52:45 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-171f76b3-e0b4-4cf8-9671-610e6f432435 tempest-ServersNegativeTestJSON-792739514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.664s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:52:45 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-171f76b3-e0b4-4cf8-9671-610e6f432435 tempest-ServersNegativeTestJSON-792739514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0439927-d02e-4fc3-a63e-6edbbfa2e568) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27fadd52-92c8-4f36-8214-93dc46b5ad21', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:52:45 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-171f76b3-e0b4-4cf8-9671-610e6f432435 tempest-ServersNegativeTestJSON-792739514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77138634-7219-48a7-ad4b-694239de2d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:52:45 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-171f76b3-e0b4-4cf8-9671-610e6f432435 tempest-ServersNegativeTestJSON-792739514 None] Volume volume-27fadd52-92c8-4f36-8214-93dc46b5ad21 (27fadd52-92c8-4f36-8214-93dc46b5ad21): created successfully
Apr 15 15:52:45 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-171f76b3-e0b4-4cf8-9671-610e6f432435 tempest-ServersNegativeTestJSON-792739514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77138634-7219-48a7-ad4b-694239de2d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:52:45 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-171f76b3-e0b4-4cf8-9671-610e6f432435 tempest-ServersNegativeTestJSON-792739514 None] Flow 'volume_create_manager' (0357230c-a838-4773-8511-6878f4d34950) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:52:45 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-171f76b3-e0b4-4cf8-9671-610e6f432435 tempest-ServersNegativeTestJSON-792739514 None] Created volume successfully.
Apr 15 15:52:48 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-10d1432c-959c-44d3-b886-c7071598a34c tempest-ServersNegativeTestJSON-792739514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:52:48 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-10d1432c-959c-44d3-b886-c7071598a34c tempest-ServersNegativeTestJSON-792739514 None] Flow 'volume_create_manager' (cd9e77eb-d65a-44ce-b428-7a8233cfffad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:52:48 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-10d1432c-959c-44d3-b886-c7071598a34c tempest-ServersNegativeTestJSON-792739514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9804b1e4-38ca-40bc-95df-5a7a5dfcb420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:52:48 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-10d1432c-959c-44d3-b886-c7071598a34c tempest-ServersNegativeTestJSON-792739514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9804b1e4-38ca-40bc-95df-5a7a5dfcb420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:52:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1693434609',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d351263-4dbf-41a3-8867-2ff7a1d4bba9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbe47a23b0814ba08e43ecd1ecb1a505',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:52:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:52:48Z,use_quota=True,user_id='11e0d1b2d0d449f0a18bd03482fc9836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:52:48 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-10d1432c-959c-44d3-b886-c7071598a34c tempest-ServersNegativeTestJSON-792739514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c1dd898-7611-461d-bef1-cccea2773bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:52:48 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-10d1432c-959c-44d3-b886-c7071598a34c tempest-ServersNegativeTestJSON-792739514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c1dd898-7611-461d-bef1-cccea2773bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:52:48 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-10d1432c-959c-44d3-b886-c7071598a34c tempest-ServersNegativeTestJSON-792739514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a178cbf5-b651-41d9-acc1-4396d5515473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:52:48 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-10d1432c-959c-44d3-b886-c7071598a34c tempest-ServersNegativeTestJSON-792739514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a178cbf5-b651-41d9-acc1-4396d5515473) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d351263-4dbf-41a3-8867-2ff7a1d4bba9', 'volume_name': 'volume-3d351263-4dbf-41a3-8867-2ff7a1d4bba9', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:52:48 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-10d1432c-959c-44d3-b886-c7071598a34c tempest-ServersNegativeTestJSON-792739514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (688699b6-513c-4590-8659-381f3ac8642a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:52:48 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-10d1432c-959c-44d3-b886-c7071598a34c tempest-ServersNegativeTestJSON-792739514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (688699b6-513c-4590-8659-381f3ac8642a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:52:48 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-10d1432c-959c-44d3-b886-c7071598a34c tempest-ServersNegativeTestJSON-792739514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (689b85f8-b1dd-4cc3-a865-4c6a4330de13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:52:48 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-10d1432c-959c-44d3-b886-c7071598a34c tempest-ServersNegativeTestJSON-792739514 None] Volume 3d351263-4dbf-41a3-8867-2ff7a1d4bba9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d351263-4dbf-41a3-8867-2ff7a1d4bba9', 'volume_size': 1}
Apr 15 15:52:48 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-10d1432c-959c-44d3-b886-c7071598a34c tempest-ServersNegativeTestJSON-792739514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:52:48 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-10d1432c-959c-44d3-b886-c7071598a34c tempest-ServersNegativeTestJSON-792739514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:52:48 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-10d1432c-959c-44d3-b886-c7071598a34c tempest-ServersNegativeTestJSON-792739514 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:52:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1693434609',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d351263-4dbf-41a3-8867-2ff7a1d4bba9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbe47a23b0814ba08e43ecd1ecb1a505',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:52:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:52:48Z,use_quota=True,user_id='11e0d1b2d0d449f0a18bd03482fc9836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:52:48 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-10d1432c-959c-44d3-b886-c7071598a34c tempest-ServersNegativeTestJSON-792739514 None] Creating volume 3d351263-4dbf-41a3-8867-2ff7a1d4bba9 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:52:48 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-10d1432c-959c-44d3-b886-c7071598a34c tempest-ServersNegativeTestJSON-792739514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:52:48 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-10d1432c-959c-44d3-b886-c7071598a34c tempest-ServersNegativeTestJSON-792739514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:52:48 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-10d1432c-959c-44d3-b886-c7071598a34c tempest-ServersNegativeTestJSON-792739514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:52:48 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-10d1432c-959c-44d3-b886-c7071598a34c tempest-ServersNegativeTestJSON-792739514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:52:48 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-10d1432c-959c-44d3-b886-c7071598a34c tempest-ServersNegativeTestJSON-792739514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:52:48 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-10d1432c-959c-44d3-b886-c7071598a34c tempest-ServersNegativeTestJSON-792739514 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:52:48 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-10d1432c-959c-44d3-b886-c7071598a34c tempest-ServersNegativeTestJSON-792739514 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:52:48 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-10d1432c-959c-44d3-b886-c7071598a34c tempest-ServersNegativeTestJSON-792739514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3d351263-4dbf-41a3-8867-2ff7a1d4bba9 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:52:48 devstack sudo[84218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3d351263-4dbf-41a3-8867-2ff7a1d4bba9 1073741824
Apr 15 15:52:48 devstack sudo[84218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:52:49 devstack sudo[84218]: pam_unix(sudo:session): session closed for user root
Apr 15 15:52:49 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-10d1432c-959c-44d3-b886-c7071598a34c tempest-ServersNegativeTestJSON-792739514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3d351263-4dbf-41a3-8867-2ff7a1d4bba9 1073741824" returned: 0 in 1.193s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:52:49 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-10d1432c-959c-44d3-b886-c7071598a34c tempest-ServersNegativeTestJSON-792739514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3d351263-4dbf-41a3-8867-2ff7a1d4bba9 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:52:49 devstack sudo[84246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3d351263-4dbf-41a3-8867-2ff7a1d4bba9
Apr 15 15:52:49 devstack sudo[84246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:52:50 devstack sudo[84246]: pam_unix(sudo:session): session closed for user root
Apr 15 15:52:50 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-10d1432c-959c-44d3-b886-c7071598a34c tempest-ServersNegativeTestJSON-792739514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3d351263-4dbf-41a3-8867-2ff7a1d4bba9" returned: 0 in 1.065s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:52:50 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-10d1432c-959c-44d3-b886-c7071598a34c tempest-ServersNegativeTestJSON-792739514 None] <== create_volume: return (2334ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:52:50 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-10d1432c-959c-44d3-b886-c7071598a34c tempest-ServersNegativeTestJSON-792739514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.336s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:52:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-10d1432c-959c-44d3-b886-c7071598a34c tempest-ServersNegativeTestJSON-792739514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (689b85f8-b1dd-4cc3-a865-4c6a4330de13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d351263-4dbf-41a3-8867-2ff7a1d4bba9', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:52:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-10d1432c-959c-44d3-b886-c7071598a34c tempest-ServersNegativeTestJSON-792739514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8dfaa91-2247-4d5e-b73b-bb4bcc114151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:52:50 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-10d1432c-959c-44d3-b886-c7071598a34c tempest-ServersNegativeTestJSON-792739514 None] Volume volume-3d351263-4dbf-41a3-8867-2ff7a1d4bba9 (3d351263-4dbf-41a3-8867-2ff7a1d4bba9): created successfully
Apr 15 15:52:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-10d1432c-959c-44d3-b886-c7071598a34c tempest-ServersNegativeTestJSON-792739514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8dfaa91-2247-4d5e-b73b-bb4bcc114151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:52:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-10d1432c-959c-44d3-b886-c7071598a34c tempest-ServersNegativeTestJSON-792739514 None] Flow 'volume_create_manager' (cd9e77eb-d65a-44ce-b428-7a8233cfffad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:52:50 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-10d1432c-959c-44d3-b886-c7071598a34c tempest-ServersNegativeTestJSON-792739514 None] Created volume successfully.
Apr 15 15:52:52 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-9ac7f675-9eac-4123-b4b5-0289e0f37170 tempest-ServersNegativeTestJSON-792739514 None] Acquiring lock "cinder-3d351263-4dbf-41a3-8867-2ff7a1d4bba9-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:52:52 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-9ac7f675-9eac-4123-b4b5-0289e0f37170 tempest-ServersNegativeTestJSON-792739514 None] Lock "cinder-3d351263-4dbf-41a3-8867-2ff7a1d4bba9-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:52:52 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-9ac7f675-9eac-4123-b4b5-0289e0f37170 tempest-ServersNegativeTestJSON-792739514 None] Acquiring lock "cinder-quobyte-3d351263-4dbf-41a3-8867-2ff7a1d4bba9" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:52:52 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-9ac7f675-9eac-4123-b4b5-0289e0f37170 tempest-ServersNegativeTestJSON-792739514 None] Lock "cinder-quobyte-3d351263-4dbf-41a3-8867-2ff7a1d4bba9" acquired by "delete_volume" :: waited 0.016s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:52:52 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a3800c-dd3d-4fd6-b6d8-95f4b6bcc936]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:52:52 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9ac7f675-9eac-4123-b4b5-0289e0f37170 tempest-ServersNegativeTestJSON-792739514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3d351263-4dbf-41a3-8867-2ff7a1d4bba9 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:52:52 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [req-c1599394-a3a6-430a-98b7-a11506f834ad req-292200de-738d-4fd1-b8fd-0cfb88db8ae0 tempest-VolumesSnapshotsTestJSON-1477544476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:52:52 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [req-c1599394-a3a6-430a-98b7-a11506f834ad req-292200de-738d-4fd1-b8fd-0cfb88db8ae0 tempest-VolumesSnapshotsTestJSON-1477544476 None] Flow 'volume_create_manager' (6b5682da-50a7-4845-9acf-e8095a2bf737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:52:52 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [req-c1599394-a3a6-430a-98b7-a11506f834ad req-292200de-738d-4fd1-b8fd-0cfb88db8ae0 tempest-VolumesSnapshotsTestJSON-1477544476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41d2e981-71a5-4b2c-b5d3-09c841fcc9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:52:52 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [req-c1599394-a3a6-430a-98b7-a11506f834ad req-292200de-738d-4fd1-b8fd-0cfb88db8ae0 tempest-VolumesSnapshotsTestJSON-1477544476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41d2e981-71a5-4b2c-b5d3-09c841fcc9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:52:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-779754002',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9d8be3b-afc6-4197-aee2-96afc19dcb98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ca65a1bb226465ab4baffd2ea7fc557',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:52:52Z,use_quota=True,user_id='2ccb22a4cef049e2963ebf8ea599121e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:52:52 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [req-c1599394-a3a6-430a-98b7-a11506f834ad req-292200de-738d-4fd1-b8fd-0cfb88db8ae0 tempest-VolumesSnapshotsTestJSON-1477544476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9bc5362-cc1b-49e7-881c-2a6f0d0dc740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:52:52 devstack sudo[84258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3d351263-4dbf-41a3-8867-2ff7a1d4bba9
Apr 15 15:52:52 devstack sudo[84258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:52:52 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [req-c1599394-a3a6-430a-98b7-a11506f834ad req-292200de-738d-4fd1-b8fd-0cfb88db8ae0 tempest-VolumesSnapshotsTestJSON-1477544476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9bc5362-cc1b-49e7-881c-2a6f0d0dc740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:52:52 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [req-c1599394-a3a6-430a-98b7-a11506f834ad req-292200de-738d-4fd1-b8fd-0cfb88db8ae0 tempest-VolumesSnapshotsTestJSON-1477544476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81f4d27e-7616-47e1-a02c-917081d94cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:52:52 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [req-c1599394-a3a6-430a-98b7-a11506f834ad req-292200de-738d-4fd1-b8fd-0cfb88db8ae0 tempest-VolumesSnapshotsTestJSON-1477544476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81f4d27e-7616-47e1-a02c-917081d94cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9d8be3b-afc6-4197-aee2-96afc19dcb98', 'volume_name': 'volume-a9d8be3b-afc6-4197-aee2-96afc19dcb98', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:52:52 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [req-c1599394-a3a6-430a-98b7-a11506f834ad req-292200de-738d-4fd1-b8fd-0cfb88db8ae0 tempest-VolumesSnapshotsTestJSON-1477544476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ae10c21-9553-495d-9bb1-399b2e03f9e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:52:52 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [req-c1599394-a3a6-430a-98b7-a11506f834ad req-292200de-738d-4fd1-b8fd-0cfb88db8ae0 tempest-VolumesSnapshotsTestJSON-1477544476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ae10c21-9553-495d-9bb1-399b2e03f9e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:52:52 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [req-c1599394-a3a6-430a-98b7-a11506f834ad req-292200de-738d-4fd1-b8fd-0cfb88db8ae0 tempest-VolumesSnapshotsTestJSON-1477544476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c560256e-dce8-42e6-b0b5-216557711365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:52:52 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [req-c1599394-a3a6-430a-98b7-a11506f834ad req-292200de-738d-4fd1-b8fd-0cfb88db8ae0 tempest-VolumesSnapshotsTestJSON-1477544476 None] Volume a9d8be3b-afc6-4197-aee2-96afc19dcb98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9d8be3b-afc6-4197-aee2-96afc19dcb98', 'volume_size': 1}
Apr 15 15:52:52 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [req-c1599394-a3a6-430a-98b7-a11506f834ad req-292200de-738d-4fd1-b8fd-0cfb88db8ae0 tempest-VolumesSnapshotsTestJSON-1477544476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:52:52 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [req-c1599394-a3a6-430a-98b7-a11506f834ad req-292200de-738d-4fd1-b8fd-0cfb88db8ae0 tempest-VolumesSnapshotsTestJSON-1477544476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:52:52 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [req-c1599394-a3a6-430a-98b7-a11506f834ad req-292200de-738d-4fd1-b8fd-0cfb88db8ae0 tempest-VolumesSnapshotsTestJSON-1477544476 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:52:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-779754002',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9d8be3b-afc6-4197-aee2-96afc19dcb98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ca65a1bb226465ab4baffd2ea7fc557',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:52:52Z,use_quota=True,user_id='2ccb22a4cef049e2963ebf8ea599121e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:52:52 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [req-c1599394-a3a6-430a-98b7-a11506f834ad req-292200de-738d-4fd1-b8fd-0cfb88db8ae0 tempest-VolumesSnapshotsTestJSON-1477544476 None] Creating volume a9d8be3b-afc6-4197-aee2-96afc19dcb98 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:52:52 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [req-c1599394-a3a6-430a-98b7-a11506f834ad req-292200de-738d-4fd1-b8fd-0cfb88db8ae0 tempest-VolumesSnapshotsTestJSON-1477544476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:52:52 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [req-c1599394-a3a6-430a-98b7-a11506f834ad req-292200de-738d-4fd1-b8fd-0cfb88db8ae0 tempest-VolumesSnapshotsTestJSON-1477544476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:52:52 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [req-c1599394-a3a6-430a-98b7-a11506f834ad req-292200de-738d-4fd1-b8fd-0cfb88db8ae0 tempest-VolumesSnapshotsTestJSON-1477544476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:52:52 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [req-c1599394-a3a6-430a-98b7-a11506f834ad req-292200de-738d-4fd1-b8fd-0cfb88db8ae0 tempest-VolumesSnapshotsTestJSON-1477544476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:52:52 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [req-c1599394-a3a6-430a-98b7-a11506f834ad req-292200de-738d-4fd1-b8fd-0cfb88db8ae0 tempest-VolumesSnapshotsTestJSON-1477544476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:52:52 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [req-c1599394-a3a6-430a-98b7-a11506f834ad req-292200de-738d-4fd1-b8fd-0cfb88db8ae0 tempest-VolumesSnapshotsTestJSON-1477544476 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:52:52 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [req-c1599394-a3a6-430a-98b7-a11506f834ad req-292200de-738d-4fd1-b8fd-0cfb88db8ae0 tempest-VolumesSnapshotsTestJSON-1477544476 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:52:52 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-c1599394-a3a6-430a-98b7-a11506f834ad req-292200de-738d-4fd1-b8fd-0cfb88db8ae0 tempest-VolumesSnapshotsTestJSON-1477544476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a9d8be3b-afc6-4197-aee2-96afc19dcb98 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:52:52 devstack sudo[84260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a9d8be3b-afc6-4197-aee2-96afc19dcb98 1073741824
Apr 15 15:52:52 devstack sudo[84260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:52:53 devstack sudo[84258]: pam_unix(sudo:session): session closed for user root
Apr 15 15:52:53 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9ac7f675-9eac-4123-b4b5-0289e0f37170 tempest-ServersNegativeTestJSON-792739514 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3d351263-4dbf-41a3-8867-2ff7a1d4bba9" returned: 0 in 1.066s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:52:53 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9ac7f675-9eac-4123-b4b5-0289e0f37170 tempest-ServersNegativeTestJSON-792739514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3d351263-4dbf-41a3-8867-2ff7a1d4bba9 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:52:53 devstack sudo[84270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3d351263-4dbf-41a3-8867-2ff7a1d4bba9
Apr 15 15:52:53 devstack sudo[84270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:52:53 devstack sudo[84260]: pam_unix(sudo:session): session closed for user root
Apr 15 15:52:53 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-c1599394-a3a6-430a-98b7-a11506f834ad req-292200de-738d-4fd1-b8fd-0cfb88db8ae0 tempest-VolumesSnapshotsTestJSON-1477544476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a9d8be3b-afc6-4197-aee2-96afc19dcb98 1073741824" returned: 0 in 0.816s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:52:53 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-c1599394-a3a6-430a-98b7-a11506f834ad req-292200de-738d-4fd1-b8fd-0cfb88db8ae0 tempest-VolumesSnapshotsTestJSON-1477544476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a9d8be3b-afc6-4197-aee2-96afc19dcb98 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:52:53 devstack sudo[84272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a9d8be3b-afc6-4197-aee2-96afc19dcb98
Apr 15 15:52:53 devstack sudo[84272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:52:54 devstack sudo[84270]: pam_unix(sudo:session): session closed for user root
Apr 15 15:52:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9ac7f675-9eac-4123-b4b5-0289e0f37170 tempest-ServersNegativeTestJSON-792739514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3d351263-4dbf-41a3-8867-2ff7a1d4bba9" returned: 0 in 0.757s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:52:54 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-9ac7f675-9eac-4123-b4b5-0289e0f37170 tempest-ServersNegativeTestJSON-792739514 None] Lock "cinder-quobyte-3d351263-4dbf-41a3-8867-2ff7a1d4bba9" released by "delete_volume" :: held 1.954s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:52:54 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-9ac7f675-9eac-4123-b4b5-0289e0f37170 tempest-ServersNegativeTestJSON-792739514 None] Created reservations ['59e44775-0686-43a9-8376-f15b7a8de381', '287b546d-9fc8-4c3e-955a-5a0233384ed8', '957ed1b6-5ff5-42ee-a360-c4f784f0fb41', '46ac4ee0-688d-486a-bf44-b401a171e862'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:52:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-9ac7f675-9eac-4123-b4b5-0289e0f37170 tempest-ServersNegativeTestJSON-792739514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:52:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-9ac7f675-9eac-4123-b4b5-0289e0f37170 tempest-ServersNegativeTestJSON-792739514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:52:54 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-9ac7f675-9eac-4123-b4b5-0289e0f37170 tempest-ServersNegativeTestJSON-792739514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:52:54 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-9ac7f675-9eac-4123-b4b5-0289e0f37170 tempest-ServersNegativeTestJSON-792739514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:52:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-9ac7f675-9eac-4123-b4b5-0289e0f37170 tempest-ServersNegativeTestJSON-792739514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:52:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9ac7f675-9eac-4123-b4b5-0289e0f37170 tempest-ServersNegativeTestJSON-792739514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:52:54 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-a2df94d1-3c93-412e-8568-c996c19b0bb5 tempest-ServersNegativeTestJSON-792739514 None] Acquiring lock "cinder-27fadd52-92c8-4f36-8214-93dc46b5ad21-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:52:54 devstack sudo[84306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:52:54 devstack sudo[84306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:52:54 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-a2df94d1-3c93-412e-8568-c996c19b0bb5 tempest-ServersNegativeTestJSON-792739514 None] Lock "cinder-27fadd52-92c8-4f36-8214-93dc46b5ad21-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:52:54 devstack sudo[84272]: pam_unix(sudo:session): session closed for user root
Apr 15 15:52:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-c1599394-a3a6-430a-98b7-a11506f834ad req-292200de-738d-4fd1-b8fd-0cfb88db8ae0 tempest-VolumesSnapshotsTestJSON-1477544476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a9d8be3b-afc6-4197-aee2-96afc19dcb98" returned: 0 in 1.049s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:52:54 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [req-c1599394-a3a6-430a-98b7-a11506f834ad req-292200de-738d-4fd1-b8fd-0cfb88db8ae0 tempest-VolumesSnapshotsTestJSON-1477544476 None] <== create_volume: return (1922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:52:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [req-c1599394-a3a6-430a-98b7-a11506f834ad req-292200de-738d-4fd1-b8fd-0cfb88db8ae0 tempest-VolumesSnapshotsTestJSON-1477544476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.924s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:52:54 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-a2df94d1-3c93-412e-8568-c996c19b0bb5 tempest-ServersNegativeTestJSON-792739514 None] Acquiring lock "cinder-quobyte-27fadd52-92c8-4f36-8214-93dc46b5ad21" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:52:54 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [req-c1599394-a3a6-430a-98b7-a11506f834ad req-292200de-738d-4fd1-b8fd-0cfb88db8ae0 tempest-VolumesSnapshotsTestJSON-1477544476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c560256e-dce8-42e6-b0b5-216557711365) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9d8be3b-afc6-4197-aee2-96afc19dcb98', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:52:54 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [req-c1599394-a3a6-430a-98b7-a11506f834ad req-292200de-738d-4fd1-b8fd-0cfb88db8ae0 tempest-VolumesSnapshotsTestJSON-1477544476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (286d803f-49df-4fb6-a00d-69b22cbda4ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:52:54 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-a2df94d1-3c93-412e-8568-c996c19b0bb5 tempest-ServersNegativeTestJSON-792739514 None] Lock "cinder-quobyte-27fadd52-92c8-4f36-8214-93dc46b5ad21" acquired by "delete_volume" :: waited 0.021s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:52:54 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [req-c1599394-a3a6-430a-98b7-a11506f834ad req-292200de-738d-4fd1-b8fd-0cfb88db8ae0 tempest-VolumesSnapshotsTestJSON-1477544476 None] Volume volume-a9d8be3b-afc6-4197-aee2-96afc19dcb98 (a9d8be3b-afc6-4197-aee2-96afc19dcb98): created successfully
Apr 15 15:52:54 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [req-c1599394-a3a6-430a-98b7-a11506f834ad req-292200de-738d-4fd1-b8fd-0cfb88db8ae0 tempest-VolumesSnapshotsTestJSON-1477544476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (286d803f-49df-4fb6-a00d-69b22cbda4ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:52:54 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [req-c1599394-a3a6-430a-98b7-a11506f834ad req-292200de-738d-4fd1-b8fd-0cfb88db8ae0 tempest-VolumesSnapshotsTestJSON-1477544476 None] Flow 'volume_create_manager' (6b5682da-50a7-4845-9acf-e8095a2bf737) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:52:54 devstack cinder-volume[82485]: INFO cinder.volume.manager [req-c1599394-a3a6-430a-98b7-a11506f834ad req-292200de-738d-4fd1-b8fd-0cfb88db8ae0 tempest-VolumesSnapshotsTestJSON-1477544476 None] Created volume successfully.
Apr 15 15:52:54 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[addf4a03-88fd-4d84-863b-45c38f3a0703]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:52:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-a2df94d1-3c93-412e-8568-c996c19b0bb5 tempest-ServersNegativeTestJSON-792739514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-27fadd52-92c8-4f36-8214-93dc46b5ad21 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:52:54 devstack sudo[84308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-27fadd52-92c8-4f36-8214-93dc46b5ad21
Apr 15 15:52:54 devstack sudo[84308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:52:55 devstack sudo[84306]: pam_unix(sudo:session): session closed for user root
Apr 15 15:52:55 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9ac7f675-9eac-4123-b4b5-0289e0f37170 tempest-ServersNegativeTestJSON-792739514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.769s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:52:55 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-9ac7f675-9eac-4123-b4b5-0289e0f37170 tempest-ServersNegativeTestJSON-792739514 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:52:55 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-9ac7f675-9eac-4123-b4b5-0289e0f37170 tempest-ServersNegativeTestJSON-792739514 None] Deleted volume successfully.
Apr 15 15:52:55 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-9ac7f675-9eac-4123-b4b5-0289e0f37170 tempest-ServersNegativeTestJSON-792739514 None] Lock "cinder-3d351263-4dbf-41a3-8867-2ff7a1d4bba9-delete_volume" released by "delete_volume" :: held 3.077s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:52:55 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [req-b0533826-7c1b-4607-9217-5a015c55adcc req-493d9aa6-0173-4632-9e10-851ef4950550 tempest-VolumesSnapshotsTestJSON-1477544476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:52:55 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [req-b0533826-7c1b-4607-9217-5a015c55adcc req-493d9aa6-0173-4632-9e10-851ef4950550 tempest-VolumesSnapshotsTestJSON-1477544476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:52:55 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [req-b0533826-7c1b-4607-9217-5a015c55adcc req-493d9aa6-0173-4632-9e10-851ef4950550 tempest-VolumesSnapshotsTestJSON-1477544476 None] Creating offline snapshot aa8d0fd2-be2e-44de-8404-0c29eab70ac3 of volume a9d8be3b-afc6-4197-aee2-96afc19dcb98 {{(pid=82485) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 15:52:55 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[8058afca-d3f5-4faa-8813-2c42f44c76ff]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:52:55 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-b0533826-7c1b-4607-9217-5a015c55adcc req-493d9aa6-0173-4632-9e10-851ef4950550 tempest-VolumesSnapshotsTestJSON-1477544476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a9d8be3b-afc6-4197-aee2-96afc19dcb98 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:52:55 devstack sudo[84316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a9d8be3b-afc6-4197-aee2-96afc19dcb98
Apr 15 15:52:55 devstack sudo[84316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:52:55 devstack sudo[84308]: pam_unix(sudo:session): session closed for user root
Apr 15 15:52:55 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-a2df94d1-3c93-412e-8568-c996c19b0bb5 tempest-ServersNegativeTestJSON-792739514 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-27fadd52-92c8-4f36-8214-93dc46b5ad21" returned: 0 in 1.395s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:52:55 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-a2df94d1-3c93-412e-8568-c996c19b0bb5 tempest-ServersNegativeTestJSON-792739514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-27fadd52-92c8-4f36-8214-93dc46b5ad21 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:52:56 devstack sudo[84319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-27fadd52-92c8-4f36-8214-93dc46b5ad21
Apr 15 15:52:56 devstack sudo[84319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:52:56 devstack sudo[84316]: pam_unix(sudo:session): session closed for user root
Apr 15 15:52:56 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-b0533826-7c1b-4607-9217-5a015c55adcc req-493d9aa6-0173-4632-9e10-851ef4950550 tempest-VolumesSnapshotsTestJSON-1477544476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a9d8be3b-afc6-4197-aee2-96afc19dcb98" returned: 0 in 1.292s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:52:56 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-b0533826-7c1b-4607-9217-5a015c55adcc req-493d9aa6-0173-4632-9e10-851ef4950550 tempest-VolumesSnapshotsTestJSON-1477544476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a9d8be3b-afc6-4197-aee2-96afc19dcb98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a9d8be3b-afc6-4197-aee2-96afc19dcb98.aa8d0fd2-be2e-44de-8404-0c29eab70ac3 1G {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:52:56 devstack sudo[84325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a9d8be3b-afc6-4197-aee2-96afc19dcb98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a9d8be3b-afc6-4197-aee2-96afc19dcb98.aa8d0fd2-be2e-44de-8404-0c29eab70ac3 1G
Apr 15 15:52:56 devstack sudo[84325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:52:57 devstack sudo[84319]: pam_unix(sudo:session): session closed for user root
Apr 15 15:52:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-a2df94d1-3c93-412e-8568-c996c19b0bb5 tempest-ServersNegativeTestJSON-792739514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-27fadd52-92c8-4f36-8214-93dc46b5ad21" returned: 0 in 1.261s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:52:57 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-a2df94d1-3c93-412e-8568-c996c19b0bb5 tempest-ServersNegativeTestJSON-792739514 None] Lock "cinder-quobyte-27fadd52-92c8-4f36-8214-93dc46b5ad21" released by "delete_volume" :: held 2.737s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:52:57 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-a2df94d1-3c93-412e-8568-c996c19b0bb5 tempest-ServersNegativeTestJSON-792739514 None] Created reservations ['fa4c54d4-2955-4470-b3fc-670da316f400', '525114d9-14c0-4144-8ed7-b6c11e0a1b7f', '5e83c59c-2071-4094-9700-35c23bb0fda0', 'c3d4cc84-bb98-46fd-8b64-3fa2704704de'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:52:57 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-90d18938-482e-4626-9135-f5d9bdd47dd1 tempest-ServerRescueNegativeTestJSON-809130254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:52:57 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-90d18938-482e-4626-9135-f5d9bdd47dd1 tempest-ServerRescueNegativeTestJSON-809130254 None] Flow 'volume_create_manager' (fb4e98f7-25f5-4e65-be2b-c8553bb26630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:52:57 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-90d18938-482e-4626-9135-f5d9bdd47dd1 tempest-ServerRescueNegativeTestJSON-809130254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fa3f989-7085-49d1-ba84-121c39c723a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:52:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-a2df94d1-3c93-412e-8568-c996c19b0bb5 tempest-ServersNegativeTestJSON-792739514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:52:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-a2df94d1-3c93-412e-8568-c996c19b0bb5 tempest-ServersNegativeTestJSON-792739514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:52:57 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-a2df94d1-3c93-412e-8568-c996c19b0bb5 tempest-ServersNegativeTestJSON-792739514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:52:57 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-a2df94d1-3c93-412e-8568-c996c19b0bb5 tempest-ServersNegativeTestJSON-792739514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:52:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-a2df94d1-3c93-412e-8568-c996c19b0bb5 tempest-ServersNegativeTestJSON-792739514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:52:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-a2df94d1-3c93-412e-8568-c996c19b0bb5 tempest-ServersNegativeTestJSON-792739514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:52:57 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-90d18938-482e-4626-9135-f5d9bdd47dd1 tempest-ServerRescueNegativeTestJSON-809130254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fa3f989-7085-49d1-ba84-121c39c723a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1690569166',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0e5eb91-50ac-4134-8026-055c4997c2e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cd34d71debc40d0a801fede71d98d8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:52:57Z,use_quota=True,user_id='79eef84a481146eb831661e01dc9506d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:52:57 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-90d18938-482e-4626-9135-f5d9bdd47dd1 tempest-ServerRescueNegativeTestJSON-809130254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aed84a2b-b09d-4ba2-9b8f-09543c19b546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:52:57 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-90d18938-482e-4626-9135-f5d9bdd47dd1 tempest-ServerRescueNegativeTestJSON-809130254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aed84a2b-b09d-4ba2-9b8f-09543c19b546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:52:57 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-90d18938-482e-4626-9135-f5d9bdd47dd1 tempest-ServerRescueNegativeTestJSON-809130254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2a1d24c-8ec6-4d18-a28b-e33d72682154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:52:57 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-90d18938-482e-4626-9135-f5d9bdd47dd1 tempest-ServerRescueNegativeTestJSON-809130254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2a1d24c-8ec6-4d18-a28b-e33d72682154) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0e5eb91-50ac-4134-8026-055c4997c2e2', 'volume_name': 'volume-d0e5eb91-50ac-4134-8026-055c4997c2e2', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:52:57 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-90d18938-482e-4626-9135-f5d9bdd47dd1 tempest-ServerRescueNegativeTestJSON-809130254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (481dbaa3-64d7-4ba3-ad9a-f9f52558f7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:52:57 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-90d18938-482e-4626-9135-f5d9bdd47dd1 tempest-ServerRescueNegativeTestJSON-809130254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (481dbaa3-64d7-4ba3-ad9a-f9f52558f7a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:52:57 devstack sudo[84330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:52:57 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-90d18938-482e-4626-9135-f5d9bdd47dd1 tempest-ServerRescueNegativeTestJSON-809130254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0445083c-edb5-4d02-86e5-4aa7d85f6476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:52:57 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-90d18938-482e-4626-9135-f5d9bdd47dd1 tempest-ServerRescueNegativeTestJSON-809130254 None] Volume d0e5eb91-50ac-4134-8026-055c4997c2e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0e5eb91-50ac-4134-8026-055c4997c2e2', 'volume_size': 1}
Apr 15 15:52:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-90d18938-482e-4626-9135-f5d9bdd47dd1 tempest-ServerRescueNegativeTestJSON-809130254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:52:57 devstack sudo[84330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:52:58 devstack sudo[84325]: pam_unix(sudo:session): session closed for user root
Apr 15 15:52:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-b0533826-7c1b-4607-9217-5a015c55adcc req-493d9aa6-0173-4632-9e10-851ef4950550 tempest-VolumesSnapshotsTestJSON-1477544476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a9d8be3b-afc6-4197-aee2-96afc19dcb98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a9d8be3b-afc6-4197-aee2-96afc19dcb98.aa8d0fd2-be2e-44de-8404-0c29eab70ac3 1G" returned: 0 in 1.299s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:52:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-b0533826-7c1b-4607-9217-5a015c55adcc req-493d9aa6-0173-4632-9e10-851ef4950550 tempest-VolumesSnapshotsTestJSON-1477544476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9d8be3b-afc6-4197-aee2-96afc19dcb98 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a9d8be3b-afc6-4197-aee2-96afc19dcb98.aa8d0fd2-be2e-44de-8404-0c29eab70ac3 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:52:58 devstack sudo[84334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9d8be3b-afc6-4197-aee2-96afc19dcb98 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a9d8be3b-afc6-4197-aee2-96afc19dcb98.aa8d0fd2-be2e-44de-8404-0c29eab70ac3
Apr 15 15:52:58 devstack sudo[84334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:52:58 devstack sudo[84330]: pam_unix(sudo:session): session closed for user root
Apr 15 15:52:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-a2df94d1-3c93-412e-8568-c996c19b0bb5 tempest-ServersNegativeTestJSON-792739514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 1.248s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:52:58 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-a2df94d1-3c93-412e-8568-c996c19b0bb5 tempest-ServersNegativeTestJSON-792739514 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:52:58 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-a2df94d1-3c93-412e-8568-c996c19b0bb5 tempest-ServersNegativeTestJSON-792739514 None] Deleted volume successfully.
Apr 15 15:52:58 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-a2df94d1-3c93-412e-8568-c996c19b0bb5 tempest-ServersNegativeTestJSON-792739514 None] Lock "cinder-27fadd52-92c8-4f36-8214-93dc46b5ad21-delete_volume" released by "delete_volume" :: held 4.467s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:52:59 devstack sudo[84334]: pam_unix(sudo:session): session closed for user root
Apr 15 15:52:59 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-b0533826-7c1b-4607-9217-5a015c55adcc req-493d9aa6-0173-4632-9e10-851ef4950550 tempest-VolumesSnapshotsTestJSON-1477544476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9d8be3b-afc6-4197-aee2-96afc19dcb98 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a9d8be3b-afc6-4197-aee2-96afc19dcb98.aa8d0fd2-be2e-44de-8404-0c29eab70ac3" returned: 0 in 1.145s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:52:59 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [req-b0533826-7c1b-4607-9217-5a015c55adcc req-493d9aa6-0173-4632-9e10-851ef4950550 tempest-VolumesSnapshotsTestJSON-1477544476 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a9d8be3b-afc6-4197-aee2-96afc19dcb98.aa8d0fd2-be2e-44de-8404-0c29eab70ac3 is being set with open permissions: ugo+rw
Apr 15 15:52:59 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-b0533826-7c1b-4607-9217-5a015c55adcc req-493d9aa6-0173-4632-9e10-851ef4950550 tempest-VolumesSnapshotsTestJSON-1477544476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a9d8be3b-afc6-4197-aee2-96afc19dcb98.aa8d0fd2-be2e-44de-8404-0c29eab70ac3 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:52:59 devstack sudo[84347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a9d8be3b-afc6-4197-aee2-96afc19dcb98.aa8d0fd2-be2e-44de-8404-0c29eab70ac3
Apr 15 15:52:59 devstack sudo[84347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:53:00 devstack sudo[84347]: pam_unix(sudo:session): session closed for user root
Apr 15 15:53:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-b0533826-7c1b-4607-9217-5a015c55adcc req-493d9aa6-0173-4632-9e10-851ef4950550 tempest-VolumesSnapshotsTestJSON-1477544476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a9d8be3b-afc6-4197-aee2-96afc19dcb98.aa8d0fd2-be2e-44de-8404-0c29eab70ac3" returned: 0 in 0.759s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:53:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-b0533826-7c1b-4607-9217-5a015c55adcc req-493d9aa6-0173-4632-9e10-851ef4950550 tempest-VolumesSnapshotsTestJSON-1477544476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a9d8be3b-afc6-4197-aee2-96afc19dcb98.info {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:53:00 devstack sudo[84368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a9d8be3b-afc6-4197-aee2-96afc19dcb98.info
Apr 15 15:53:00 devstack sudo[84368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:53:00 devstack sudo[84368]: pam_unix(sudo:session): session closed for user root
Apr 15 15:53:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-b0533826-7c1b-4607-9217-5a015c55adcc req-493d9aa6-0173-4632-9e10-851ef4950550 tempest-VolumesSnapshotsTestJSON-1477544476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a9d8be3b-afc6-4197-aee2-96afc19dcb98.info" returned: 0 in 0.595s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:53:00 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [req-b0533826-7c1b-4607-9217-5a015c55adcc req-493d9aa6-0173-4632-9e10-851ef4950550 tempest-VolumesSnapshotsTestJSON-1477544476 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a9d8be3b-afc6-4197-aee2-96afc19dcb98.info is being set with open permissions: ugo+rw
Apr 15 15:53:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-b0533826-7c1b-4607-9217-5a015c55adcc req-493d9aa6-0173-4632-9e10-851ef4950550 tempest-VolumesSnapshotsTestJSON-1477544476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a9d8be3b-afc6-4197-aee2-96afc19dcb98.info {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:53:00 devstack sudo[84373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a9d8be3b-afc6-4197-aee2-96afc19dcb98.info
Apr 15 15:53:00 devstack sudo[84373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:53:01 devstack sudo[84373]: pam_unix(sudo:session): session closed for user root
Apr 15 15:53:01 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-b0533826-7c1b-4607-9217-5a015c55adcc req-493d9aa6-0173-4632-9e10-851ef4950550 tempest-VolumesSnapshotsTestJSON-1477544476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a9d8be3b-afc6-4197-aee2-96afc19dcb98.info" returned: 0 in 0.840s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:53:01 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [req-b0533826-7c1b-4607-9217-5a015c55adcc req-493d9aa6-0173-4632-9e10-851ef4950550 tempest-VolumesSnapshotsTestJSON-1477544476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.202s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:53:01 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-90d18938-482e-4626-9135-f5d9bdd47dd1 tempest-ServerRescueNegativeTestJSON-809130254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.998s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:53:01 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-90d18938-482e-4626-9135-f5d9bdd47dd1 tempest-ServerRescueNegativeTestJSON-809130254 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1690569166',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0e5eb91-50ac-4134-8026-055c4997c2e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cd34d71debc40d0a801fede71d98d8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:52:57Z,use_quota=True,user_id='79eef84a481146eb831661e01dc9506d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:53:01 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-90d18938-482e-4626-9135-f5d9bdd47dd1 tempest-ServerRescueNegativeTestJSON-809130254 None] Creating volume d0e5eb91-50ac-4134-8026-055c4997c2e2 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:53:01 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-90d18938-482e-4626-9135-f5d9bdd47dd1 tempest-ServerRescueNegativeTestJSON-809130254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:53:01 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-90d18938-482e-4626-9135-f5d9bdd47dd1 tempest-ServerRescueNegativeTestJSON-809130254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:53:01 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-90d18938-482e-4626-9135-f5d9bdd47dd1 tempest-ServerRescueNegativeTestJSON-809130254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:53:01 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-90d18938-482e-4626-9135-f5d9bdd47dd1 tempest-ServerRescueNegativeTestJSON-809130254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:53:01 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-90d18938-482e-4626-9135-f5d9bdd47dd1 tempest-ServerRescueNegativeTestJSON-809130254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:53:01 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-90d18938-482e-4626-9135-f5d9bdd47dd1 tempest-ServerRescueNegativeTestJSON-809130254 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:53:01 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-90d18938-482e-4626-9135-f5d9bdd47dd1 tempest-ServerRescueNegativeTestJSON-809130254 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:53:01 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-90d18938-482e-4626-9135-f5d9bdd47dd1 tempest-ServerRescueNegativeTestJSON-809130254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-d0e5eb91-50ac-4134-8026-055c4997c2e2 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:53:01 devstack sudo[84378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-d0e5eb91-50ac-4134-8026-055c4997c2e2 1073741824
Apr 15 15:53:01 devstack cinder-volume[82485]: INFO cinder.volume.manager [req-b0533826-7c1b-4607-9217-5a015c55adcc req-493d9aa6-0173-4632-9e10-851ef4950550 tempest-VolumesSnapshotsTestJSON-1477544476 None] Create snapshot completed successfully
Apr 15 15:53:01 devstack sudo[84378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:53:02 devstack cinder-volume[82485]: DEBUG cinder.coordination [req-06220c51-5589-438a-be98-4bf341dc947a req-b2f73633-2769-480e-8005-f60bbab32de2 tempest-VolumesSnapshotsTestJSON-1477544476 None] Acquiring lock "cinder-aa8d0fd2-be2e-44de-8404-0c29eab70ac3-delete_snapshot" by "delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:53:02 devstack cinder-volume[82485]: DEBUG cinder.coordination [req-06220c51-5589-438a-be98-4bf341dc947a req-b2f73633-2769-480e-8005-f60bbab32de2 tempest-VolumesSnapshotsTestJSON-1477544476 None] Lock "cinder-aa8d0fd2-be2e-44de-8404-0c29eab70ac3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:53:02 devstack cinder-volume[82485]: DEBUG cinder.coordination [req-06220c51-5589-438a-be98-4bf341dc947a req-b2f73633-2769-480e-8005-f60bbab32de2 tempest-VolumesSnapshotsTestJSON-1477544476 None] Acquiring lock "cinder-quobyte-a9d8be3b-afc6-4197-aee2-96afc19dcb98" by "delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:53:02 devstack sudo[84378]: pam_unix(sudo:session): session closed for user root
Apr 15 15:53:02 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-90d18938-482e-4626-9135-f5d9bdd47dd1 tempest-ServerRescueNegativeTestJSON-809130254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-d0e5eb91-50ac-4134-8026-055c4997c2e2 1073741824" returned: 0 in 0.871s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:53:02 devstack cinder-volume[82485]: DEBUG cinder.coordination [req-06220c51-5589-438a-be98-4bf341dc947a req-b2f73633-2769-480e-8005-f60bbab32de2 tempest-VolumesSnapshotsTestJSON-1477544476 None] Lock "cinder-quobyte-a9d8be3b-afc6-4197-aee2-96afc19dcb98" acquired by "delete_snapshot" :: waited 0.074s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:53:02 devstack cinder-volume[82485]: DEBUG cinder.coordination [req-06220c51-5589-438a-be98-4bf341dc947a req-b2f73633-2769-480e-8005-f60bbab32de2 tempest-VolumesSnapshotsTestJSON-1477544476 None] Acquiring lock "cinder-quobyte-aa8d0fd2-be2e-44de-8404-0c29eab70ac3" by "_delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:53:02 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-90d18938-482e-4626-9135-f5d9bdd47dd1 tempest-ServerRescueNegativeTestJSON-809130254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-d0e5eb91-50ac-4134-8026-055c4997c2e2 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:53:02 devstack cinder-volume[82485]: DEBUG cinder.coordination [req-06220c51-5589-438a-be98-4bf341dc947a req-b2f73633-2769-480e-8005-f60bbab32de2 tempest-VolumesSnapshotsTestJSON-1477544476 None] Lock "cinder-quobyte-aa8d0fd2-be2e-44de-8404-0c29eab70ac3" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:53:02 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [req-06220c51-5589-438a-be98-4bf341dc947a req-b2f73633-2769-480e-8005-f60bbab32de2 tempest-VolumesSnapshotsTestJSON-1477544476 None] Deleting offline snapshot aa8d0fd2-be2e-44de-8404-0c29eab70ac3 of volume a9d8be3b-afc6-4197-aee2-96afc19dcb98 {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 15:53:02 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [req-06220c51-5589-438a-be98-4bf341dc947a req-b2f73633-2769-480e-8005-f60bbab32de2 tempest-VolumesSnapshotsTestJSON-1477544476 None] snapshot_file for this snap is: volume-a9d8be3b-afc6-4197-aee2-96afc19dcb98.aa8d0fd2-be2e-44de-8404-0c29eab70ac3 {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 15:53:02 devstack sudo[84384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-d0e5eb91-50ac-4134-8026-055c4997c2e2
Apr 15 15:53:02 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[379e352d-e804-4402-afde-e9e2178b90bc]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:53:02 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-06220c51-5589-438a-be98-4bf341dc947a req-b2f73633-2769-480e-8005-f60bbab32de2 tempest-VolumesSnapshotsTestJSON-1477544476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a9d8be3b-afc6-4197-aee2-96afc19dcb98.aa8d0fd2-be2e-44de-8404-0c29eab70ac3 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:53:02 devstack sudo[84384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:53:02 devstack sudo[84385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a9d8be3b-afc6-4197-aee2-96afc19dcb98.aa8d0fd2-be2e-44de-8404-0c29eab70ac3
Apr 15 15:53:02 devstack sudo[84385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:53:03 devstack sudo[84384]: pam_unix(sudo:session): session closed for user root
Apr 15 15:53:03 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-90d18938-482e-4626-9135-f5d9bdd47dd1 tempest-ServerRescueNegativeTestJSON-809130254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-d0e5eb91-50ac-4134-8026-055c4997c2e2" returned: 0 in 0.622s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:53:03 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-90d18938-482e-4626-9135-f5d9bdd47dd1 tempest-ServerRescueNegativeTestJSON-809130254 None] <== create_volume: return (1557ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:53:03 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-90d18938-482e-4626-9135-f5d9bdd47dd1 tempest-ServerRescueNegativeTestJSON-809130254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:53:03 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-90d18938-482e-4626-9135-f5d9bdd47dd1 tempest-ServerRescueNegativeTestJSON-809130254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0445083c-edb5-4d02-86e5-4aa7d85f6476) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0e5eb91-50ac-4134-8026-055c4997c2e2', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:53:03 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-90d18938-482e-4626-9135-f5d9bdd47dd1 tempest-ServerRescueNegativeTestJSON-809130254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4443e3a8-5ef2-4a1b-97cf-86531bc7bda0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:53:03 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-90d18938-482e-4626-9135-f5d9bdd47dd1 tempest-ServerRescueNegativeTestJSON-809130254 None] Volume volume-d0e5eb91-50ac-4134-8026-055c4997c2e2 (d0e5eb91-50ac-4134-8026-055c4997c2e2): created successfully
Apr 15 15:53:03 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-90d18938-482e-4626-9135-f5d9bdd47dd1 tempest-ServerRescueNegativeTestJSON-809130254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4443e3a8-5ef2-4a1b-97cf-86531bc7bda0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:53:03 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-90d18938-482e-4626-9135-f5d9bdd47dd1 tempest-ServerRescueNegativeTestJSON-809130254 None] Flow 'volume_create_manager' (fb4e98f7-25f5-4e65-be2b-c8553bb26630) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:53:03 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-90d18938-482e-4626-9135-f5d9bdd47dd1 tempest-ServerRescueNegativeTestJSON-809130254 None] Created volume successfully.
Apr 15 15:53:03 devstack sudo[84385]: pam_unix(sudo:session): session closed for user root
Apr 15 15:53:03 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-06220c51-5589-438a-be98-4bf341dc947a req-b2f73633-2769-480e-8005-f60bbab32de2 tempest-VolumesSnapshotsTestJSON-1477544476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a9d8be3b-afc6-4197-aee2-96afc19dcb98.aa8d0fd2-be2e-44de-8404-0c29eab70ac3" returned: 0 in 0.729s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:53:03 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [req-06220c51-5589-438a-be98-4bf341dc947a req-b2f73633-2769-480e-8005-f60bbab32de2 tempest-VolumesSnapshotsTestJSON-1477544476 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9d8be3b-afc6-4197-aee2-96afc19dcb98(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82485) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 15:53:03 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8cfbda-af08-4f90-8c9c-e8f0245f4a00]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:53:03 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-06220c51-5589-438a-be98-4bf341dc947a req-b2f73633-2769-480e-8005-f60bbab32de2 tempest-VolumesSnapshotsTestJSON-1477544476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a9d8be3b-afc6-4197-aee2-96afc19dcb98 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:53:03 devstack sudo[84392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a9d8be3b-afc6-4197-aee2-96afc19dcb98
Apr 15 15:53:03 devstack sudo[84392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:53:04 devstack sudo[84392]: pam_unix(sudo:session): session closed for user root
Apr 15 15:53:04 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-06220c51-5589-438a-be98-4bf341dc947a req-b2f73633-2769-480e-8005-f60bbab32de2 tempest-VolumesSnapshotsTestJSON-1477544476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a9d8be3b-afc6-4197-aee2-96afc19dcb98" returned: 0 in 0.720s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:53:04 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-06220c51-5589-438a-be98-4bf341dc947a req-b2f73633-2769-480e-8005-f60bbab32de2 tempest-VolumesSnapshotsTestJSON-1477544476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a9d8be3b-afc6-4197-aee2-96afc19dcb98.aa8d0fd2-be2e-44de-8404-0c29eab70ac3 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:53:04 devstack sudo[84402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a9d8be3b-afc6-4197-aee2-96afc19dcb98.aa8d0fd2-be2e-44de-8404-0c29eab70ac3
Apr 15 15:53:04 devstack sudo[84402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:53:04 devstack sudo[84402]: pam_unix(sudo:session): session closed for user root
Apr 15 15:53:04 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-06220c51-5589-438a-be98-4bf341dc947a req-b2f73633-2769-480e-8005-f60bbab32de2 tempest-VolumesSnapshotsTestJSON-1477544476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a9d8be3b-afc6-4197-aee2-96afc19dcb98.aa8d0fd2-be2e-44de-8404-0c29eab70ac3" returned: 0 in 0.703s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:53:04 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-06220c51-5589-438a-be98-4bf341dc947a req-b2f73633-2769-480e-8005-f60bbab32de2 tempest-VolumesSnapshotsTestJSON-1477544476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a9d8be3b-afc6-4197-aee2-96afc19dcb98.aa8d0fd2-be2e-44de-8404-0c29eab70ac3 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:53:04 devstack sudo[84410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a9d8be3b-afc6-4197-aee2-96afc19dcb98.aa8d0fd2-be2e-44de-8404-0c29eab70ac3
Apr 15 15:53:04 devstack sudo[84410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:53:05 devstack sudo[84410]: pam_unix(sudo:session): session closed for user root
Apr 15 15:53:05 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-06220c51-5589-438a-be98-4bf341dc947a req-b2f73633-2769-480e-8005-f60bbab32de2 tempest-VolumesSnapshotsTestJSON-1477544476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a9d8be3b-afc6-4197-aee2-96afc19dcb98.aa8d0fd2-be2e-44de-8404-0c29eab70ac3" returned: 0 in 0.725s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:53:05 devstack cinder-volume[82485]: DEBUG cinder.coordination [req-06220c51-5589-438a-be98-4bf341dc947a req-b2f73633-2769-480e-8005-f60bbab32de2 tempest-VolumesSnapshotsTestJSON-1477544476 None] Lock "cinder-quobyte-aa8d0fd2-be2e-44de-8404-0c29eab70ac3" released by "_delete_snapshot" :: held 2.982s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:53:05 devstack cinder-volume[82485]: DEBUG cinder.coordination [req-06220c51-5589-438a-be98-4bf341dc947a req-b2f73633-2769-480e-8005-f60bbab32de2 tempest-VolumesSnapshotsTestJSON-1477544476 None] Lock "cinder-quobyte-a9d8be3b-afc6-4197-aee2-96afc19dcb98" released by "delete_snapshot" :: held 3.022s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:53:05 devstack cinder-volume[82485]: WARNING cinder.quota [req-06220c51-5589-438a-be98-4bf341dc947a req-b2f73633-2769-480e-8005-f60bbab32de2 tempest-VolumesSnapshotsTestJSON-1477544476 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 15 15:53:05 devstack cinder-volume[82485]: DEBUG cinder.quota [req-06220c51-5589-438a-be98-4bf341dc947a req-b2f73633-2769-480e-8005-f60bbab32de2 tempest-VolumesSnapshotsTestJSON-1477544476 None] Created reservations ['0c6ba744-77bc-481c-9ce5-5c921352769f', 'b14343ad-9257-43fa-acf4-26763fe3c66f', '59521a90-4043-421d-a8dd-1a0694fe6f06', '6b1772aa-ff6d-4aeb-91a5-b61c5a3d2d81'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:53:05 devstack cinder-volume[82485]: INFO cinder.volume.manager [req-06220c51-5589-438a-be98-4bf341dc947a req-b2f73633-2769-480e-8005-f60bbab32de2 tempest-VolumesSnapshotsTestJSON-1477544476 None] Delete snapshot completed successfully.
Apr 15 15:53:05 devstack cinder-volume[82485]: DEBUG cinder.coordination [req-06220c51-5589-438a-be98-4bf341dc947a req-b2f73633-2769-480e-8005-f60bbab32de2 tempest-VolumesSnapshotsTestJSON-1477544476 None] Lock "cinder-aa8d0fd2-be2e-44de-8404-0c29eab70ac3-delete_snapshot" released by "delete_snapshot" :: held 3.282s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:53:05 devstack cinder-volume[82485]: DEBUG cinder.coordination [req-577ff73f-40ca-4402-916e-415ef83e3fe6 req-b65612eb-78e1-4fbd-82fd-aa1cf625cbae tempest-VolumesSnapshotsTestJSON-1477544476 None] Acquiring lock "cinder-a9d8be3b-afc6-4197-aee2-96afc19dcb98-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:53:05 devstack cinder-volume[82485]: DEBUG cinder.coordination [req-577ff73f-40ca-4402-916e-415ef83e3fe6 req-b65612eb-78e1-4fbd-82fd-aa1cf625cbae tempest-VolumesSnapshotsTestJSON-1477544476 None] Lock "cinder-a9d8be3b-afc6-4197-aee2-96afc19dcb98-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:53:06 devstack cinder-volume[82485]: DEBUG cinder.coordination [req-577ff73f-40ca-4402-916e-415ef83e3fe6 req-b65612eb-78e1-4fbd-82fd-aa1cf625cbae tempest-VolumesSnapshotsTestJSON-1477544476 None] Acquiring lock "cinder-quobyte-a9d8be3b-afc6-4197-aee2-96afc19dcb98" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:53:06 devstack cinder-volume[82485]: DEBUG cinder.coordination [req-577ff73f-40ca-4402-916e-415ef83e3fe6 req-b65612eb-78e1-4fbd-82fd-aa1cf625cbae tempest-VolumesSnapshotsTestJSON-1477544476 None] Lock "cinder-quobyte-a9d8be3b-afc6-4197-aee2-96afc19dcb98" acquired by "delete_volume" :: waited 0.012s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:53:06 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[54bb3707-c6a1-4771-ab0b-1a115ae43e5c]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:53:06 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-577ff73f-40ca-4402-916e-415ef83e3fe6 req-b65612eb-78e1-4fbd-82fd-aa1cf625cbae tempest-VolumesSnapshotsTestJSON-1477544476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a9d8be3b-afc6-4197-aee2-96afc19dcb98 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:53:06 devstack sudo[84414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a9d8be3b-afc6-4197-aee2-96afc19dcb98
Apr 15 15:53:06 devstack sudo[84414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:53:06 devstack sudo[84414]: pam_unix(sudo:session): session closed for user root
Apr 15 15:53:06 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-577ff73f-40ca-4402-916e-415ef83e3fe6 req-b65612eb-78e1-4fbd-82fd-aa1cf625cbae tempest-VolumesSnapshotsTestJSON-1477544476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a9d8be3b-afc6-4197-aee2-96afc19dcb98" returned: 0 in 0.729s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:53:06 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-577ff73f-40ca-4402-916e-415ef83e3fe6 req-b65612eb-78e1-4fbd-82fd-aa1cf625cbae tempest-VolumesSnapshotsTestJSON-1477544476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a9d8be3b-afc6-4197-aee2-96afc19dcb98 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:53:06 devstack sudo[84420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a9d8be3b-afc6-4197-aee2-96afc19dcb98
Apr 15 15:53:06 devstack sudo[84420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:53:07 devstack sudo[84420]: pam_unix(sudo:session): session closed for user root
Apr 15 15:53:07 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-577ff73f-40ca-4402-916e-415ef83e3fe6 req-b65612eb-78e1-4fbd-82fd-aa1cf625cbae tempest-VolumesSnapshotsTestJSON-1477544476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a9d8be3b-afc6-4197-aee2-96afc19dcb98" returned: 0 in 0.658s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:53:07 devstack cinder-volume[82485]: DEBUG cinder.coordination [req-577ff73f-40ca-4402-916e-415ef83e3fe6 req-b65612eb-78e1-4fbd-82fd-aa1cf625cbae tempest-VolumesSnapshotsTestJSON-1477544476 None] Lock "cinder-quobyte-a9d8be3b-afc6-4197-aee2-96afc19dcb98" released by "delete_volume" :: held 1.443s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:53:07 devstack cinder-volume[82485]: DEBUG cinder.quota [req-577ff73f-40ca-4402-916e-415ef83e3fe6 req-b65612eb-78e1-4fbd-82fd-aa1cf625cbae tempest-VolumesSnapshotsTestJSON-1477544476 None] Created reservations ['888a2bc9-d668-4c3a-8819-ce1abee111e9', '19e749d4-c257-4029-89db-70c9cc641bb4', 'f5b4ba39-4f47-4d19-87ae-75097c3c9b55', 'eb99d36e-1dea-4239-90dd-7bb1dfbf4781'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:53:07 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [req-577ff73f-40ca-4402-916e-415ef83e3fe6 req-b65612eb-78e1-4fbd-82fd-aa1cf625cbae tempest-VolumesSnapshotsTestJSON-1477544476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:53:07 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [req-577ff73f-40ca-4402-916e-415ef83e3fe6 req-b65612eb-78e1-4fbd-82fd-aa1cf625cbae tempest-VolumesSnapshotsTestJSON-1477544476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:53:07 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [req-577ff73f-40ca-4402-916e-415ef83e3fe6 req-b65612eb-78e1-4fbd-82fd-aa1cf625cbae tempest-VolumesSnapshotsTestJSON-1477544476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:53:07 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [req-577ff73f-40ca-4402-916e-415ef83e3fe6 req-b65612eb-78e1-4fbd-82fd-aa1cf625cbae tempest-VolumesSnapshotsTestJSON-1477544476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:53:07 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [req-577ff73f-40ca-4402-916e-415ef83e3fe6 req-b65612eb-78e1-4fbd-82fd-aa1cf625cbae tempest-VolumesSnapshotsTestJSON-1477544476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.068s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:53:07 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-577ff73f-40ca-4402-916e-415ef83e3fe6 req-b65612eb-78e1-4fbd-82fd-aa1cf625cbae tempest-VolumesSnapshotsTestJSON-1477544476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:53:07 devstack sudo[84423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:53:07 devstack sudo[84423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:53:08 devstack sudo[84423]: pam_unix(sudo:session): session closed for user root
Apr 15 15:53:08 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-577ff73f-40ca-4402-916e-415ef83e3fe6 req-b65612eb-78e1-4fbd-82fd-aa1cf625cbae tempest-VolumesSnapshotsTestJSON-1477544476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.601s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:53:08 devstack cinder-volume[82485]: DEBUG cinder.manager [req-577ff73f-40ca-4402-916e-415ef83e3fe6 req-b65612eb-78e1-4fbd-82fd-aa1cf625cbae tempest-VolumesSnapshotsTestJSON-1477544476 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:53:08 devstack cinder-volume[82485]: INFO cinder.volume.manager [req-577ff73f-40ca-4402-916e-415ef83e3fe6 req-b65612eb-78e1-4fbd-82fd-aa1cf625cbae tempest-VolumesSnapshotsTestJSON-1477544476 None] Deleted volume successfully.
Apr 15 15:53:08 devstack cinder-volume[82485]: DEBUG cinder.coordination [req-577ff73f-40ca-4402-916e-415ef83e3fe6 req-b65612eb-78e1-4fbd-82fd-aa1cf625cbae tempest-VolumesSnapshotsTestJSON-1477544476 None] Lock "cinder-a9d8be3b-afc6-4197-aee2-96afc19dcb98-delete_volume" released by "delete_volume" :: held 2.292s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:53:12 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-adda4dfe-365d-4b1a-b2e9-6971aea3c94d tempest-VolumesTestJSON-126649175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:53:12 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-adda4dfe-365d-4b1a-b2e9-6971aea3c94d tempest-VolumesTestJSON-126649175 None] Flow 'volume_create_manager' (b13caba8-eb97-46fb-a09c-98710bbf86f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:53:12 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-adda4dfe-365d-4b1a-b2e9-6971aea3c94d tempest-VolumesTestJSON-126649175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bafc87fc-9b1b-4fa9-812b-6b3a5f258df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:53:12 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-adda4dfe-365d-4b1a-b2e9-6971aea3c94d tempest-VolumesTestJSON-126649175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bafc87fc-9b1b-4fa9-812b-6b3a5f258df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:53:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1929916669',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b43518f-d492-4c03-9608-a631bb7a732d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5966803fc7554a8599bc4e32e0b5e6c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:53:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:53:12Z,use_quota=True,user_id='d853cfa0c0f141bdab4b763bd0fe00a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:53:12 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-adda4dfe-365d-4b1a-b2e9-6971aea3c94d tempest-VolumesTestJSON-126649175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01f76f19-17c2-4a54-9439-fb3eff065c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:53:12 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-adda4dfe-365d-4b1a-b2e9-6971aea3c94d tempest-VolumesTestJSON-126649175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01f76f19-17c2-4a54-9439-fb3eff065c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:53:12 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-adda4dfe-365d-4b1a-b2e9-6971aea3c94d tempest-VolumesTestJSON-126649175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74c2aa62-378a-4907-a64d-4aaf66ac709a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:53:12 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-adda4dfe-365d-4b1a-b2e9-6971aea3c94d tempest-VolumesTestJSON-126649175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74c2aa62-378a-4907-a64d-4aaf66ac709a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b43518f-d492-4c03-9608-a631bb7a732d', 'volume_name': 'volume-4b43518f-d492-4c03-9608-a631bb7a732d', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:53:12 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-adda4dfe-365d-4b1a-b2e9-6971aea3c94d tempest-VolumesTestJSON-126649175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (245315fd-f0ef-4af6-af6e-11f33fc01d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:53:12 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-adda4dfe-365d-4b1a-b2e9-6971aea3c94d tempest-VolumesTestJSON-126649175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (245315fd-f0ef-4af6-af6e-11f33fc01d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:53:12 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-adda4dfe-365d-4b1a-b2e9-6971aea3c94d tempest-VolumesTestJSON-126649175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86df8d3c-b849-4e33-af03-9c64b7a9a13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:53:12 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-adda4dfe-365d-4b1a-b2e9-6971aea3c94d tempest-VolumesTestJSON-126649175 None] Volume 4b43518f-d492-4c03-9608-a631bb7a732d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b43518f-d492-4c03-9608-a631bb7a732d', 'volume_size': 1}
Apr 15 15:53:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-adda4dfe-365d-4b1a-b2e9-6971aea3c94d tempest-VolumesTestJSON-126649175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:53:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-adda4dfe-365d-4b1a-b2e9-6971aea3c94d tempest-VolumesTestJSON-126649175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:53:12 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-adda4dfe-365d-4b1a-b2e9-6971aea3c94d tempest-VolumesTestJSON-126649175 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:53:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1929916669',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b43518f-d492-4c03-9608-a631bb7a732d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5966803fc7554a8599bc4e32e0b5e6c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:53:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:53:12Z,use_quota=True,user_id='d853cfa0c0f141bdab4b763bd0fe00a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:53:12 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-adda4dfe-365d-4b1a-b2e9-6971aea3c94d tempest-VolumesTestJSON-126649175 None] Creating volume 4b43518f-d492-4c03-9608-a631bb7a732d {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:53:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-adda4dfe-365d-4b1a-b2e9-6971aea3c94d tempest-VolumesTestJSON-126649175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:53:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-adda4dfe-365d-4b1a-b2e9-6971aea3c94d tempest-VolumesTestJSON-126649175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:53:12 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-adda4dfe-365d-4b1a-b2e9-6971aea3c94d tempest-VolumesTestJSON-126649175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:53:12 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-adda4dfe-365d-4b1a-b2e9-6971aea3c94d tempest-VolumesTestJSON-126649175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:53:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-adda4dfe-365d-4b1a-b2e9-6971aea3c94d tempest-VolumesTestJSON-126649175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:53:12 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-adda4dfe-365d-4b1a-b2e9-6971aea3c94d tempest-VolumesTestJSON-126649175 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:53:12 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-adda4dfe-365d-4b1a-b2e9-6971aea3c94d tempest-VolumesTestJSON-126649175 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:53:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-adda4dfe-365d-4b1a-b2e9-6971aea3c94d tempest-VolumesTestJSON-126649175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-4b43518f-d492-4c03-9608-a631bb7a732d 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:53:12 devstack sudo[84479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-4b43518f-d492-4c03-9608-a631bb7a732d 1073741824
Apr 15 15:53:12 devstack sudo[84479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:53:13 devstack sudo[84479]: pam_unix(sudo:session): session closed for user root
Apr 15 15:53:13 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-adda4dfe-365d-4b1a-b2e9-6971aea3c94d tempest-VolumesTestJSON-126649175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-4b43518f-d492-4c03-9608-a631bb7a732d 1073741824" returned: 0 in 0.781s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:53:13 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-adda4dfe-365d-4b1a-b2e9-6971aea3c94d tempest-VolumesTestJSON-126649175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-4b43518f-d492-4c03-9608-a631bb7a732d {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:53:13 devstack sudo[84485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-4b43518f-d492-4c03-9608-a631bb7a732d
Apr 15 15:53:13 devstack sudo[84485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:53:13 devstack sudo[84485]: pam_unix(sudo:session): session closed for user root
Apr 15 15:53:13 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-adda4dfe-365d-4b1a-b2e9-6971aea3c94d tempest-VolumesTestJSON-126649175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-4b43518f-d492-4c03-9608-a631bb7a732d" returned: 0 in 0.840s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:53:13 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-adda4dfe-365d-4b1a-b2e9-6971aea3c94d tempest-VolumesTestJSON-126649175 None] <== create_volume: return (1661ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:53:13 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-adda4dfe-365d-4b1a-b2e9-6971aea3c94d tempest-VolumesTestJSON-126649175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.664s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:53:14 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-adda4dfe-365d-4b1a-b2e9-6971aea3c94d tempest-VolumesTestJSON-126649175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86df8d3c-b849-4e33-af03-9c64b7a9a13d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b43518f-d492-4c03-9608-a631bb7a732d', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:53:14 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-adda4dfe-365d-4b1a-b2e9-6971aea3c94d tempest-VolumesTestJSON-126649175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4579d39d-3ccf-4403-91bd-b2033401a915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:53:14 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-adda4dfe-365d-4b1a-b2e9-6971aea3c94d tempest-VolumesTestJSON-126649175 None] Volume volume-4b43518f-d492-4c03-9608-a631bb7a732d (4b43518f-d492-4c03-9608-a631bb7a732d): created successfully
Apr 15 15:53:14 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-adda4dfe-365d-4b1a-b2e9-6971aea3c94d tempest-VolumesTestJSON-126649175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4579d39d-3ccf-4403-91bd-b2033401a915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:53:14 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-adda4dfe-365d-4b1a-b2e9-6971aea3c94d tempest-VolumesTestJSON-126649175 None] Flow 'volume_create_manager' (b13caba8-eb97-46fb-a09c-98710bbf86f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:53:14 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-adda4dfe-365d-4b1a-b2e9-6971aea3c94d tempest-VolumesTestJSON-126649175 None] Created volume successfully.
Apr 15 15:53:15 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fe8cc9d-d929-44cb-bd72-b59d4ff1d77f tempest-VolumesTestJSON-126649175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:53:15 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7fe8cc9d-d929-44cb-bd72-b59d4ff1d77f tempest-VolumesTestJSON-126649175 None] Flow 'volume_create_manager' (f548a9cd-7154-48a9-bc32-70e75a0f86c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:53:15 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7fe8cc9d-d929-44cb-bd72-b59d4ff1d77f tempest-VolumesTestJSON-126649175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e13d441-0006-4846-a280-35ee05f1138e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:53:15 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7fe8cc9d-d929-44cb-bd72-b59d4ff1d77f tempest-VolumesTestJSON-126649175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e13d441-0006-4846-a280-35ee05f1138e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:53:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-976155163',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf0aa396-f2c0-4c88-afe6-4cfa136af6fe,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5966803fc7554a8599bc4e32e0b5e6c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:53:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:53:15Z,use_quota=True,user_id='d853cfa0c0f141bdab4b763bd0fe00a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:53:15 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7fe8cc9d-d929-44cb-bd72-b59d4ff1d77f tempest-VolumesTestJSON-126649175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5af0bb01-be96-4428-ad2d-d43e618b757f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:53:15 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7fe8cc9d-d929-44cb-bd72-b59d4ff1d77f tempest-VolumesTestJSON-126649175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5af0bb01-be96-4428-ad2d-d43e618b757f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:53:15 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7fe8cc9d-d929-44cb-bd72-b59d4ff1d77f tempest-VolumesTestJSON-126649175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69021279-0bbd-4a99-aabe-49293ec4b953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:53:15 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7fe8cc9d-d929-44cb-bd72-b59d4ff1d77f tempest-VolumesTestJSON-126649175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69021279-0bbd-4a99-aabe-49293ec4b953) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf0aa396-f2c0-4c88-afe6-4cfa136af6fe', 'volume_name': 'volume-cf0aa396-f2c0-4c88-afe6-4cfa136af6fe', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:53:15 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7fe8cc9d-d929-44cb-bd72-b59d4ff1d77f tempest-VolumesTestJSON-126649175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9959057a-cfd6-48f8-81aa-22acd267a755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:53:15 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7fe8cc9d-d929-44cb-bd72-b59d4ff1d77f tempest-VolumesTestJSON-126649175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9959057a-cfd6-48f8-81aa-22acd267a755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:53:15 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7fe8cc9d-d929-44cb-bd72-b59d4ff1d77f tempest-VolumesTestJSON-126649175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53c4f9bd-d25a-41fe-b3b3-65e722c278e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:53:15 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-7fe8cc9d-d929-44cb-bd72-b59d4ff1d77f tempest-VolumesTestJSON-126649175 None] Volume cf0aa396-f2c0-4c88-afe6-4cfa136af6fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf0aa396-f2c0-4c88-afe6-4cfa136af6fe', 'volume_size': 1}
Apr 15 15:53:15 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7fe8cc9d-d929-44cb-bd72-b59d4ff1d77f tempest-VolumesTestJSON-126649175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:53:15 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7fe8cc9d-d929-44cb-bd72-b59d4ff1d77f tempest-VolumesTestJSON-126649175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:53:15 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-7fe8cc9d-d929-44cb-bd72-b59d4ff1d77f tempest-VolumesTestJSON-126649175 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:53:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-976155163',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf0aa396-f2c0-4c88-afe6-4cfa136af6fe,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5966803fc7554a8599bc4e32e0b5e6c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:53:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:53:15Z,use_quota=True,user_id='d853cfa0c0f141bdab4b763bd0fe00a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:53:15 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-7fe8cc9d-d929-44cb-bd72-b59d4ff1d77f tempest-VolumesTestJSON-126649175 None] Creating volume cf0aa396-f2c0-4c88-afe6-4cfa136af6fe {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:53:15 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7fe8cc9d-d929-44cb-bd72-b59d4ff1d77f tempest-VolumesTestJSON-126649175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:53:15 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7fe8cc9d-d929-44cb-bd72-b59d4ff1d77f tempest-VolumesTestJSON-126649175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:53:15 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-7fe8cc9d-d929-44cb-bd72-b59d4ff1d77f tempest-VolumesTestJSON-126649175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:53:15 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-7fe8cc9d-d929-44cb-bd72-b59d4ff1d77f tempest-VolumesTestJSON-126649175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:53:15 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7fe8cc9d-d929-44cb-bd72-b59d4ff1d77f tempest-VolumesTestJSON-126649175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:53:15 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-7fe8cc9d-d929-44cb-bd72-b59d4ff1d77f tempest-VolumesTestJSON-126649175 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:53:15 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-7fe8cc9d-d929-44cb-bd72-b59d4ff1d77f tempest-VolumesTestJSON-126649175 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:53:15 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7fe8cc9d-d929-44cb-bd72-b59d4ff1d77f tempest-VolumesTestJSON-126649175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cf0aa396-f2c0-4c88-afe6-4cfa136af6fe 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:53:15 devstack sudo[84563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cf0aa396-f2c0-4c88-afe6-4cfa136af6fe 1073741824
Apr 15 15:53:15 devstack sudo[84563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:53:15 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-733ed37c-32eb-4c55-80b7-20c3ca11bf6b tempest-GroupSnapshotsV319Test-1423450155 None] Group tempest-GroupSnapshotsV319Test-Group-1559444362: creating
Apr 15 15:53:15 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-733ed37c-32eb-4c55-80b7-20c3ca11bf6b tempest-GroupSnapshotsV319Test-1423450155 None] Group tempest-GroupSnapshotsV319Test-Group-1559444362: created successfully
Apr 15 15:53:15 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-733ed37c-32eb-4c55-80b7-20c3ca11bf6b tempest-GroupSnapshotsV319Test-1423450155 None] Create group completed successfully.
Apr 15 15:53:16 devstack sudo[84563]: pam_unix(sudo:session): session closed for user root
Apr 15 15:53:16 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7fe8cc9d-d929-44cb-bd72-b59d4ff1d77f tempest-VolumesTestJSON-126649175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cf0aa396-f2c0-4c88-afe6-4cfa136af6fe 1073741824" returned: 0 in 1.389s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:53:16 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7fe8cc9d-d929-44cb-bd72-b59d4ff1d77f tempest-VolumesTestJSON-126649175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cf0aa396-f2c0-4c88-afe6-4cfa136af6fe {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:53:16 devstack sudo[84581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cf0aa396-f2c0-4c88-afe6-4cfa136af6fe
Apr 15 15:53:16 devstack sudo[84581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:53:17 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-98d94f43-ed42-42c5-b1a5-dd0a4385446c tempest-GroupSnapshotsV319Test-1423450155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:53:17 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-98d94f43-ed42-42c5-b1a5-dd0a4385446c tempest-GroupSnapshotsV319Test-1423450155 None] Flow 'volume_create_manager' (1565597a-9b2f-47ea-8b37-eb7508ba1db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:53:17 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-98d94f43-ed42-42c5-b1a5-dd0a4385446c tempest-GroupSnapshotsV319Test-1423450155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afbb612c-5687-4346-b639-bbc5a9aca08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:53:17 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-98d94f43-ed42-42c5-b1a5-dd0a4385446c tempest-GroupSnapshotsV319Test-1423450155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afbb612c-5687-4346-b639-bbc5a9aca08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:53:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-993607999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4018497e-a415-458c-9e56-083b5371e639,host='devstack@QuobyteHD#QuobyteHD',id=6a53e441-1584-4740-ad23-7d876c0a2651,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7138eeabbf2b4a2b9c9cb654eade9ff4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:53:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:53:17Z,use_quota=True,user_id='5e7145e91da24d0392d19485a49fea37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07c934d8-79b5-4977-bae3-4147e3eb5157),volume_type_id=07c934d8-79b5-4977-bae3-4147e3eb5157)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:53:17 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-98d94f43-ed42-42c5-b1a5-dd0a4385446c tempest-GroupSnapshotsV319Test-1423450155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86279c6f-7e35-4025-8913-059bcf692897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:53:17 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-98d94f43-ed42-42c5-b1a5-dd0a4385446c tempest-GroupSnapshotsV319Test-1423450155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86279c6f-7e35-4025-8913-059bcf692897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:53:17 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-98d94f43-ed42-42c5-b1a5-dd0a4385446c tempest-GroupSnapshotsV319Test-1423450155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8aa86fb6-5f15-46a5-b494-9389b627cfa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:53:17 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-98d94f43-ed42-42c5-b1a5-dd0a4385446c tempest-GroupSnapshotsV319Test-1423450155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8aa86fb6-5f15-46a5-b494-9389b627cfa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a53e441-1584-4740-ad23-7d876c0a2651', 'volume_name': 'volume-6a53e441-1584-4740-ad23-7d876c0a2651', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:53:17 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-98d94f43-ed42-42c5-b1a5-dd0a4385446c tempest-GroupSnapshotsV319Test-1423450155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da2a7b3c-fc76-44d0-bad2-b52af6dd57e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:53:17 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-98d94f43-ed42-42c5-b1a5-dd0a4385446c tempest-GroupSnapshotsV319Test-1423450155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da2a7b3c-fc76-44d0-bad2-b52af6dd57e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:53:17 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-98d94f43-ed42-42c5-b1a5-dd0a4385446c tempest-GroupSnapshotsV319Test-1423450155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f93fadc-b7e4-4720-a3c2-f2b69ac158a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:53:17 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-98d94f43-ed42-42c5-b1a5-dd0a4385446c tempest-GroupSnapshotsV319Test-1423450155 None] Volume 6a53e441-1584-4740-ad23-7d876c0a2651: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a53e441-1584-4740-ad23-7d876c0a2651', 'volume_size': 1}
Apr 15 15:53:17 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-98d94f43-ed42-42c5-b1a5-dd0a4385446c tempest-GroupSnapshotsV319Test-1423450155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:53:17 devstack sudo[84581]: pam_unix(sudo:session): session closed for user root
Apr 15 15:53:17 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7fe8cc9d-d929-44cb-bd72-b59d4ff1d77f tempest-VolumesTestJSON-126649175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cf0aa396-f2c0-4c88-afe6-4cfa136af6fe" returned: 0 in 1.154s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:53:17 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-7fe8cc9d-d929-44cb-bd72-b59d4ff1d77f tempest-VolumesTestJSON-126649175 None] <== create_volume: return (2588ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:53:17 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7fe8cc9d-d929-44cb-bd72-b59d4ff1d77f tempest-VolumesTestJSON-126649175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.592s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:53:17 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-98d94f43-ed42-42c5-b1a5-dd0a4385446c tempest-GroupSnapshotsV319Test-1423450155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.644s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:53:18 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-98d94f43-ed42-42c5-b1a5-dd0a4385446c tempest-GroupSnapshotsV319Test-1423450155 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=4018497e-a415-458c-9e56-083b5371e639,created_at=2026-04-15T13:53:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-993607999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4018497e-a415-458c-9e56-083b5371e639,host='devstack@QuobyteHD#QuobyteHD',id=6a53e441-1584-4740-ad23-7d876c0a2651,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7138eeabbf2b4a2b9c9cb654eade9ff4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:53:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:53:17Z,use_quota=True,user_id='5e7145e91da24d0392d19485a49fea37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07c934d8-79b5-4977-bae3-4147e3eb5157),volume_type_id=07c934d8-79b5-4977-bae3-4147e3eb5157)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:53:18 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-98d94f43-ed42-42c5-b1a5-dd0a4385446c tempest-GroupSnapshotsV319Test-1423450155 None] Creating volume 6a53e441-1584-4740-ad23-7d876c0a2651 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:53:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-98d94f43-ed42-42c5-b1a5-dd0a4385446c tempest-GroupSnapshotsV319Test-1423450155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:53:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-98d94f43-ed42-42c5-b1a5-dd0a4385446c tempest-GroupSnapshotsV319Test-1423450155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:53:18 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-98d94f43-ed42-42c5-b1a5-dd0a4385446c tempest-GroupSnapshotsV319Test-1423450155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:53:18 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-98d94f43-ed42-42c5-b1a5-dd0a4385446c tempest-GroupSnapshotsV319Test-1423450155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:53:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-98d94f43-ed42-42c5-b1a5-dd0a4385446c tempest-GroupSnapshotsV319Test-1423450155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:53:18 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-98d94f43-ed42-42c5-b1a5-dd0a4385446c tempest-GroupSnapshotsV319Test-1423450155 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:53:18 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-98d94f43-ed42-42c5-b1a5-dd0a4385446c tempest-GroupSnapshotsV319Test-1423450155 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:53:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-98d94f43-ed42-42c5-b1a5-dd0a4385446c tempest-GroupSnapshotsV319Test-1423450155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6a53e441-1584-4740-ad23-7d876c0a2651 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:53:18 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7fe8cc9d-d929-44cb-bd72-b59d4ff1d77f tempest-VolumesTestJSON-126649175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53c4f9bd-d25a-41fe-b3b3-65e722c278e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf0aa396-f2c0-4c88-afe6-4cfa136af6fe', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:53:18 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7fe8cc9d-d929-44cb-bd72-b59d4ff1d77f tempest-VolumesTestJSON-126649175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (590bad1a-c8a9-4a66-b3a5-ac6d735cf475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:53:18 devstack sudo[84585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6a53e441-1584-4740-ad23-7d876c0a2651 1073741824
Apr 15 15:53:18 devstack sudo[84585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:53:18 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-7fe8cc9d-d929-44cb-bd72-b59d4ff1d77f tempest-VolumesTestJSON-126649175 None] Volume volume-cf0aa396-f2c0-4c88-afe6-4cfa136af6fe (cf0aa396-f2c0-4c88-afe6-4cfa136af6fe): created successfully
Apr 15 15:53:18 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7fe8cc9d-d929-44cb-bd72-b59d4ff1d77f tempest-VolumesTestJSON-126649175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (590bad1a-c8a9-4a66-b3a5-ac6d735cf475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:53:18 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7fe8cc9d-d929-44cb-bd72-b59d4ff1d77f tempest-VolumesTestJSON-126649175 None] Flow 'volume_create_manager' (f548a9cd-7154-48a9-bc32-70e75a0f86c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:53:18 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-7fe8cc9d-d929-44cb-bd72-b59d4ff1d77f tempest-VolumesTestJSON-126649175 None] Created volume successfully.
Apr 15 15:53:18 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-9876efef-9a87-4b2b-a35f-15dd87abd92d tempest-VolumesTestJSON-126649175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:53:18 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9876efef-9a87-4b2b-a35f-15dd87abd92d tempest-VolumesTestJSON-126649175 None] Flow 'volume_create_manager' (1f7efa26-45fd-4e5a-81d3-f85b0eade6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:53:18 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9876efef-9a87-4b2b-a35f-15dd87abd92d tempest-VolumesTestJSON-126649175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (882fe597-55b2-4d2e-8509-59fa1a35127f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:53:18 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9876efef-9a87-4b2b-a35f-15dd87abd92d tempest-VolumesTestJSON-126649175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (882fe597-55b2-4d2e-8509-59fa1a35127f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:53:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1874252235',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6699ec6-da2a-4575-9102-8a925e533762,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5966803fc7554a8599bc4e32e0b5e6c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:53:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:53:19Z,use_quota=True,user_id='d853cfa0c0f141bdab4b763bd0fe00a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:53:18 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9876efef-9a87-4b2b-a35f-15dd87abd92d tempest-VolumesTestJSON-126649175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41bff401-a44f-4c92-9604-bab3ab263332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:53:18 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9876efef-9a87-4b2b-a35f-15dd87abd92d tempest-VolumesTestJSON-126649175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41bff401-a44f-4c92-9604-bab3ab263332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:53:18 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9876efef-9a87-4b2b-a35f-15dd87abd92d tempest-VolumesTestJSON-126649175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afc91e14-acf8-43d8-994b-38b4b8726969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:53:19 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9876efef-9a87-4b2b-a35f-15dd87abd92d tempest-VolumesTestJSON-126649175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afc91e14-acf8-43d8-994b-38b4b8726969) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6699ec6-da2a-4575-9102-8a925e533762', 'volume_name': 'volume-c6699ec6-da2a-4575-9102-8a925e533762', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:53:19 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9876efef-9a87-4b2b-a35f-15dd87abd92d tempest-VolumesTestJSON-126649175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (870cb64a-6da4-410b-a1b8-0f74640ee236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:53:19 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9876efef-9a87-4b2b-a35f-15dd87abd92d tempest-VolumesTestJSON-126649175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (870cb64a-6da4-410b-a1b8-0f74640ee236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:53:19 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9876efef-9a87-4b2b-a35f-15dd87abd92d tempest-VolumesTestJSON-126649175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3ab6a6e-5202-4884-b55b-9e27939caecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:53:19 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-9876efef-9a87-4b2b-a35f-15dd87abd92d tempest-VolumesTestJSON-126649175 None] Volume c6699ec6-da2a-4575-9102-8a925e533762: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6699ec6-da2a-4575-9102-8a925e533762', 'volume_size': 1}
Apr 15 15:53:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-9876efef-9a87-4b2b-a35f-15dd87abd92d tempest-VolumesTestJSON-126649175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:53:19 devstack sudo[84585]: pam_unix(sudo:session): session closed for user root
Apr 15 15:53:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-98d94f43-ed42-42c5-b1a5-dd0a4385446c tempest-GroupSnapshotsV319Test-1423450155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6a53e441-1584-4740-ad23-7d876c0a2651 1073741824" returned: 0 in 1.277s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:53:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-98d94f43-ed42-42c5-b1a5-dd0a4385446c tempest-GroupSnapshotsV319Test-1423450155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6a53e441-1584-4740-ad23-7d876c0a2651 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:53:19 devstack sudo[84611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6a53e441-1584-4740-ad23-7d876c0a2651
Apr 15 15:53:19 devstack sudo[84611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:53:20 devstack sudo[84611]: pam_unix(sudo:session): session closed for user root
Apr 15 15:53:20 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-98d94f43-ed42-42c5-b1a5-dd0a4385446c tempest-GroupSnapshotsV319Test-1423450155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6a53e441-1584-4740-ad23-7d876c0a2651" returned: 0 in 0.965s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:53:20 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-98d94f43-ed42-42c5-b1a5-dd0a4385446c tempest-GroupSnapshotsV319Test-1423450155 None] <== create_volume: return (2308ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:53:20 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-98d94f43-ed42-42c5-b1a5-dd0a4385446c tempest-GroupSnapshotsV319Test-1423450155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.323s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:53:20 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-9876efef-9a87-4b2b-a35f-15dd87abd92d tempest-VolumesTestJSON-126649175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.313s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:53:20 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-9876efef-9a87-4b2b-a35f-15dd87abd92d tempest-VolumesTestJSON-126649175 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:53:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1874252235',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6699ec6-da2a-4575-9102-8a925e533762,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5966803fc7554a8599bc4e32e0b5e6c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:53:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:53:19Z,use_quota=True,user_id='d853cfa0c0f141bdab4b763bd0fe00a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:53:20 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-9876efef-9a87-4b2b-a35f-15dd87abd92d tempest-VolumesTestJSON-126649175 None] Creating volume c6699ec6-da2a-4575-9102-8a925e533762 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:53:20 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-9876efef-9a87-4b2b-a35f-15dd87abd92d tempest-VolumesTestJSON-126649175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:53:20 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-9876efef-9a87-4b2b-a35f-15dd87abd92d tempest-VolumesTestJSON-126649175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:53:20 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-9876efef-9a87-4b2b-a35f-15dd87abd92d tempest-VolumesTestJSON-126649175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:53:20 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-9876efef-9a87-4b2b-a35f-15dd87abd92d tempest-VolumesTestJSON-126649175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:53:20 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-9876efef-9a87-4b2b-a35f-15dd87abd92d tempest-VolumesTestJSON-126649175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:53:20 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-9876efef-9a87-4b2b-a35f-15dd87abd92d tempest-VolumesTestJSON-126649175 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:53:20 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-9876efef-9a87-4b2b-a35f-15dd87abd92d tempest-VolumesTestJSON-126649175 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:53:20 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9876efef-9a87-4b2b-a35f-15dd87abd92d tempest-VolumesTestJSON-126649175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c6699ec6-da2a-4575-9102-8a925e533762 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:53:20 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-98d94f43-ed42-42c5-b1a5-dd0a4385446c tempest-GroupSnapshotsV319Test-1423450155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f93fadc-b7e4-4720-a3c2-f2b69ac158a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a53e441-1584-4740-ad23-7d876c0a2651', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:53:20 devstack sudo[84641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c6699ec6-da2a-4575-9102-8a925e533762 1073741824
Apr 15 15:53:20 devstack sudo[84641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:53:20 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-98d94f43-ed42-42c5-b1a5-dd0a4385446c tempest-GroupSnapshotsV319Test-1423450155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4db7d169-0f27-4d11-ae6d-858269fee908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:53:20 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-98d94f43-ed42-42c5-b1a5-dd0a4385446c tempest-GroupSnapshotsV319Test-1423450155 None] Volume volume-6a53e441-1584-4740-ad23-7d876c0a2651 (6a53e441-1584-4740-ad23-7d876c0a2651): created successfully
Apr 15 15:53:20 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-98d94f43-ed42-42c5-b1a5-dd0a4385446c tempest-GroupSnapshotsV319Test-1423450155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4db7d169-0f27-4d11-ae6d-858269fee908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:53:20 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-98d94f43-ed42-42c5-b1a5-dd0a4385446c tempest-GroupSnapshotsV319Test-1423450155 None] Flow 'volume_create_manager' (1565597a-9b2f-47ea-8b37-eb7508ba1db9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:53:20 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-98d94f43-ed42-42c5-b1a5-dd0a4385446c tempest-GroupSnapshotsV319Test-1423450155 None] Created volume successfully.
Apr 15 15:53:21 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-aa8f3028-2fc7-4504-8f5a-f9191ea75783 tempest-GroupSnapshotsV319Test-1423450155 None] GroupSnapshot c794b662-b4f6-4568-b2a7-d504d098fd8a: creating.
Apr 15 15:53:21 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-aa8f3028-2fc7-4504-8f5a-f9191ea75783 tempest-GroupSnapshotsV319Test-1423450155 None] Group snapshot c794b662-b4f6-4568-b2a7-d504d098fd8a: creating. {{(pid=82485) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 15 15:53:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-aa8f3028-2fc7-4504-8f5a-f9191ea75783 tempest-GroupSnapshotsV319Test-1423450155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:53:21 devstack sudo[84641]: pam_unix(sudo:session): session closed for user root
Apr 15 15:53:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9876efef-9a87-4b2b-a35f-15dd87abd92d tempest-VolumesTestJSON-126649175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c6699ec6-da2a-4575-9102-8a925e533762 1073741824" returned: 0 in 0.960s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:53:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9876efef-9a87-4b2b-a35f-15dd87abd92d tempest-VolumesTestJSON-126649175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c6699ec6-da2a-4575-9102-8a925e533762 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:53:21 devstack sudo[84651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c6699ec6-da2a-4575-9102-8a925e533762
Apr 15 15:53:21 devstack sudo[84651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:53:21 devstack sudo[84651]: pam_unix(sudo:session): session closed for user root
Apr 15 15:53:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9876efef-9a87-4b2b-a35f-15dd87abd92d tempest-VolumesTestJSON-126649175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c6699ec6-da2a-4575-9102-8a925e533762" returned: 0 in 0.466s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:53:21 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-9876efef-9a87-4b2b-a35f-15dd87abd92d tempest-VolumesTestJSON-126649175 None] <== create_volume: return (1476ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:53:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-9876efef-9a87-4b2b-a35f-15dd87abd92d tempest-VolumesTestJSON-126649175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.485s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:53:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-aa8f3028-2fc7-4504-8f5a-f9191ea75783 tempest-GroupSnapshotsV319Test-1423450155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.692s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:53:21 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9876efef-9a87-4b2b-a35f-15dd87abd92d tempest-VolumesTestJSON-126649175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3ab6a6e-5202-4884-b55b-9e27939caecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6699ec6-da2a-4575-9102-8a925e533762', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:53:21 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9876efef-9a87-4b2b-a35f-15dd87abd92d tempest-VolumesTestJSON-126649175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f333fe6-ec05-4ee6-b7d4-beacfd5c854d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:53:21 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-aa8f3028-2fc7-4504-8f5a-f9191ea75783 tempest-GroupSnapshotsV319Test-1423450155 None] Creating offline snapshot 0979a764-1f80-4174-9415-7fde435f15f9 of volume 6a53e441-1584-4740-ad23-7d876c0a2651 {{(pid=82485) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 15:53:21 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-9876efef-9a87-4b2b-a35f-15dd87abd92d tempest-VolumesTestJSON-126649175 None] Volume volume-c6699ec6-da2a-4575-9102-8a925e533762 (c6699ec6-da2a-4575-9102-8a925e533762): created successfully
Apr 15 15:53:21 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9876efef-9a87-4b2b-a35f-15dd87abd92d tempest-VolumesTestJSON-126649175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f333fe6-ec05-4ee6-b7d4-beacfd5c854d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:53:21 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9876efef-9a87-4b2b-a35f-15dd87abd92d tempest-VolumesTestJSON-126649175 None] Flow 'volume_create_manager' (1f7efa26-45fd-4e5a-81d3-f85b0eade6e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:53:21 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[0acbf2dc-3009-4a52-a1f7-7ac5e33aa65c]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:53:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-aa8f3028-2fc7-4504-8f5a-f9191ea75783 tempest-GroupSnapshotsV319Test-1423450155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6a53e441-1584-4740-ad23-7d876c0a2651 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:53:21 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-9876efef-9a87-4b2b-a35f-15dd87abd92d tempest-VolumesTestJSON-126649175 None] Created volume successfully.
Apr 15 15:53:22 devstack sudo[84656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6a53e441-1584-4740-ad23-7d876c0a2651
Apr 15 15:53:22 devstack sudo[84656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:53:22 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-c3dd005f-bd28-49e5-9cab-8dec5201a0d6 tempest-ServerRescueNegativeTestJSON-809130254 None] Acquiring lock "cinder-d0e5eb91-50ac-4134-8026-055c4997c2e2-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:53:22 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-c3dd005f-bd28-49e5-9cab-8dec5201a0d6 tempest-ServerRescueNegativeTestJSON-809130254 None] Lock "cinder-d0e5eb91-50ac-4134-8026-055c4997c2e2-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:53:22 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-c3dd005f-bd28-49e5-9cab-8dec5201a0d6 tempest-ServerRescueNegativeTestJSON-809130254 None] Acquiring lock "cinder-quobyte-d0e5eb91-50ac-4134-8026-055c4997c2e2" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:53:22 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-c3dd005f-bd28-49e5-9cab-8dec5201a0d6 tempest-ServerRescueNegativeTestJSON-809130254 None] Lock "cinder-quobyte-d0e5eb91-50ac-4134-8026-055c4997c2e2" acquired by "delete_volume" :: waited 0.026s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:53:22 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3494e3f-8c7e-4c71-ad68-ec11412999b6]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:53:22 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-c3dd005f-bd28-49e5-9cab-8dec5201a0d6 tempest-ServerRescueNegativeTestJSON-809130254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-d0e5eb91-50ac-4134-8026-055c4997c2e2 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:53:22 devstack sudo[84663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-d0e5eb91-50ac-4134-8026-055c4997c2e2
Apr 15 15:53:22 devstack sudo[84663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:53:22 devstack sudo[84656]: pam_unix(sudo:session): session closed for user root
Apr 15 15:53:22 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-aa8f3028-2fc7-4504-8f5a-f9191ea75783 tempest-GroupSnapshotsV319Test-1423450155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6a53e441-1584-4740-ad23-7d876c0a2651" returned: 0 in 1.077s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:53:23 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-aa8f3028-2fc7-4504-8f5a-f9191ea75783 tempest-GroupSnapshotsV319Test-1423450155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6a53e441-1584-4740-ad23-7d876c0a2651,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6a53e441-1584-4740-ad23-7d876c0a2651.0979a764-1f80-4174-9415-7fde435f15f9 1G {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:53:23 devstack sudo[84668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6a53e441-1584-4740-ad23-7d876c0a2651,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6a53e441-1584-4740-ad23-7d876c0a2651.0979a764-1f80-4174-9415-7fde435f15f9 1G
Apr 15 15:53:23 devstack sudo[84668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:53:23 devstack sudo[84663]: pam_unix(sudo:session): session closed for user root
Apr 15 15:53:23 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-c3dd005f-bd28-49e5-9cab-8dec5201a0d6 tempest-ServerRescueNegativeTestJSON-809130254 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-d0e5eb91-50ac-4134-8026-055c4997c2e2" returned: 0 in 0.830s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:53:23 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-c3dd005f-bd28-49e5-9cab-8dec5201a0d6 tempest-ServerRescueNegativeTestJSON-809130254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-d0e5eb91-50ac-4134-8026-055c4997c2e2 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:53:23 devstack sudo[84673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-d0e5eb91-50ac-4134-8026-055c4997c2e2
Apr 15 15:53:23 devstack sudo[84673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:53:23 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-5383fc49-33f0-4bf1-a5cd-6e70aad22e0c tempest-VolumesTestJSON-126649175 None] Acquiring lock "cinder-c6699ec6-da2a-4575-9102-8a925e533762-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:53:23 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-5383fc49-33f0-4bf1-a5cd-6e70aad22e0c tempest-VolumesTestJSON-126649175 None] Lock "cinder-c6699ec6-da2a-4575-9102-8a925e533762-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:53:23 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-5383fc49-33f0-4bf1-a5cd-6e70aad22e0c tempest-VolumesTestJSON-126649175 None] Acquiring lock "cinder-quobyte-c6699ec6-da2a-4575-9102-8a925e533762" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:53:23 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-5383fc49-33f0-4bf1-a5cd-6e70aad22e0c tempest-VolumesTestJSON-126649175 None] Lock "cinder-quobyte-c6699ec6-da2a-4575-9102-8a925e533762" acquired by "delete_volume" :: waited 0.036s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:53:24 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b73d6d-49a1-4e95-bf5d-ed9f6a3b77cc]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:53:24 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-5383fc49-33f0-4bf1-a5cd-6e70aad22e0c tempest-VolumesTestJSON-126649175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c6699ec6-da2a-4575-9102-8a925e533762 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:53:24 devstack sudo[84673]: pam_unix(sudo:session): session closed for user root
Apr 15 15:53:24 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-c3dd005f-bd28-49e5-9cab-8dec5201a0d6 tempest-ServerRescueNegativeTestJSON-809130254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-d0e5eb91-50ac-4134-8026-055c4997c2e2" returned: 0 in 0.680s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:53:24 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-c3dd005f-bd28-49e5-9cab-8dec5201a0d6 tempest-ServerRescueNegativeTestJSON-809130254 None] Lock "cinder-quobyte-d0e5eb91-50ac-4134-8026-055c4997c2e2" released by "delete_volume" :: held 1.579s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:53:24 devstack sudo[84682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c6699ec6-da2a-4575-9102-8a925e533762
Apr 15 15:53:24 devstack sudo[84682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:53:24 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-c3dd005f-bd28-49e5-9cab-8dec5201a0d6 tempest-ServerRescueNegativeTestJSON-809130254 None] Created reservations ['e196dd5b-7e4c-43de-bb92-b084e396f885', 'e96fe46f-9a59-4c14-bc90-51a246a4d1b1', '98f159b3-7f8f-45bc-8c34-210bbb9796f8', '5bced93f-75b1-496e-adda-a815310e15e9'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:53:24 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-c3dd005f-bd28-49e5-9cab-8dec5201a0d6 tempest-ServerRescueNegativeTestJSON-809130254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:53:24 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-c3dd005f-bd28-49e5-9cab-8dec5201a0d6 tempest-ServerRescueNegativeTestJSON-809130254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:53:24 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-c3dd005f-bd28-49e5-9cab-8dec5201a0d6 tempest-ServerRescueNegativeTestJSON-809130254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:53:24 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-c3dd005f-bd28-49e5-9cab-8dec5201a0d6 tempest-ServerRescueNegativeTestJSON-809130254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:53:24 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-c3dd005f-bd28-49e5-9cab-8dec5201a0d6 tempest-ServerRescueNegativeTestJSON-809130254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:53:24 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-c3dd005f-bd28-49e5-9cab-8dec5201a0d6 tempest-ServerRescueNegativeTestJSON-809130254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:53:24 devstack sudo[84687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:53:24 devstack sudo[84687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:53:24 devstack sudo[84668]: pam_unix(sudo:session): session closed for user root
Apr 15 15:53:24 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-aa8f3028-2fc7-4504-8f5a-f9191ea75783 tempest-GroupSnapshotsV319Test-1423450155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6a53e441-1584-4740-ad23-7d876c0a2651,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6a53e441-1584-4740-ad23-7d876c0a2651.0979a764-1f80-4174-9415-7fde435f15f9 1G" returned: 0 in 1.494s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:53:24 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-aa8f3028-2fc7-4504-8f5a-f9191ea75783 tempest-GroupSnapshotsV319Test-1423450155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a53e441-1584-4740-ad23-7d876c0a2651 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6a53e441-1584-4740-ad23-7d876c0a2651.0979a764-1f80-4174-9415-7fde435f15f9 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:53:24 devstack sudo[84693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a53e441-1584-4740-ad23-7d876c0a2651 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6a53e441-1584-4740-ad23-7d876c0a2651.0979a764-1f80-4174-9415-7fde435f15f9
Apr 15 15:53:24 devstack sudo[84693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:53:25 devstack sudo[84682]: pam_unix(sudo:session): session closed for user root
Apr 15 15:53:25 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-5383fc49-33f0-4bf1-a5cd-6e70aad22e0c tempest-VolumesTestJSON-126649175 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c6699ec6-da2a-4575-9102-8a925e533762" returned: 0 in 1.226s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:53:25 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-5383fc49-33f0-4bf1-a5cd-6e70aad22e0c tempest-VolumesTestJSON-126649175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c6699ec6-da2a-4575-9102-8a925e533762 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:53:25 devstack sudo[84687]: pam_unix(sudo:session): session closed for user root
Apr 15 15:53:25 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-c3dd005f-bd28-49e5-9cab-8dec5201a0d6 tempest-ServerRescueNegativeTestJSON-809130254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 1.005s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:53:25 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-c3dd005f-bd28-49e5-9cab-8dec5201a0d6 tempest-ServerRescueNegativeTestJSON-809130254 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:53:25 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-c3dd005f-bd28-49e5-9cab-8dec5201a0d6 tempest-ServerRescueNegativeTestJSON-809130254 None] Deleted volume successfully.
Apr 15 15:53:25 devstack sudo[84716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c6699ec6-da2a-4575-9102-8a925e533762
Apr 15 15:53:25 devstack sudo[84716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:53:25 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-c3dd005f-bd28-49e5-9cab-8dec5201a0d6 tempest-ServerRescueNegativeTestJSON-809130254 None] Lock "cinder-d0e5eb91-50ac-4134-8026-055c4997c2e2-delete_volume" released by "delete_volume" :: held 2.955s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:53:25 devstack sudo[84693]: pam_unix(sudo:session): session closed for user root
Apr 15 15:53:25 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-aa8f3028-2fc7-4504-8f5a-f9191ea75783 tempest-GroupSnapshotsV319Test-1423450155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a53e441-1584-4740-ad23-7d876c0a2651 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6a53e441-1584-4740-ad23-7d876c0a2651.0979a764-1f80-4174-9415-7fde435f15f9" returned: 0 in 1.223s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:53:25 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-aa8f3028-2fc7-4504-8f5a-f9191ea75783 tempest-GroupSnapshotsV319Test-1423450155 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6a53e441-1584-4740-ad23-7d876c0a2651.0979a764-1f80-4174-9415-7fde435f15f9 is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 15:53:25 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-aa8f3028-2fc7-4504-8f5a-f9191ea75783 tempest-GroupSnapshotsV319Test-1423450155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6a53e441-1584-4740-ad23-7d876c0a2651.0979a764-1f80-4174-9415-7fde435f15f9 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:53:25 devstack sudo[84723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6a53e441-1584-4740-ad23-7d876c0a2651.0979a764-1f80-4174-9415-7fde435f15f9
Apr 15 15:53:25 devstack sudo[84723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:53:25 devstack sudo[84716]: pam_unix(sudo:session): session closed for user root
Apr 15 15:53:25 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-5383fc49-33f0-4bf1-a5cd-6e70aad22e0c tempest-VolumesTestJSON-126649175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c6699ec6-da2a-4575-9102-8a925e533762" returned: 0 in 0.631s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:53:25 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-5383fc49-33f0-4bf1-a5cd-6e70aad22e0c tempest-VolumesTestJSON-126649175 None] Lock "cinder-quobyte-c6699ec6-da2a-4575-9102-8a925e533762" released by "delete_volume" :: held 1.948s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:53:25 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-5383fc49-33f0-4bf1-a5cd-6e70aad22e0c tempest-VolumesTestJSON-126649175 None] Created reservations ['e611df28-20d1-4b02-b3e9-e5a880a24555', '400fb211-b9f0-43ab-96d1-b41305a82800', '3811cb27-0e1a-403e-b396-a9f68a4e6483', 'd3c6ed77-1140-4a50-bf0c-502108bdfdda'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:53:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-5383fc49-33f0-4bf1-a5cd-6e70aad22e0c tempest-VolumesTestJSON-126649175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:53:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-5383fc49-33f0-4bf1-a5cd-6e70aad22e0c tempest-VolumesTestJSON-126649175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:53:26 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-5383fc49-33f0-4bf1-a5cd-6e70aad22e0c tempest-VolumesTestJSON-126649175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:53:26 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-5383fc49-33f0-4bf1-a5cd-6e70aad22e0c tempest-VolumesTestJSON-126649175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:53:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-5383fc49-33f0-4bf1-a5cd-6e70aad22e0c tempest-VolumesTestJSON-126649175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:53:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-5383fc49-33f0-4bf1-a5cd-6e70aad22e0c tempest-VolumesTestJSON-126649175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:53:26 devstack sudo[84747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:53:26 devstack sudo[84747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:53:26 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-b2dd9f7b-a1dc-42cd-82b6-fd3fd871d09d tempest-VolumesTestJSON-126649175 None] Acquiring lock "cinder-cf0aa396-f2c0-4c88-afe6-4cfa136af6fe-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:53:26 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-b2dd9f7b-a1dc-42cd-82b6-fd3fd871d09d tempest-VolumesTestJSON-126649175 None] Lock "cinder-cf0aa396-f2c0-4c88-afe6-4cfa136af6fe-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:53:26 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-b2dd9f7b-a1dc-42cd-82b6-fd3fd871d09d tempest-VolumesTestJSON-126649175 None] Acquiring lock "cinder-quobyte-cf0aa396-f2c0-4c88-afe6-4cfa136af6fe" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:53:26 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-b2dd9f7b-a1dc-42cd-82b6-fd3fd871d09d tempest-VolumesTestJSON-126649175 None] Lock "cinder-quobyte-cf0aa396-f2c0-4c88-afe6-4cfa136af6fe" acquired by "delete_volume" :: waited 0.016s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:53:26 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[577acd69-f052-4fd2-a5b0-91fe706cff16]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:53:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b2dd9f7b-a1dc-42cd-82b6-fd3fd871d09d tempest-VolumesTestJSON-126649175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cf0aa396-f2c0-4c88-afe6-4cfa136af6fe {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:53:26 devstack sudo[84754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cf0aa396-f2c0-4c88-afe6-4cfa136af6fe
Apr 15 15:53:26 devstack sudo[84754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:53:26 devstack sudo[84723]: pam_unix(sudo:session): session closed for user root
Apr 15 15:53:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-aa8f3028-2fc7-4504-8f5a-f9191ea75783 tempest-GroupSnapshotsV319Test-1423450155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6a53e441-1584-4740-ad23-7d876c0a2651.0979a764-1f80-4174-9415-7fde435f15f9" returned: 0 in 1.180s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:53:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-aa8f3028-2fc7-4504-8f5a-f9191ea75783 tempest-GroupSnapshotsV319Test-1423450155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6a53e441-1584-4740-ad23-7d876c0a2651.info {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:53:26 devstack sudo[84756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6a53e441-1584-4740-ad23-7d876c0a2651.info
Apr 15 15:53:26 devstack sudo[84756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:53:27 devstack sudo[84747]: pam_unix(sudo:session): session closed for user root
Apr 15 15:53:27 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-5383fc49-33f0-4bf1-a5cd-6e70aad22e0c tempest-VolumesTestJSON-126649175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 1.789s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:53:27 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-5383fc49-33f0-4bf1-a5cd-6e70aad22e0c tempest-VolumesTestJSON-126649175 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:53:27 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-5383fc49-33f0-4bf1-a5cd-6e70aad22e0c tempest-VolumesTestJSON-126649175 None] Deleted volume successfully.
Apr 15 15:53:27 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-5383fc49-33f0-4bf1-a5cd-6e70aad22e0c tempest-VolumesTestJSON-126649175 None] Lock "cinder-c6699ec6-da2a-4575-9102-8a925e533762-delete_volume" released by "delete_volume" :: held 4.076s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:53:28 devstack sudo[84754]: pam_unix(sudo:session): session closed for user root
Apr 15 15:53:28 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b2dd9f7b-a1dc-42cd-82b6-fd3fd871d09d tempest-VolumesTestJSON-126649175 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cf0aa396-f2c0-4c88-afe6-4cfa136af6fe" returned: 0 in 1.855s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:53:28 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b2dd9f7b-a1dc-42cd-82b6-fd3fd871d09d tempest-VolumesTestJSON-126649175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cf0aa396-f2c0-4c88-afe6-4cfa136af6fe {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:53:28 devstack sudo[84767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cf0aa396-f2c0-4c88-afe6-4cfa136af6fe
Apr 15 15:53:28 devstack sudo[84767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:53:28 devstack sudo[84756]: pam_unix(sudo:session): session closed for user root
Apr 15 15:53:28 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-aa8f3028-2fc7-4504-8f5a-f9191ea75783 tempest-GroupSnapshotsV319Test-1423450155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6a53e441-1584-4740-ad23-7d876c0a2651.info" returned: 0 in 1.556s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:53:28 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-aa8f3028-2fc7-4504-8f5a-f9191ea75783 tempest-GroupSnapshotsV319Test-1423450155 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6a53e441-1584-4740-ad23-7d876c0a2651.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 15:53:28 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-aa8f3028-2fc7-4504-8f5a-f9191ea75783 tempest-GroupSnapshotsV319Test-1423450155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6a53e441-1584-4740-ad23-7d876c0a2651.info {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:53:28 devstack sudo[84770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6a53e441-1584-4740-ad23-7d876c0a2651.info
Apr 15 15:53:28 devstack sudo[84770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:53:29 devstack sudo[84767]: pam_unix(sudo:session): session closed for user root
Apr 15 15:53:29 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b2dd9f7b-a1dc-42cd-82b6-fd3fd871d09d tempest-VolumesTestJSON-126649175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cf0aa396-f2c0-4c88-afe6-4cfa136af6fe" returned: 0 in 0.648s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:53:29 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-b2dd9f7b-a1dc-42cd-82b6-fd3fd871d09d tempest-VolumesTestJSON-126649175 None] Lock "cinder-quobyte-cf0aa396-f2c0-4c88-afe6-4cfa136af6fe" released by "delete_volume" :: held 2.595s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:53:29 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-b2dd9f7b-a1dc-42cd-82b6-fd3fd871d09d tempest-VolumesTestJSON-126649175 None] Created reservations ['00812b3c-822b-4767-b50e-69ac43c983f5', '71de7b38-2aeb-4729-a84d-f0074f1a4887', '9a4b597a-2a48-48b7-9076-03120b1b16ed', 'e75a4a67-d35e-4307-98a2-7a066c890677'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:53:29 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-b2dd9f7b-a1dc-42cd-82b6-fd3fd871d09d tempest-VolumesTestJSON-126649175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:53:29 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-b2dd9f7b-a1dc-42cd-82b6-fd3fd871d09d tempest-VolumesTestJSON-126649175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:53:29 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-b2dd9f7b-a1dc-42cd-82b6-fd3fd871d09d tempest-VolumesTestJSON-126649175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:53:29 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-b2dd9f7b-a1dc-42cd-82b6-fd3fd871d09d tempest-VolumesTestJSON-126649175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:53:29 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-b2dd9f7b-a1dc-42cd-82b6-fd3fd871d09d tempest-VolumesTestJSON-126649175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:53:29 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b2dd9f7b-a1dc-42cd-82b6-fd3fd871d09d tempest-VolumesTestJSON-126649175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:53:29 devstack sudo[84774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:53:29 devstack sudo[84774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:53:29 devstack sudo[84770]: pam_unix(sudo:session): session closed for user root
Apr 15 15:53:29 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-aa8f3028-2fc7-4504-8f5a-f9191ea75783 tempest-GroupSnapshotsV319Test-1423450155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6a53e441-1584-4740-ad23-7d876c0a2651.info" returned: 0 in 0.670s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:53:29 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-aa8f3028-2fc7-4504-8f5a-f9191ea75783 tempest-GroupSnapshotsV319Test-1423450155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.344s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:53:29 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-aa8f3028-2fc7-4504-8f5a-f9191ea75783 tempest-GroupSnapshotsV319Test-1423450155 None] group_snapshot c794b662-b4f6-4568-b2a7-d504d098fd8a: created successfully
Apr 15 15:53:29 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-19f1159c-d58d-4027-bf5f-dc0f479b1e7e tempest-VolumesTestJSON-126649175 None] Acquiring lock "cinder-4b43518f-d492-4c03-9608-a631bb7a732d-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:53:29 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-19f1159c-d58d-4027-bf5f-dc0f479b1e7e tempest-VolumesTestJSON-126649175 None] Lock "cinder-4b43518f-d492-4c03-9608-a631bb7a732d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:53:29 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-19f1159c-d58d-4027-bf5f-dc0f479b1e7e tempest-VolumesTestJSON-126649175 None] Acquiring lock "cinder-quobyte-4b43518f-d492-4c03-9608-a631bb7a732d" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:53:29 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-19f1159c-d58d-4027-bf5f-dc0f479b1e7e tempest-VolumesTestJSON-126649175 None] Lock "cinder-quobyte-4b43518f-d492-4c03-9608-a631bb7a732d" acquired by "delete_volume" :: waited 0.043s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:53:30 devstack sudo[84774]: pam_unix(sudo:session): session closed for user root
Apr 15 15:53:30 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c10640-14ad-4c9e-b88e-f7b008b3ba50]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:53:30 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-19f1159c-d58d-4027-bf5f-dc0f479b1e7e tempest-VolumesTestJSON-126649175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-4b43518f-d492-4c03-9608-a631bb7a732d {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:53:30 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b2dd9f7b-a1dc-42cd-82b6-fd3fd871d09d tempest-VolumesTestJSON-126649175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.903s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:53:30 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-b2dd9f7b-a1dc-42cd-82b6-fd3fd871d09d tempest-VolumesTestJSON-126649175 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:53:30 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-b2dd9f7b-a1dc-42cd-82b6-fd3fd871d09d tempest-VolumesTestJSON-126649175 None] Deleted volume successfully.
Apr 15 15:53:30 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-b2dd9f7b-a1dc-42cd-82b6-fd3fd871d09d tempest-VolumesTestJSON-126649175 None] Lock "cinder-cf0aa396-f2c0-4c88-afe6-4cfa136af6fe-delete_volume" released by "delete_volume" :: held 3.714s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:53:30 devstack sudo[84777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-4b43518f-d492-4c03-9608-a631bb7a732d
Apr 15 15:53:30 devstack sudo[84777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:53:30 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-8a4afab1-6b34-4830-832a-76f26a347cd2 tempest-GroupSnapshotsV319Test-1423450155 None] group_snapshot c794b662-b4f6-4568-b2a7-d504d098fd8a: deleting
Apr 15 15:53:30 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-8a4afab1-6b34-4830-832a-76f26a347cd2 tempest-GroupSnapshotsV319Test-1423450155 None] group_snapshot c794b662-b4f6-4568-b2a7-d504d098fd8a: deleting {{(pid=82485) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 15 15:53:30 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-8a4afab1-6b34-4830-832a-76f26a347cd2 tempest-GroupSnapshotsV319Test-1423450155 None] Acquiring lock "cinder-quobyte-6a53e441-1584-4740-ad23-7d876c0a2651" by "delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:53:30 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-8a4afab1-6b34-4830-832a-76f26a347cd2 tempest-GroupSnapshotsV319Test-1423450155 None] Lock "cinder-quobyte-6a53e441-1584-4740-ad23-7d876c0a2651" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:53:30 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-8a4afab1-6b34-4830-832a-76f26a347cd2 tempest-GroupSnapshotsV319Test-1423450155 None] Acquiring lock "cinder-quobyte-0979a764-1f80-4174-9415-7fde435f15f9" by "_delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:53:30 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-8a4afab1-6b34-4830-832a-76f26a347cd2 tempest-GroupSnapshotsV319Test-1423450155 None] Lock "cinder-quobyte-0979a764-1f80-4174-9415-7fde435f15f9" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:53:30 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-8a4afab1-6b34-4830-832a-76f26a347cd2 tempest-GroupSnapshotsV319Test-1423450155 None] Deleting offline snapshot 0979a764-1f80-4174-9415-7fde435f15f9 of volume 6a53e441-1584-4740-ad23-7d876c0a2651 {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 15:53:30 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-8a4afab1-6b34-4830-832a-76f26a347cd2 tempest-GroupSnapshotsV319Test-1423450155 None] snapshot_file for this snap is: volume-6a53e441-1584-4740-ad23-7d876c0a2651.0979a764-1f80-4174-9415-7fde435f15f9 {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 15:53:30 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c0618a-8f5c-44ca-b6ed-864f37441ff4]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:53:30 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-8a4afab1-6b34-4830-832a-76f26a347cd2 tempest-GroupSnapshotsV319Test-1423450155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6a53e441-1584-4740-ad23-7d876c0a2651.0979a764-1f80-4174-9415-7fde435f15f9 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:53:30 devstack sudo[84779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6a53e441-1584-4740-ad23-7d876c0a2651.0979a764-1f80-4174-9415-7fde435f15f9
Apr 15 15:53:30 devstack sudo[84779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:53:30 devstack sudo[84777]: pam_unix(sudo:session): session closed for user root
Apr 15 15:53:30 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-19f1159c-d58d-4027-bf5f-dc0f479b1e7e tempest-VolumesTestJSON-126649175 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-4b43518f-d492-4c03-9608-a631bb7a732d" returned: 0 in 0.809s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:53:30 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-19f1159c-d58d-4027-bf5f-dc0f479b1e7e tempest-VolumesTestJSON-126649175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-4b43518f-d492-4c03-9608-a631bb7a732d {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:53:30 devstack sudo[84784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-4b43518f-d492-4c03-9608-a631bb7a732d
Apr 15 15:53:30 devstack sudo[84784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:53:31 devstack sudo[84779]: pam_unix(sudo:session): session closed for user root
Apr 15 15:53:31 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-8a4afab1-6b34-4830-832a-76f26a347cd2 tempest-GroupSnapshotsV319Test-1423450155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6a53e441-1584-4740-ad23-7d876c0a2651.0979a764-1f80-4174-9415-7fde435f15f9" returned: 0 in 0.862s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:53:31 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-8a4afab1-6b34-4830-832a-76f26a347cd2 tempest-GroupSnapshotsV319Test-1423450155 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a53e441-1584-4740-ad23-7d876c0a2651(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82485) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 15:53:31 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b3ed6b-6b2a-4b45-9a97-520cee81649a]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:53:31 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-8a4afab1-6b34-4830-832a-76f26a347cd2 tempest-GroupSnapshotsV319Test-1423450155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6a53e441-1584-4740-ad23-7d876c0a2651 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:53:31 devstack sudo[84789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6a53e441-1584-4740-ad23-7d876c0a2651
Apr 15 15:53:31 devstack sudo[84789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:53:31 devstack sudo[84784]: pam_unix(sudo:session): session closed for user root
Apr 15 15:53:31 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-19f1159c-d58d-4027-bf5f-dc0f479b1e7e tempest-VolumesTestJSON-126649175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-4b43518f-d492-4c03-9608-a631bb7a732d" returned: 0 in 0.755s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:53:31 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-19f1159c-d58d-4027-bf5f-dc0f479b1e7e tempest-VolumesTestJSON-126649175 None] Lock "cinder-quobyte-4b43518f-d492-4c03-9608-a631bb7a732d" released by "delete_volume" :: held 1.642s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:53:31 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-19f1159c-d58d-4027-bf5f-dc0f479b1e7e tempest-VolumesTestJSON-126649175 None] Created reservations ['72c5f829-0927-4b10-b769-75209675653d', 'fb00ebd3-7c3b-4c98-af0c-d3b885b4fb0b', '571578ce-4f7f-4b04-a509-b3cb62287da4', '04cfd3ee-baec-46cb-b648-37895df6faae'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:53:31 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-19f1159c-d58d-4027-bf5f-dc0f479b1e7e tempest-VolumesTestJSON-126649175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:53:31 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-19f1159c-d58d-4027-bf5f-dc0f479b1e7e tempest-VolumesTestJSON-126649175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:53:31 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-19f1159c-d58d-4027-bf5f-dc0f479b1e7e tempest-VolumesTestJSON-126649175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:53:31 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-19f1159c-d58d-4027-bf5f-dc0f479b1e7e tempest-VolumesTestJSON-126649175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:53:31 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-19f1159c-d58d-4027-bf5f-dc0f479b1e7e tempest-VolumesTestJSON-126649175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:53:31 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-19f1159c-d58d-4027-bf5f-dc0f479b1e7e tempest-VolumesTestJSON-126649175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:53:31 devstack sudo[84799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:53:31 devstack sudo[84799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:53:32 devstack sudo[84789]: pam_unix(sudo:session): session closed for user root
Apr 15 15:53:32 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-8a4afab1-6b34-4830-832a-76f26a347cd2 tempest-GroupSnapshotsV319Test-1423450155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6a53e441-1584-4740-ad23-7d876c0a2651" returned: 0 in 0.842s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:53:32 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-8a4afab1-6b34-4830-832a-76f26a347cd2 tempest-GroupSnapshotsV319Test-1423450155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6a53e441-1584-4740-ad23-7d876c0a2651.0979a764-1f80-4174-9415-7fde435f15f9 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:53:32 devstack sudo[84801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6a53e441-1584-4740-ad23-7d876c0a2651.0979a764-1f80-4174-9415-7fde435f15f9
Apr 15 15:53:32 devstack sudo[84801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:53:32 devstack sudo[84799]: pam_unix(sudo:session): session closed for user root
Apr 15 15:53:32 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-19f1159c-d58d-4027-bf5f-dc0f479b1e7e tempest-VolumesTestJSON-126649175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.921s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:53:32 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-19f1159c-d58d-4027-bf5f-dc0f479b1e7e tempest-VolumesTestJSON-126649175 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:53:32 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-19f1159c-d58d-4027-bf5f-dc0f479b1e7e tempest-VolumesTestJSON-126649175 None] Deleted volume successfully.
Apr 15 15:53:32 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-19f1159c-d58d-4027-bf5f-dc0f479b1e7e tempest-VolumesTestJSON-126649175 None] Lock "cinder-4b43518f-d492-4c03-9608-a631bb7a732d-delete_volume" released by "delete_volume" :: held 2.960s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:53:32 devstack sudo[84801]: pam_unix(sudo:session): session closed for user root
Apr 15 15:53:32 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-8a4afab1-6b34-4830-832a-76f26a347cd2 tempest-GroupSnapshotsV319Test-1423450155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6a53e441-1584-4740-ad23-7d876c0a2651.0979a764-1f80-4174-9415-7fde435f15f9" returned: 0 in 0.843s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:53:32 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-8a4afab1-6b34-4830-832a-76f26a347cd2 tempest-GroupSnapshotsV319Test-1423450155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6a53e441-1584-4740-ad23-7d876c0a2651.0979a764-1f80-4174-9415-7fde435f15f9 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:53:32 devstack sudo[84810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6a53e441-1584-4740-ad23-7d876c0a2651.0979a764-1f80-4174-9415-7fde435f15f9
Apr 15 15:53:32 devstack sudo[84810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:53:33 devstack sudo[84810]: pam_unix(sudo:session): session closed for user root
Apr 15 15:53:33 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-8a4afab1-6b34-4830-832a-76f26a347cd2 tempest-GroupSnapshotsV319Test-1423450155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6a53e441-1584-4740-ad23-7d876c0a2651.0979a764-1f80-4174-9415-7fde435f15f9" returned: 0 in 0.724s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:53:33 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-8a4afab1-6b34-4830-832a-76f26a347cd2 tempest-GroupSnapshotsV319Test-1423450155 None] Lock "cinder-quobyte-0979a764-1f80-4174-9415-7fde435f15f9" released by "_delete_snapshot" :: held 3.380s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:53:33 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-8a4afab1-6b34-4830-832a-76f26a347cd2 tempest-GroupSnapshotsV319Test-1423450155 None] Lock "cinder-quobyte-6a53e441-1584-4740-ad23-7d876c0a2651" released by "delete_snapshot" :: held 3.398s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:53:33 devstack cinder-volume[82485]: WARNING cinder.quota [None req-8a4afab1-6b34-4830-832a-76f26a347cd2 tempest-GroupSnapshotsV319Test-1423450155 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1146966373 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1146966373, it is now deprecated. Please use the default quota class for default quota.
Apr 15 15:53:33 devstack cinder-volume[82485]: WARNING cinder.quota [None req-8a4afab1-6b34-4830-832a-76f26a347cd2 tempest-GroupSnapshotsV319Test-1423450155 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1146966373 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1146966373, it is now deprecated. Please use the default quota class for default quota.
Apr 15 15:53:33 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-8a4afab1-6b34-4830-832a-76f26a347cd2 tempest-GroupSnapshotsV319Test-1423450155 None] Created reservations ['0e6c62b1-1417-4bf4-ae34-af9cc5ab8f77', '609a707c-3245-40d8-93fa-31d5c468b494', '906b4020-35fe-488e-a17e-4da3d441b0d8', 'f847da27-8e5e-4669-a18d-4ab1c5b72385'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:53:33 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-8a4afab1-6b34-4830-832a-76f26a347cd2 tempest-GroupSnapshotsV319Test-1423450155 None] group_snapshot c794b662-b4f6-4568-b2a7-d504d098fd8a: deleted successfully
Apr 15 15:53:34 devstack cinder-volume[82485]: DEBUG dbcounter [-] [82485] Writing DB stats cinder:SELECT=75,cinder:UPDATE=104,cinder:DELETE=9,cinder:INSERT=29 {{(pid=82485) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 15:53:34 devstack cinder-volume[82485]: DEBUG dbcounter [-] [82485] Writing DB stats cinder:SELECT=88,cinder:UPDATE=106,cinder:INSERT=21,cinder:DELETE=8 {{(pid=82485) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 15:53:34 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-7c322149-9b7d-4370-bdcc-0a260d7f41fc tempest-GroupSnapshotsV319Test-1423450155 None] Acquiring lock "cinder-quobyte-6a53e441-1584-4740-ad23-7d876c0a2651" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:53:34 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-7c322149-9b7d-4370-bdcc-0a260d7f41fc tempest-GroupSnapshotsV319Test-1423450155 None] Lock "cinder-quobyte-6a53e441-1584-4740-ad23-7d876c0a2651" acquired by "delete_volume" :: waited 0.013s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:53:34 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b48cdd-8bc0-4f7a-947b-7219faabf9fb]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:53:34 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7c322149-9b7d-4370-bdcc-0a260d7f41fc tempest-GroupSnapshotsV319Test-1423450155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6a53e441-1584-4740-ad23-7d876c0a2651 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:53:34 devstack sudo[84846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6a53e441-1584-4740-ad23-7d876c0a2651
Apr 15 15:53:34 devstack sudo[84846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:53:35 devstack sudo[84846]: pam_unix(sudo:session): session closed for user root
Apr 15 15:53:35 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7c322149-9b7d-4370-bdcc-0a260d7f41fc tempest-GroupSnapshotsV319Test-1423450155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6a53e441-1584-4740-ad23-7d876c0a2651" returned: 0 in 0.626s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:53:35 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7c322149-9b7d-4370-bdcc-0a260d7f41fc tempest-GroupSnapshotsV319Test-1423450155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6a53e441-1584-4740-ad23-7d876c0a2651 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:53:35 devstack sudo[84852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6a53e441-1584-4740-ad23-7d876c0a2651
Apr 15 15:53:35 devstack sudo[84852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:53:35 devstack sudo[84852]: pam_unix(sudo:session): session closed for user root
Apr 15 15:53:35 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7c322149-9b7d-4370-bdcc-0a260d7f41fc tempest-GroupSnapshotsV319Test-1423450155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6a53e441-1584-4740-ad23-7d876c0a2651" returned: 0 in 0.410s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:53:35 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-7c322149-9b7d-4370-bdcc-0a260d7f41fc tempest-GroupSnapshotsV319Test-1423450155 None] Lock "cinder-quobyte-6a53e441-1584-4740-ad23-7d876c0a2651" released by "delete_volume" :: held 1.071s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:53:35 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-7c322149-9b7d-4370-bdcc-0a260d7f41fc tempest-GroupSnapshotsV319Test-1423450155 None] Created reservations ['6c883c63-7db3-4c48-82c6-4578e7968176'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:53:36 devstack cinder-volume[82485]: WARNING cinder.quota [None req-7c322149-9b7d-4370-bdcc-0a260d7f41fc tempest-GroupSnapshotsV319Test-1423450155 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1146966373 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1146966373, it is now deprecated. Please use the default quota class for default quota.
Apr 15 15:53:36 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-7c322149-9b7d-4370-bdcc-0a260d7f41fc tempest-GroupSnapshotsV319Test-1423450155 None] Created reservations ['7d81cfed-1841-4f9d-a2f5-ed358b38cb26', '62915bc8-5da7-4400-affe-af60cb4a07c0', 'b0ddc409-0e41-4f90-8e38-5f4c50292d6f', '86cbc1ef-846e-46bf-ae00-9b290c9ad752'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:53:36 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7c322149-9b7d-4370-bdcc-0a260d7f41fc tempest-GroupSnapshotsV319Test-1423450155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:53:36 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7c322149-9b7d-4370-bdcc-0a260d7f41fc tempest-GroupSnapshotsV319Test-1423450155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:53:36 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-7c322149-9b7d-4370-bdcc-0a260d7f41fc tempest-GroupSnapshotsV319Test-1423450155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:53:36 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-7c322149-9b7d-4370-bdcc-0a260d7f41fc tempest-GroupSnapshotsV319Test-1423450155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:53:36 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7c322149-9b7d-4370-bdcc-0a260d7f41fc tempest-GroupSnapshotsV319Test-1423450155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:53:36 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7c322149-9b7d-4370-bdcc-0a260d7f41fc tempest-GroupSnapshotsV319Test-1423450155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:53:36 devstack sudo[84856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:53:36 devstack sudo[84856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:53:36 devstack sudo[84856]: pam_unix(sudo:session): session closed for user root
Apr 15 15:53:36 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7c322149-9b7d-4370-bdcc-0a260d7f41fc tempest-GroupSnapshotsV319Test-1423450155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.522s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:53:36 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-7c322149-9b7d-4370-bdcc-0a260d7f41fc tempest-GroupSnapshotsV319Test-1423450155 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:53:36 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-7c322149-9b7d-4370-bdcc-0a260d7f41fc tempest-GroupSnapshotsV319Test-1423450155 None] Delete group completed successfully.
Apr 15 15:53:38 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [req-168f28bb-6fc8-48e6-bb0a-8c629d58ec50 req-6d005118-13cc-474a-8285-d77a7ad04ef5 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:53:38 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [req-168f28bb-6fc8-48e6-bb0a-8c629d58ec50 req-6d005118-13cc-474a-8285-d77a7ad04ef5 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Flow 'volume_create_manager' (b0b8558f-a061-4948-ac7c-b4fbdeb36e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:53:38 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [req-168f28bb-6fc8-48e6-bb0a-8c629d58ec50 req-6d005118-13cc-474a-8285-d77a7ad04ef5 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25e0cd93-a8a7-4159-b9c1-8e80075883a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:53:38 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [req-168f28bb-6fc8-48e6-bb0a-8c629d58ec50 req-6d005118-13cc-474a-8285-d77a7ad04ef5 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25e0cd93-a8a7-4159-b9c1-8e80075883a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:53:38Z,deleted=False,deleted_at=None,display_description='',display_name='46f4855d-fd45-480e-88cb-058a2751abcf-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f20b67de-38f0-4b05-8963-b4a4123aa132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d04dec0f5d04abb90a11fceb752a2c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:53:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:53:38Z,use_quota=True,user_id='35fd433b182747e0901b8a99e1a04327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:53:38 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [req-168f28bb-6fc8-48e6-bb0a-8c629d58ec50 req-6d005118-13cc-474a-8285-d77a7ad04ef5 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0e10591-1e89-4371-8faf-f57f1343b78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:53:38 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [req-168f28bb-6fc8-48e6-bb0a-8c629d58ec50 req-6d005118-13cc-474a-8285-d77a7ad04ef5 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0e10591-1e89-4371-8faf-f57f1343b78c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:53:38 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [req-168f28bb-6fc8-48e6-bb0a-8c629d58ec50 req-6d005118-13cc-474a-8285-d77a7ad04ef5 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abd3280d-9ada-405d-9c17-3df59399f234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:53:38 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [req-168f28bb-6fc8-48e6-bb0a-8c629d58ec50 req-6d005118-13cc-474a-8285-d77a7ad04ef5 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abd3280d-9ada-405d-9c17-3df59399f234) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f20b67de-38f0-4b05-8963-b4a4123aa132', 'volume_name': 'volume-f20b67de-38f0-4b05-8963-b4a4123aa132', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:53:38 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [req-168f28bb-6fc8-48e6-bb0a-8c629d58ec50 req-6d005118-13cc-474a-8285-d77a7ad04ef5 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (412968e0-dc6c-4030-bfa4-561a3685ed85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:53:38 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [req-168f28bb-6fc8-48e6-bb0a-8c629d58ec50 req-6d005118-13cc-474a-8285-d77a7ad04ef5 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (412968e0-dc6c-4030-bfa4-561a3685ed85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:53:38 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [req-168f28bb-6fc8-48e6-bb0a-8c629d58ec50 req-6d005118-13cc-474a-8285-d77a7ad04ef5 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (136fa5fe-01d7-4c11-bfdc-c7cdd640aff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:53:38 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [req-168f28bb-6fc8-48e6-bb0a-8c629d58ec50 req-6d005118-13cc-474a-8285-d77a7ad04ef5 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Volume f20b67de-38f0-4b05-8963-b4a4123aa132: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f20b67de-38f0-4b05-8963-b4a4123aa132', 'volume_size': 1}
Apr 15 15:53:38 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [req-168f28bb-6fc8-48e6-bb0a-8c629d58ec50 req-6d005118-13cc-474a-8285-d77a7ad04ef5 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:53:38 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [req-168f28bb-6fc8-48e6-bb0a-8c629d58ec50 req-6d005118-13cc-474a-8285-d77a7ad04ef5 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:53:38 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [req-168f28bb-6fc8-48e6-bb0a-8c629d58ec50 req-6d005118-13cc-474a-8285-d77a7ad04ef5 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:53:38Z,deleted=False,deleted_at=None,display_description='',display_name='46f4855d-fd45-480e-88cb-058a2751abcf-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f20b67de-38f0-4b05-8963-b4a4123aa132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d04dec0f5d04abb90a11fceb752a2c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:53:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:53:38Z,use_quota=True,user_id='35fd433b182747e0901b8a99e1a04327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:53:38 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [req-168f28bb-6fc8-48e6-bb0a-8c629d58ec50 req-6d005118-13cc-474a-8285-d77a7ad04ef5 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Creating volume f20b67de-38f0-4b05-8963-b4a4123aa132 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:53:38 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [req-168f28bb-6fc8-48e6-bb0a-8c629d58ec50 req-6d005118-13cc-474a-8285-d77a7ad04ef5 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:53:38 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [req-168f28bb-6fc8-48e6-bb0a-8c629d58ec50 req-6d005118-13cc-474a-8285-d77a7ad04ef5 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:53:38 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [req-168f28bb-6fc8-48e6-bb0a-8c629d58ec50 req-6d005118-13cc-474a-8285-d77a7ad04ef5 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:53:38 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [req-168f28bb-6fc8-48e6-bb0a-8c629d58ec50 req-6d005118-13cc-474a-8285-d77a7ad04ef5 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:53:38 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [req-168f28bb-6fc8-48e6-bb0a-8c629d58ec50 req-6d005118-13cc-474a-8285-d77a7ad04ef5 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:53:38 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [req-168f28bb-6fc8-48e6-bb0a-8c629d58ec50 req-6d005118-13cc-474a-8285-d77a7ad04ef5 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:53:38 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [req-168f28bb-6fc8-48e6-bb0a-8c629d58ec50 req-6d005118-13cc-474a-8285-d77a7ad04ef5 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:53:38 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-168f28bb-6fc8-48e6-bb0a-8c629d58ec50 req-6d005118-13cc-474a-8285-d77a7ad04ef5 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f20b67de-38f0-4b05-8963-b4a4123aa132 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:53:38 devstack sudo[84862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f20b67de-38f0-4b05-8963-b4a4123aa132 1073741824
Apr 15 15:53:38 devstack sudo[84862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:53:39 devstack sudo[84862]: pam_unix(sudo:session): session closed for user root
Apr 15 15:53:39 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-168f28bb-6fc8-48e6-bb0a-8c629d58ec50 req-6d005118-13cc-474a-8285-d77a7ad04ef5 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f20b67de-38f0-4b05-8963-b4a4123aa132 1073741824" returned: 0 in 1.100s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:53:39 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-168f28bb-6fc8-48e6-bb0a-8c629d58ec50 req-6d005118-13cc-474a-8285-d77a7ad04ef5 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f20b67de-38f0-4b05-8963-b4a4123aa132 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:53:39 devstack sudo[84901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f20b67de-38f0-4b05-8963-b4a4123aa132
Apr 15 15:53:39 devstack sudo[84901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:53:40 devstack sudo[84901]: pam_unix(sudo:session): session closed for user root
Apr 15 15:53:40 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-168f28bb-6fc8-48e6-bb0a-8c629d58ec50 req-6d005118-13cc-474a-8285-d77a7ad04ef5 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f20b67de-38f0-4b05-8963-b4a4123aa132" returned: 0 in 1.003s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:53:40 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [req-168f28bb-6fc8-48e6-bb0a-8c629d58ec50 req-6d005118-13cc-474a-8285-d77a7ad04ef5 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] <== create_volume: return (2139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:53:40 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [req-168f28bb-6fc8-48e6-bb0a-8c629d58ec50 req-6d005118-13cc-474a-8285-d77a7ad04ef5 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.142s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:53:40 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [req-168f28bb-6fc8-48e6-bb0a-8c629d58ec50 req-6d005118-13cc-474a-8285-d77a7ad04ef5 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (136fa5fe-01d7-4c11-bfdc-c7cdd640aff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f20b67de-38f0-4b05-8963-b4a4123aa132', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:53:40 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [req-168f28bb-6fc8-48e6-bb0a-8c629d58ec50 req-6d005118-13cc-474a-8285-d77a7ad04ef5 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a018bd4-dccd-4e6c-b608-fb66cbe9239b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:53:40 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [req-168f28bb-6fc8-48e6-bb0a-8c629d58ec50 req-6d005118-13cc-474a-8285-d77a7ad04ef5 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Volume volume-f20b67de-38f0-4b05-8963-b4a4123aa132 (f20b67de-38f0-4b05-8963-b4a4123aa132): created successfully
Apr 15 15:53:40 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [req-168f28bb-6fc8-48e6-bb0a-8c629d58ec50 req-6d005118-13cc-474a-8285-d77a7ad04ef5 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a018bd4-dccd-4e6c-b608-fb66cbe9239b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:53:40 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [req-168f28bb-6fc8-48e6-bb0a-8c629d58ec50 req-6d005118-13cc-474a-8285-d77a7ad04ef5 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Flow 'volume_create_manager' (b0b8558f-a061-4948-ac7c-b4fbdeb36e33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:53:40 devstack cinder-volume[82485]: INFO cinder.volume.manager [req-168f28bb-6fc8-48e6-bb0a-8c629d58ec50 req-6d005118-13cc-474a-8285-d77a7ad04ef5 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Created volume successfully.
Apr 15 15:53:42 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [req-168f28bb-6fc8-48e6-bb0a-8c629d58ec50 req-9be3fa7f-8917-4ea5-bc49-da1b1deece6b tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:53:42 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [req-168f28bb-6fc8-48e6-bb0a-8c629d58ec50 req-9be3fa7f-8917-4ea5-bc49-da1b1deece6b tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:53:42 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[d952c31d-35b8-4472-9446-acebbe1ff927]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:53:42 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-168f28bb-6fc8-48e6-bb0a-8c629d58ec50 req-9be3fa7f-8917-4ea5-bc49-da1b1deece6b tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f20b67de-38f0-4b05-8963-b4a4123aa132 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:53:42 devstack sudo[84920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f20b67de-38f0-4b05-8963-b4a4123aa132
Apr 15 15:53:42 devstack sudo[84920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:53:42 devstack sudo[84920]: pam_unix(sudo:session): session closed for user root
Apr 15 15:53:42 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-168f28bb-6fc8-48e6-bb0a-8c629d58ec50 req-9be3fa7f-8917-4ea5-bc49-da1b1deece6b tempest-ServerBootFromVolumeStableRescueTest-854633972 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f20b67de-38f0-4b05-8963-b4a4123aa132" returned: 0 in 0.612s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:53:42 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [req-168f28bb-6fc8-48e6-bb0a-8c629d58ec50 req-9be3fa7f-8917-4ea5-bc49-da1b1deece6b tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.623s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:53:42 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [req-168f28bb-6fc8-48e6-bb0a-8c629d58ec50 req-9be3fa7f-8917-4ea5-bc49-da1b1deece6b tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c', 'name': 'volume-f20b67de-38f0-4b05-8963-b4a4123aa132', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ad3683ef-30b1-43dc-8fd6-19f6f22c4f56', 'enforce_multipath': True} {{(pid=82485) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 15 15:53:42 devstack cinder-volume[82485]: INFO cinder.volume.manager [req-168f28bb-6fc8-48e6-bb0a-8c629d58ec50 req-9be3fa7f-8917-4ea5-bc49-da1b1deece6b tempest-ServerBootFromVolumeStableRescueTest-854633972 None] attachment_update completed successfully.
Apr 15 15:53:44 devstack cinder-volume[82485]: DEBUG oslo_service.periodic_task [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82485) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 15 15:53:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:53:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:53:44 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:53:44 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:53:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:53:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:53:44 devstack sudo[84932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:53:44 devstack sudo[84932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:53:45 devstack sudo[84932]: pam_unix(sudo:session): session closed for user root
Apr 15 15:53:45 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.868s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:53:45 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:53:46 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-931f238a-1937-4411-a121-afc31befd90e tempest-GroupSnapshotsTest-1023701834 None] Group tempest-GroupSnapshotsTest-Group-1247302646: creating
Apr 15 15:53:46 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-931f238a-1937-4411-a121-afc31befd90e tempest-GroupSnapshotsTest-1023701834 None] Group tempest-GroupSnapshotsTest-Group-1247302646: created successfully
Apr 15 15:53:46 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-931f238a-1937-4411-a121-afc31befd90e tempest-GroupSnapshotsTest-1023701834 None] Create group completed successfully.
Apr 15 15:53:47 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-39e082e2-55e1-4850-b6db-8ebbd6c44f48 tempest-GroupSnapshotsTest-1023701834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:53:47 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-39e082e2-55e1-4850-b6db-8ebbd6c44f48 tempest-GroupSnapshotsTest-1023701834 None] Flow 'volume_create_manager' (625c9966-e50e-46db-a7a4-b20ae0a5a9a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:53:47 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-39e082e2-55e1-4850-b6db-8ebbd6c44f48 tempest-GroupSnapshotsTest-1023701834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c353d8c5-19b7-4716-a31c-b7bf645cd66e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:53:47 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-5aca473a-989c-4e23-90ea-4c90863c394a tempest-GroupsV314Test-1965176933 None] Group tempest-GroupsV314Test-Group-469362052: creating
Apr 15 15:53:47 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-39e082e2-55e1-4850-b6db-8ebbd6c44f48 tempest-GroupSnapshotsTest-1023701834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c353d8c5-19b7-4716-a31c-b7bf645cd66e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:53:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1025692177',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0ed38756-bdd5-4002-8573-0647e8d1ad5f,host='devstack@QuobyteHD#QuobyteHD',id=86fb75a3-1f34-438d-bd34-a0fddfe21fd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fce0dc69f99342178f01ef06e0beb61c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:53:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:53:48Z,use_quota=True,user_id='065979835d994434a62276753eaa5fcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5990234-cc24-4fca-9f67-e1874802cce2),volume_type_id=a5990234-cc24-4fca-9f67-e1874802cce2)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:53:47 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-39e082e2-55e1-4850-b6db-8ebbd6c44f48 tempest-GroupSnapshotsTest-1023701834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77cca768-293f-428a-9262-cee1e9eaeb18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:53:47 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-39e082e2-55e1-4850-b6db-8ebbd6c44f48 tempest-GroupSnapshotsTest-1023701834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77cca768-293f-428a-9262-cee1e9eaeb18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:53:47 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-39e082e2-55e1-4850-b6db-8ebbd6c44f48 tempest-GroupSnapshotsTest-1023701834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1043c847-ac50-4fbf-aab4-e96260e95660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:53:47 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-39e082e2-55e1-4850-b6db-8ebbd6c44f48 tempest-GroupSnapshotsTest-1023701834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1043c847-ac50-4fbf-aab4-e96260e95660) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86fb75a3-1f34-438d-bd34-a0fddfe21fd8', 'volume_name': 'volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:53:47 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-39e082e2-55e1-4850-b6db-8ebbd6c44f48 tempest-GroupSnapshotsTest-1023701834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9c62343-0cc5-468f-b51b-f2632163c882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:53:47 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-39e082e2-55e1-4850-b6db-8ebbd6c44f48 tempest-GroupSnapshotsTest-1023701834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9c62343-0cc5-468f-b51b-f2632163c882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:53:47 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-39e082e2-55e1-4850-b6db-8ebbd6c44f48 tempest-GroupSnapshotsTest-1023701834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae6b4482-ccc5-4e44-9347-6f291df38798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:53:47 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-39e082e2-55e1-4850-b6db-8ebbd6c44f48 tempest-GroupSnapshotsTest-1023701834 None] Volume 86fb75a3-1f34-438d-bd34-a0fddfe21fd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8', 'volume_size': 1}
Apr 15 15:53:47 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-39e082e2-55e1-4850-b6db-8ebbd6c44f48 tempest-GroupSnapshotsTest-1023701834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:53:47 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-39e082e2-55e1-4850-b6db-8ebbd6c44f48 tempest-GroupSnapshotsTest-1023701834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:53:47 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-39e082e2-55e1-4850-b6db-8ebbd6c44f48 tempest-GroupSnapshotsTest-1023701834 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=0ed38756-bdd5-4002-8573-0647e8d1ad5f,created_at=2026-04-15T13:53:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1025692177',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0ed38756-bdd5-4002-8573-0647e8d1ad5f,host='devstack@QuobyteHD#QuobyteHD',id=86fb75a3-1f34-438d-bd34-a0fddfe21fd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fce0dc69f99342178f01ef06e0beb61c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:53:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:53:48Z,use_quota=True,user_id='065979835d994434a62276753eaa5fcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5990234-cc24-4fca-9f67-e1874802cce2),volume_type_id=a5990234-cc24-4fca-9f67-e1874802cce2)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:53:47 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-39e082e2-55e1-4850-b6db-8ebbd6c44f48 tempest-GroupSnapshotsTest-1023701834 None] Creating volume 86fb75a3-1f34-438d-bd34-a0fddfe21fd8 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:53:47 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-39e082e2-55e1-4850-b6db-8ebbd6c44f48 tempest-GroupSnapshotsTest-1023701834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:53:47 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-39e082e2-55e1-4850-b6db-8ebbd6c44f48 tempest-GroupSnapshotsTest-1023701834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:53:47 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-39e082e2-55e1-4850-b6db-8ebbd6c44f48 tempest-GroupSnapshotsTest-1023701834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:53:47 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-39e082e2-55e1-4850-b6db-8ebbd6c44f48 tempest-GroupSnapshotsTest-1023701834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:53:47 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-39e082e2-55e1-4850-b6db-8ebbd6c44f48 tempest-GroupSnapshotsTest-1023701834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:53:47 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-39e082e2-55e1-4850-b6db-8ebbd6c44f48 tempest-GroupSnapshotsTest-1023701834 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:53:47 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-39e082e2-55e1-4850-b6db-8ebbd6c44f48 tempest-GroupSnapshotsTest-1023701834 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:53:47 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-39e082e2-55e1-4850-b6db-8ebbd6c44f48 tempest-GroupSnapshotsTest-1023701834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:53:47 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-5aca473a-989c-4e23-90ea-4c90863c394a tempest-GroupsV314Test-1965176933 None] Group tempest-GroupsV314Test-Group-469362052: created successfully
Apr 15 15:53:47 devstack sudo[85342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8 1073741824
Apr 15 15:53:47 devstack sudo[85342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:53:47 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-5aca473a-989c-4e23-90ea-4c90863c394a tempest-GroupsV314Test-1965176933 None] Create group completed successfully.
Apr 15 15:53:48 devstack sudo[85342]: pam_unix(sudo:session): session closed for user root
Apr 15 15:53:48 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-39e082e2-55e1-4850-b6db-8ebbd6c44f48 tempest-GroupSnapshotsTest-1023701834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8 1073741824" returned: 0 in 0.766s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:53:48 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-39e082e2-55e1-4850-b6db-8ebbd6c44f48 tempest-GroupSnapshotsTest-1023701834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:53:48 devstack sudo[85351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8
Apr 15 15:53:48 devstack sudo[85351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:53:49 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-c64f6054-2f1a-410f-89b2-dcc0ef820273 tempest-GroupsV314Test-1965176933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:53:49 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-c64f6054-2f1a-410f-89b2-dcc0ef820273 tempest-GroupsV314Test-1965176933 None] Flow 'volume_create_manager' (8be0090f-1c79-4546-a7be-f1c8f18ec515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:53:49 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-c64f6054-2f1a-410f-89b2-dcc0ef820273 tempest-GroupsV314Test-1965176933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a50e833e-c22f-4bb2-a3dc-f6259f7a4f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:53:49 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-c64f6054-2f1a-410f-89b2-dcc0ef820273 tempest-GroupsV314Test-1965176933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a50e833e-c22f-4bb2-a3dc-f6259f7a4f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:53:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1460382819',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a64e21c5-610c-458f-81e8-f1864e965590,host='devstack@QuobyteHD#QuobyteHD',id=cd004fd3-4d5d-40fe-887d-d9b30bea8a98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9084300a64164893833828020a125256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:53:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:53:49Z,use_quota=True,user_id='5d48712a48d2404cb4648bbe0d4b1125',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d6d9790-a533-4906-bab8-511e22aa10eb),volume_type_id=6d6d9790-a533-4906-bab8-511e22aa10eb)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:53:49 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-c64f6054-2f1a-410f-89b2-dcc0ef820273 tempest-GroupsV314Test-1965176933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be4d01fe-0a5d-4765-8a8a-3b108452ae88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:53:49 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-c64f6054-2f1a-410f-89b2-dcc0ef820273 tempest-GroupsV314Test-1965176933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be4d01fe-0a5d-4765-8a8a-3b108452ae88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:53:49 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-c64f6054-2f1a-410f-89b2-dcc0ef820273 tempest-GroupsV314Test-1965176933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (041d707a-c5ed-4eed-982d-01eb0ab03516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:53:49 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-c64f6054-2f1a-410f-89b2-dcc0ef820273 tempest-GroupsV314Test-1965176933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (041d707a-c5ed-4eed-982d-01eb0ab03516) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd004fd3-4d5d-40fe-887d-d9b30bea8a98', 'volume_name': 'volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:53:49 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-c64f6054-2f1a-410f-89b2-dcc0ef820273 tempest-GroupsV314Test-1965176933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b853af51-0747-43a2-8cc2-6cd32b8da6bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:53:49 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-c64f6054-2f1a-410f-89b2-dcc0ef820273 tempest-GroupsV314Test-1965176933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b853af51-0747-43a2-8cc2-6cd32b8da6bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:53:49 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-c64f6054-2f1a-410f-89b2-dcc0ef820273 tempest-GroupsV314Test-1965176933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (203f11ba-2adf-48b8-ab5b-34bbea1df616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:53:49 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-c64f6054-2f1a-410f-89b2-dcc0ef820273 tempest-GroupsV314Test-1965176933 None] Volume cd004fd3-4d5d-40fe-887d-d9b30bea8a98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98', 'volume_size': 1}
Apr 15 15:53:49 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-c64f6054-2f1a-410f-89b2-dcc0ef820273 tempest-GroupsV314Test-1965176933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:53:49 devstack sudo[85351]: pam_unix(sudo:session): session closed for user root
Apr 15 15:53:49 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-39e082e2-55e1-4850-b6db-8ebbd6c44f48 tempest-GroupSnapshotsTest-1023701834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8" returned: 0 in 0.750s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:53:49 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-39e082e2-55e1-4850-b6db-8ebbd6c44f48 tempest-GroupSnapshotsTest-1023701834 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:53:49 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-39e082e2-55e1-4850-b6db-8ebbd6c44f48 tempest-GroupSnapshotsTest-1023701834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.564s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:53:49 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-c64f6054-2f1a-410f-89b2-dcc0ef820273 tempest-GroupsV314Test-1965176933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.141s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:53:49 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-c64f6054-2f1a-410f-89b2-dcc0ef820273 tempest-GroupsV314Test-1965176933 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=a64e21c5-610c-458f-81e8-f1864e965590,created_at=2026-04-15T13:53:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1460382819',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a64e21c5-610c-458f-81e8-f1864e965590,host='devstack@QuobyteHD#QuobyteHD',id=cd004fd3-4d5d-40fe-887d-d9b30bea8a98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9084300a64164893833828020a125256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:53:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:53:49Z,use_quota=True,user_id='5d48712a48d2404cb4648bbe0d4b1125',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d6d9790-a533-4906-bab8-511e22aa10eb),volume_type_id=6d6d9790-a533-4906-bab8-511e22aa10eb)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:53:49 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-c64f6054-2f1a-410f-89b2-dcc0ef820273 tempest-GroupsV314Test-1965176933 None] Creating volume cd004fd3-4d5d-40fe-887d-d9b30bea8a98 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:53:49 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-c64f6054-2f1a-410f-89b2-dcc0ef820273 tempest-GroupsV314Test-1965176933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:53:49 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-c64f6054-2f1a-410f-89b2-dcc0ef820273 tempest-GroupsV314Test-1965176933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:53:49 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-c64f6054-2f1a-410f-89b2-dcc0ef820273 tempest-GroupsV314Test-1965176933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:53:49 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-c64f6054-2f1a-410f-89b2-dcc0ef820273 tempest-GroupsV314Test-1965176933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:53:49 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-c64f6054-2f1a-410f-89b2-dcc0ef820273 tempest-GroupsV314Test-1965176933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:53:49 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-c64f6054-2f1a-410f-89b2-dcc0ef820273 tempest-GroupsV314Test-1965176933 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:53:49 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-c64f6054-2f1a-410f-89b2-dcc0ef820273 tempest-GroupsV314Test-1965176933 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:53:49 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-c64f6054-2f1a-410f-89b2-dcc0ef820273 tempest-GroupsV314Test-1965176933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:53:49 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-39e082e2-55e1-4850-b6db-8ebbd6c44f48 tempest-GroupSnapshotsTest-1023701834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae6b4482-ccc5-4e44-9347-6f291df38798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:53:49 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-39e082e2-55e1-4850-b6db-8ebbd6c44f48 tempest-GroupSnapshotsTest-1023701834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbb0413b-360c-4874-9801-9ea45835173d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:53:49 devstack sudo[85354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98 1073741824
Apr 15 15:53:49 devstack sudo[85354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:53:49 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-39e082e2-55e1-4850-b6db-8ebbd6c44f48 tempest-GroupSnapshotsTest-1023701834 None] Volume volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8 (86fb75a3-1f34-438d-bd34-a0fddfe21fd8): created successfully
Apr 15 15:53:49 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-39e082e2-55e1-4850-b6db-8ebbd6c44f48 tempest-GroupSnapshotsTest-1023701834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbb0413b-360c-4874-9801-9ea45835173d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:53:49 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-39e082e2-55e1-4850-b6db-8ebbd6c44f48 tempest-GroupSnapshotsTest-1023701834 None] Flow 'volume_create_manager' (625c9966-e50e-46db-a7a4-b20ae0a5a9a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:53:49 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-39e082e2-55e1-4850-b6db-8ebbd6c44f48 tempest-GroupSnapshotsTest-1023701834 None] Created volume successfully.
Apr 15 15:53:50 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-f6c71be8-ab17-42bf-8ad9-c4f0943786ee tempest-GroupSnapshotsTest-1023701834 None] GroupSnapshot 80183f21-4a71-4e04-b3d0-2f365ffdb0ff: creating.
Apr 15 15:53:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-f6c71be8-ab17-42bf-8ad9-c4f0943786ee tempest-GroupSnapshotsTest-1023701834 None] Group snapshot 80183f21-4a71-4e04-b3d0-2f365ffdb0ff: creating. {{(pid=82485) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 15 15:53:50 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-f6c71be8-ab17-42bf-8ad9-c4f0943786ee tempest-GroupSnapshotsTest-1023701834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:53:50 devstack sudo[85354]: pam_unix(sudo:session): session closed for user root
Apr 15 15:53:50 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-c64f6054-2f1a-410f-89b2-dcc0ef820273 tempest-GroupsV314Test-1965176933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98 1073741824" returned: 0 in 0.909s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:53:50 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-c64f6054-2f1a-410f-89b2-dcc0ef820273 tempest-GroupsV314Test-1965176933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:53:50 devstack sudo[85360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98
Apr 15 15:53:50 devstack sudo[85360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:53:50 devstack sudo[85360]: pam_unix(sudo:session): session closed for user root
Apr 15 15:53:50 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-c64f6054-2f1a-410f-89b2-dcc0ef820273 tempest-GroupsV314Test-1965176933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98" returned: 0 in 0.521s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:53:50 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-c64f6054-2f1a-410f-89b2-dcc0ef820273 tempest-GroupsV314Test-1965176933 None] <== create_volume: return (1453ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:53:50 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-c64f6054-2f1a-410f-89b2-dcc0ef820273 tempest-GroupsV314Test-1965176933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.457s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:53:50 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-f6c71be8-ab17-42bf-8ad9-c4f0943786ee tempest-GroupSnapshotsTest-1023701834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.555s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:53:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-c64f6054-2f1a-410f-89b2-dcc0ef820273 tempest-GroupsV314Test-1965176933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (203f11ba-2adf-48b8-ab5b-34bbea1df616) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:53:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-c64f6054-2f1a-410f-89b2-dcc0ef820273 tempest-GroupsV314Test-1965176933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87ed2481-bc58-4600-a30d-e7c90a1f6237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:53:50 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-c64f6054-2f1a-410f-89b2-dcc0ef820273 tempest-GroupsV314Test-1965176933 None] Volume volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98 (cd004fd3-4d5d-40fe-887d-d9b30bea8a98): created successfully
Apr 15 15:53:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-c64f6054-2f1a-410f-89b2-dcc0ef820273 tempest-GroupsV314Test-1965176933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87ed2481-bc58-4600-a30d-e7c90a1f6237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:53:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-c64f6054-2f1a-410f-89b2-dcc0ef820273 tempest-GroupsV314Test-1965176933 None] Flow 'volume_create_manager' (8be0090f-1c79-4546-a7be-f1c8f18ec515) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:53:50 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-f6c71be8-ab17-42bf-8ad9-c4f0943786ee tempest-GroupSnapshotsTest-1023701834 None] Creating offline snapshot 27a011a5-383f-41aa-b522-8849ae3e9ec1 of volume 86fb75a3-1f34-438d-bd34-a0fddfe21fd8 {{(pid=82485) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 15:53:50 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-c64f6054-2f1a-410f-89b2-dcc0ef820273 tempest-GroupsV314Test-1965176933 None] Created volume successfully.
Apr 15 15:53:50 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32f92a5-7d09-4add-9e64-30694bb7cbcd]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:53:50 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-f6c71be8-ab17-42bf-8ad9-c4f0943786ee tempest-GroupSnapshotsTest-1023701834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:53:51 devstack sudo[85363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8
Apr 15 15:53:51 devstack sudo[85363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:53:51 devstack sudo[85363]: pam_unix(sudo:session): session closed for user root
Apr 15 15:53:51 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-f6c71be8-ab17-42bf-8ad9-c4f0943786ee tempest-GroupSnapshotsTest-1023701834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8" returned: 0 in 0.742s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:53:51 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-f6c71be8-ab17-42bf-8ad9-c4f0943786ee tempest-GroupSnapshotsTest-1023701834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8.27a011a5-383f-41aa-b522-8849ae3e9ec1 1G {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:53:51 devstack sudo[85369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8.27a011a5-383f-41aa-b522-8849ae3e9ec1 1G
Apr 15 15:53:51 devstack sudo[85369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:53:52 devstack sudo[85369]: pam_unix(sudo:session): session closed for user root
Apr 15 15:53:52 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-f6c71be8-ab17-42bf-8ad9-c4f0943786ee tempest-GroupSnapshotsTest-1023701834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8.27a011a5-383f-41aa-b522-8849ae3e9ec1 1G" returned: 0 in 0.633s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:53:52 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-f6c71be8-ab17-42bf-8ad9-c4f0943786ee tempest-GroupSnapshotsTest-1023701834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8.27a011a5-383f-41aa-b522-8849ae3e9ec1 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:53:52 devstack sudo[85374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8.27a011a5-383f-41aa-b522-8849ae3e9ec1
Apr 15 15:53:52 devstack sudo[85374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:53:52 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-20f04680-70ec-482c-9d23-e3c6470289de tempest-GroupsV314Test-1965176933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:53:53 devstack sudo[85374]: pam_unix(sudo:session): session closed for user root
Apr 15 15:53:53 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-f6c71be8-ab17-42bf-8ad9-c4f0943786ee tempest-GroupSnapshotsTest-1023701834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8.27a011a5-383f-41aa-b522-8849ae3e9ec1" returned: 0 in 0.793s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:53:53 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-f6c71be8-ab17-42bf-8ad9-c4f0943786ee tempest-GroupSnapshotsTest-1023701834 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8.27a011a5-383f-41aa-b522-8849ae3e9ec1 is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 15:53:53 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-f6c71be8-ab17-42bf-8ad9-c4f0943786ee tempest-GroupSnapshotsTest-1023701834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8.27a011a5-383f-41aa-b522-8849ae3e9ec1 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:53:53 devstack sudo[85379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8.27a011a5-383f-41aa-b522-8849ae3e9ec1
Apr 15 15:53:53 devstack sudo[85379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:53:53 devstack sudo[85379]: pam_unix(sudo:session): session closed for user root
Apr 15 15:53:53 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-f6c71be8-ab17-42bf-8ad9-c4f0943786ee tempest-GroupSnapshotsTest-1023701834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8.27a011a5-383f-41aa-b522-8849ae3e9ec1" returned: 0 in 0.486s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:53:53 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-f6c71be8-ab17-42bf-8ad9-c4f0943786ee tempest-GroupSnapshotsTest-1023701834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8.info {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:53:53 devstack sudo[85382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8.info
Apr 15 15:53:53 devstack sudo[85382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:53:54 devstack sudo[85382]: pam_unix(sudo:session): session closed for user root
Apr 15 15:53:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-f6c71be8-ab17-42bf-8ad9-c4f0943786ee tempest-GroupSnapshotsTest-1023701834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8.info" returned: 0 in 0.500s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:53:54 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-f6c71be8-ab17-42bf-8ad9-c4f0943786ee tempest-GroupSnapshotsTest-1023701834 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 15:53:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-f6c71be8-ab17-42bf-8ad9-c4f0943786ee tempest-GroupSnapshotsTest-1023701834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8.info {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:53:54 devstack sudo[85385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8.info
Apr 15 15:53:54 devstack sudo[85385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:53:54 devstack sudo[85385]: pam_unix(sudo:session): session closed for user root
Apr 15 15:53:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-f6c71be8-ab17-42bf-8ad9-c4f0943786ee tempest-GroupSnapshotsTest-1023701834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8.info" returned: 0 in 0.456s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:53:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-f6c71be8-ab17-42bf-8ad9-c4f0943786ee tempest-GroupSnapshotsTest-1023701834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.691s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:53:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-20f04680-70ec-482c-9d23-e3c6470289de tempest-GroupsV314Test-1965176933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 2.025s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:53:54 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-20f04680-70ec-482c-9d23-e3c6470289de tempest-GroupsV314Test-1965176933 None] Cloning volume cd004fd3-4d5d-40fe-887d-d9b30bea8a98 to volume 0befda97-37c2-4bd6-8e01-7cf8e5b3973c
Apr 15 15:53:54 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-20f04680-70ec-482c-9d23-e3c6470289de tempest-GroupsV314Test-1965176933 None] Creating offline snapshot 6ee8af24-0531-4719-b9bc-a75bca6dd439 of volume cd004fd3-4d5d-40fe-887d-d9b30bea8a98 {{(pid=82485) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 15:53:54 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eea6fce-b33e-410e-9911-27fedda5c9ca]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:53:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-20f04680-70ec-482c-9d23-e3c6470289de tempest-GroupsV314Test-1965176933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:53:54 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-f6c71be8-ab17-42bf-8ad9-c4f0943786ee tempest-GroupSnapshotsTest-1023701834 None] group_snapshot 80183f21-4a71-4e04-b3d0-2f365ffdb0ff: created successfully
Apr 15 15:53:54 devstack sudo[85389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98
Apr 15 15:53:54 devstack sudo[85389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:53:55 devstack sudo[85389]: pam_unix(sudo:session): session closed for user root
Apr 15 15:53:55 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-20f04680-70ec-482c-9d23-e3c6470289de tempest-GroupsV314Test-1965176933 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98" returned: 0 in 0.641s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:53:55 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-20f04680-70ec-482c-9d23-e3c6470289de tempest-GroupsV314Test-1965176933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98.6ee8af24-0531-4719-b9bc-a75bca6dd439 1G {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:53:55 devstack sudo[85421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98.6ee8af24-0531-4719-b9bc-a75bca6dd439 1G
Apr 15 15:53:55 devstack sudo[85421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:53:55 devstack sudo[85421]: pam_unix(sudo:session): session closed for user root
Apr 15 15:53:55 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-20f04680-70ec-482c-9d23-e3c6470289de tempest-GroupsV314Test-1965176933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98.6ee8af24-0531-4719-b9bc-a75bca6dd439 1G" returned: 0 in 0.621s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:53:55 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-20f04680-70ec-482c-9d23-e3c6470289de tempest-GroupsV314Test-1965176933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98.6ee8af24-0531-4719-b9bc-a75bca6dd439 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:53:55 devstack sudo[85427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98.6ee8af24-0531-4719-b9bc-a75bca6dd439
Apr 15 15:53:55 devstack sudo[85427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:53:56 devstack sudo[85427]: pam_unix(sudo:session): session closed for user root
Apr 15 15:53:56 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-20f04680-70ec-482c-9d23-e3c6470289de tempest-GroupsV314Test-1965176933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98.6ee8af24-0531-4719-b9bc-a75bca6dd439" returned: 0 in 0.485s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:53:56 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-20f04680-70ec-482c-9d23-e3c6470289de tempest-GroupsV314Test-1965176933 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98.6ee8af24-0531-4719-b9bc-a75bca6dd439 is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 15:53:56 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-20f04680-70ec-482c-9d23-e3c6470289de tempest-GroupsV314Test-1965176933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98.6ee8af24-0531-4719-b9bc-a75bca6dd439 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:53:56 devstack sudo[85432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98.6ee8af24-0531-4719-b9bc-a75bca6dd439
Apr 15 15:53:56 devstack sudo[85432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:53:56 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-bfe1eb9a-79f6-42f2-a47e-916b6afa2e68 tempest-GroupSnapshotsTest-1023701834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:53:56 devstack sudo[85432]: pam_unix(sudo:session): session closed for user root
Apr 15 15:53:56 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-20f04680-70ec-482c-9d23-e3c6470289de tempest-GroupsV314Test-1965176933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98.6ee8af24-0531-4719-b9bc-a75bca6dd439" returned: 0 in 0.551s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:53:56 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-20f04680-70ec-482c-9d23-e3c6470289de tempest-GroupsV314Test-1965176933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98.info {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:53:56 devstack sudo[85442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98.info
Apr 15 15:53:56 devstack sudo[85442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:53:57 devstack sudo[85442]: pam_unix(sudo:session): session closed for user root
Apr 15 15:53:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-20f04680-70ec-482c-9d23-e3c6470289de tempest-GroupsV314Test-1965176933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98.info" returned: 0 in 0.415s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:53:57 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-20f04680-70ec-482c-9d23-e3c6470289de tempest-GroupsV314Test-1965176933 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 15:53:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-20f04680-70ec-482c-9d23-e3c6470289de tempest-GroupsV314Test-1965176933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98.info {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:53:57 devstack sudo[85454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98.info
Apr 15 15:53:57 devstack sudo[85454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:53:57 devstack sudo[85454]: pam_unix(sudo:session): session closed for user root
Apr 15 15:53:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-20f04680-70ec-482c-9d23-e3c6470289de tempest-GroupsV314Test-1965176933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98.info" returned: 0 in 0.472s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:53:57 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-20f04680-70ec-482c-9d23-e3c6470289de tempest-GroupsV314Test-1965176933 None] Acquiring lock "cinder-quobyte-0befda97-37c2-4bd6-8e01-7cf8e5b3973c" by "_copy_volume_from_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:53:57 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-20f04680-70ec-482c-9d23-e3c6470289de tempest-GroupsV314Test-1965176933 None] Lock "cinder-quobyte-0befda97-37c2-4bd6-8e01-7cf8e5b3973c" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:53:57 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-20f04680-70ec-482c-9d23-e3c6470289de tempest-GroupsV314Test-1965176933 None] snapshot: 6ee8af24-0531-4719-b9bc-a75bca6dd439, volume: 0befda97-37c2-4bd6-8e01-7cf8e5b3973c,  {{(pid=82485) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 15 15:53:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-20f04680-70ec-482c-9d23-e3c6470289de tempest-GroupsV314Test-1965176933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:53:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-20f04680-70ec-482c-9d23-e3c6470289de tempest-GroupsV314Test-1965176933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:53:57 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-20f04680-70ec-482c-9d23-e3c6470289de tempest-GroupsV314Test-1965176933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:53:57 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-20f04680-70ec-482c-9d23-e3c6470289de tempest-GroupsV314Test-1965176933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:53:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-20f04680-70ec-482c-9d23-e3c6470289de tempest-GroupsV314Test-1965176933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:53:57 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d134e3-f5ce-4603-ac73-8882f9c4ba15]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:53:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-20f04680-70ec-482c-9d23-e3c6470289de tempest-GroupsV314Test-1965176933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98.6ee8af24-0531-4719-b9bc-a75bca6dd439 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:53:58 devstack sudo[85457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98.6ee8af24-0531-4719-b9bc-a75bca6dd439
Apr 15 15:53:58 devstack sudo[85457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:53:58 devstack sudo[85457]: pam_unix(sudo:session): session closed for user root
Apr 15 15:53:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-20f04680-70ec-482c-9d23-e3c6470289de tempest-GroupsV314Test-1965176933 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98.6ee8af24-0531-4719-b9bc-a75bca6dd439" returned: 0 in 0.563s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:53:58 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-20f04680-70ec-482c-9d23-e3c6470289de tempest-GroupsV314Test-1965176933 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82485) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 15:53:58 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-20f04680-70ec-482c-9d23-e3c6470289de tempest-GroupsV314Test-1965176933 None] will copy from snapshot at /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98 {{(pid=82485) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 15 15:53:58 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-20f04680-70ec-482c-9d23-e3c6470289de tempest-GroupsV314Test-1965176933 None] Creating direct copy from snapshot {{(pid=82485) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 15 15:53:58 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce3c551-0924-44ca-afd8-12705fbda6fb]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:53:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-20f04680-70ec-482c-9d23-e3c6470289de tempest-GroupsV314Test-1965176933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:53:58 devstack sudo[85462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98
Apr 15 15:53:58 devstack sudo[85462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:53:59 devstack sudo[85462]: pam_unix(sudo:session): session closed for user root
Apr 15 15:53:59 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-20f04680-70ec-482c-9d23-e3c6470289de tempest-GroupsV314Test-1965176933 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98" returned: 0 in 0.548s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:53:59 devstack cinder-volume[82485]: DEBUG cinder.utils [None req-20f04680-70ec-482c-9d23-e3c6470289de tempest-GroupsV314Test-1965176933 None] Path /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-0befda97-37c2-4bd6-8e01-7cf8e5b3973c not found in is_blk_device check {{(pid=82485) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 15 15:53:59 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-20f04680-70ec-482c-9d23-e3c6470289de tempest-GroupsV314Test-1965176933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-0befda97-37c2-4bd6-8e01-7cf8e5b3973c {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:53:59 devstack sudo[85467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-0befda97-37c2-4bd6-8e01-7cf8e5b3973c
Apr 15 15:53:59 devstack sudo[85467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:02 devstack sudo[85467]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:02 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-20f04680-70ec-482c-9d23-e3c6470289de tempest-GroupsV314Test-1965176933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-0befda97-37c2-4bd6-8e01-7cf8e5b3973c" returned: 0 in 3.064s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:02 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a99740-b374-47a8-a232-734921688b08]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:54:02 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-20f04680-70ec-482c-9d23-e3c6470289de tempest-GroupsV314Test-1965176933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:02 devstack sudo[85522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98
Apr 15 15:54:02 devstack sudo[85522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:02 devstack sudo[85522]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:02 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-20f04680-70ec-482c-9d23-e3c6470289de tempest-GroupsV314Test-1965176933 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98" returned: 0 in 0.868s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:02 devstack cinder-volume[82485]: DEBUG cinder.image.image_utils [None req-20f04680-70ec-482c-9d23-e3c6470289de tempest-GroupsV314Test-1965176933 None] Image conversion details: src /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98, size 1024.00 MB, duration 3.07 sec, destination /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-0befda97-37c2-4bd6-8e01-7cf8e5b3973c {{(pid=82485) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 15:54:02 devstack cinder-volume[82485]: INFO cinder.image.image_utils [None req-20f04680-70ec-482c-9d23-e3c6470289de tempest-GroupsV314Test-1965176933 None] Converted 1024.00 MB image at 334.03 MB/s
Apr 15 15:54:02 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-20f04680-70ec-482c-9d23-e3c6470289de tempest-GroupsV314Test-1965176933 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-0befda97-37c2-4bd6-8e01-7cf8e5b3973c is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 15:54:02 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-20f04680-70ec-482c-9d23-e3c6470289de tempest-GroupsV314Test-1965176933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-0befda97-37c2-4bd6-8e01-7cf8e5b3973c {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:03 devstack sudo[85528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-0befda97-37c2-4bd6-8e01-7cf8e5b3973c
Apr 15 15:54:03 devstack sudo[85528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:03 devstack sudo[85528]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:03 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-20f04680-70ec-482c-9d23-e3c6470289de tempest-GroupsV314Test-1965176933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-0befda97-37c2-4bd6-8e01-7cf8e5b3973c" returned: 0 in 0.481s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:03 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-20f04680-70ec-482c-9d23-e3c6470289de tempest-GroupsV314Test-1965176933 None] Lock "cinder-quobyte-0befda97-37c2-4bd6-8e01-7cf8e5b3973c" released by "_copy_volume_from_snapshot" :: held 5.591s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:54:03 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-20f04680-70ec-482c-9d23-e3c6470289de tempest-GroupsV314Test-1965176933 None] Acquiring lock "cinder-quobyte-6ee8af24-0531-4719-b9bc-a75bca6dd439" by "_delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:54:03 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-20f04680-70ec-482c-9d23-e3c6470289de tempest-GroupsV314Test-1965176933 None] Lock "cinder-quobyte-6ee8af24-0531-4719-b9bc-a75bca6dd439" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:54:03 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-20f04680-70ec-482c-9d23-e3c6470289de tempest-GroupsV314Test-1965176933 None] Deleting offline snapshot 6ee8af24-0531-4719-b9bc-a75bca6dd439 of volume cd004fd3-4d5d-40fe-887d-d9b30bea8a98 {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 15:54:03 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-20f04680-70ec-482c-9d23-e3c6470289de tempest-GroupsV314Test-1965176933 None] snapshot_file for this snap is: volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98.6ee8af24-0531-4719-b9bc-a75bca6dd439 {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 15:54:03 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[582d4864-0c9a-479c-a483-beec839f6088]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:54:03 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-20f04680-70ec-482c-9d23-e3c6470289de tempest-GroupsV314Test-1965176933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98.6ee8af24-0531-4719-b9bc-a75bca6dd439 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:03 devstack sudo[85531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98.6ee8af24-0531-4719-b9bc-a75bca6dd439
Apr 15 15:54:03 devstack sudo[85531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:04 devstack sudo[85531]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:04 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-20f04680-70ec-482c-9d23-e3c6470289de tempest-GroupsV314Test-1965176933 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98.6ee8af24-0531-4719-b9bc-a75bca6dd439" returned: 0 in 0.637s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:04 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-20f04680-70ec-482c-9d23-e3c6470289de tempest-GroupsV314Test-1965176933 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82485) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 15:54:04 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[0756b602-84ff-4538-a6d6-d5790d1ca9a4]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:54:04 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-20f04680-70ec-482c-9d23-e3c6470289de tempest-GroupsV314Test-1965176933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:04 devstack sudo[85538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98
Apr 15 15:54:04 devstack sudo[85538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:04 devstack sudo[85538]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:04 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-20f04680-70ec-482c-9d23-e3c6470289de tempest-GroupsV314Test-1965176933 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98" returned: 0 in 0.525s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:04 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-20f04680-70ec-482c-9d23-e3c6470289de tempest-GroupsV314Test-1965176933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98.6ee8af24-0531-4719-b9bc-a75bca6dd439 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:04 devstack sudo[85544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98.6ee8af24-0531-4719-b9bc-a75bca6dd439
Apr 15 15:54:04 devstack sudo[85544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:05 devstack sudo[85544]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:05 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-20f04680-70ec-482c-9d23-e3c6470289de tempest-GroupsV314Test-1965176933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98.6ee8af24-0531-4719-b9bc-a75bca6dd439" returned: 0 in 0.570s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:05 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-20f04680-70ec-482c-9d23-e3c6470289de tempest-GroupsV314Test-1965176933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98.6ee8af24-0531-4719-b9bc-a75bca6dd439 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:05 devstack sudo[85573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98.6ee8af24-0531-4719-b9bc-a75bca6dd439
Apr 15 15:54:05 devstack sudo[85573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:05 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d43ff39-a294-4cff-b052-3a61dee017f8 tempest-VolumesTransfersTest-1185850073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:54:05 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-2d43ff39-a294-4cff-b052-3a61dee017f8 tempest-VolumesTransfersTest-1185850073 None] Flow 'volume_create_manager' (925a2be0-e466-40f9-8ea4-4a6ca8a1a424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:54:05 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-2d43ff39-a294-4cff-b052-3a61dee017f8 tempest-VolumesTransfersTest-1185850073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7fa7b58-48ae-4e8a-bcc3-3fb40e8a26b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:05 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-2d43ff39-a294-4cff-b052-3a61dee017f8 tempest-VolumesTransfersTest-1185850073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7fa7b58-48ae-4e8a-bcc3-3fb40e8a26b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:54:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-964062584',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bfe6d0c-2bbd-403b-b7d1-d6744305be1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f85fe21ff584442bfe8bc1a40fe683c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:54:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:54:05Z,use_quota=True,user_id='5cdf3c807db0486d911cd24d5d49b233',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:05 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-2d43ff39-a294-4cff-b052-3a61dee017f8 tempest-VolumesTransfersTest-1185850073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dfe8cef-cb8b-440c-a14e-afd2f6bc0b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:05 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-2d43ff39-a294-4cff-b052-3a61dee017f8 tempest-VolumesTransfersTest-1185850073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dfe8cef-cb8b-440c-a14e-afd2f6bc0b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:05 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-2d43ff39-a294-4cff-b052-3a61dee017f8 tempest-VolumesTransfersTest-1185850073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (580e68b4-7bec-4dc9-8518-e80de1fe53c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:05 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-2d43ff39-a294-4cff-b052-3a61dee017f8 tempest-VolumesTransfersTest-1185850073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (580e68b4-7bec-4dc9-8518-e80de1fe53c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bfe6d0c-2bbd-403b-b7d1-d6744305be1c', 'volume_name': 'volume-1bfe6d0c-2bbd-403b-b7d1-d6744305be1c', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:05 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-2d43ff39-a294-4cff-b052-3a61dee017f8 tempest-VolumesTransfersTest-1185850073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56a1d859-4843-475c-88c9-79c889072e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:05 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-2d43ff39-a294-4cff-b052-3a61dee017f8 tempest-VolumesTransfersTest-1185850073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56a1d859-4843-475c-88c9-79c889072e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:05 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-2d43ff39-a294-4cff-b052-3a61dee017f8 tempest-VolumesTransfersTest-1185850073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c29597a-c733-44f7-b95d-817bf1a9d445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:05 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-2d43ff39-a294-4cff-b052-3a61dee017f8 tempest-VolumesTransfersTest-1185850073 None] Volume 1bfe6d0c-2bbd-403b-b7d1-d6744305be1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bfe6d0c-2bbd-403b-b7d1-d6744305be1c', 'volume_size': 1}
Apr 15 15:54:05 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-2d43ff39-a294-4cff-b052-3a61dee017f8 tempest-VolumesTransfersTest-1185850073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:54:05 devstack sudo[85573]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:05 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-20f04680-70ec-482c-9d23-e3c6470289de tempest-GroupsV314Test-1965176933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98.6ee8af24-0531-4719-b9bc-a75bca6dd439" returned: 0 in 0.426s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:05 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-20f04680-70ec-482c-9d23-e3c6470289de tempest-GroupsV314Test-1965176933 None] Lock "cinder-quobyte-6ee8af24-0531-4719-b9bc-a75bca6dd439" released by "_delete_snapshot" :: held 2.267s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:54:05 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-20f04680-70ec-482c-9d23-e3c6470289de tempest-GroupsV314Test-1965176933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.201s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:54:05 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-bfe1eb9a-79f6-42f2-a47e-916b6afa2e68 tempest-GroupSnapshotsTest-1023701834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 9.154s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:54:05 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-bfe1eb9a-79f6-42f2-a47e-916b6afa2e68 tempest-GroupSnapshotsTest-1023701834 None] Acquiring lock "cinder-quobyte-27a011a5-383f-41aa-b522-8849ae3e9ec1-1ada3fe3-e400-4ede-b6fc-483a6e1a097d" by "_create_volume_from_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:54:05 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-bfe1eb9a-79f6-42f2-a47e-916b6afa2e68 tempest-GroupSnapshotsTest-1023701834 None] Lock "cinder-quobyte-27a011a5-383f-41aa-b522-8849ae3e9ec1-1ada3fe3-e400-4ede-b6fc-483a6e1a097d" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:54:05 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-bfe1eb9a-79f6-42f2-a47e-916b6afa2e68 tempest-GroupSnapshotsTest-1023701834 None] Creating volume 1ada3fe3-e400-4ede-b6fc-483a6e1a097d from snapshot 27a011a5-383f-41aa-b522-8849ae3e9ec1 {{(pid=82485) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 15 15:54:05 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-bfe1eb9a-79f6-42f2-a47e-916b6afa2e68 tempest-GroupSnapshotsTest-1023701834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:54:05 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-bfe1eb9a-79f6-42f2-a47e-916b6afa2e68 tempest-GroupSnapshotsTest-1023701834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:54:05 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-bfe1eb9a-79f6-42f2-a47e-916b6afa2e68 tempest-GroupSnapshotsTest-1023701834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:54:05 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-bfe1eb9a-79f6-42f2-a47e-916b6afa2e68 tempest-GroupSnapshotsTest-1023701834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:54:05 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-bfe1eb9a-79f6-42f2-a47e-916b6afa2e68 tempest-GroupSnapshotsTest-1023701834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:54:05 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-bfe1eb9a-79f6-42f2-a47e-916b6afa2e68 tempest-GroupSnapshotsTest-1023701834 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:54:05 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-bfe1eb9a-79f6-42f2-a47e-916b6afa2e68 tempest-GroupSnapshotsTest-1023701834 None] Acquiring lock "cinder-quobyte-1ada3fe3-e400-4ede-b6fc-483a6e1a097d" by "_copy_volume_from_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:54:05 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-bfe1eb9a-79f6-42f2-a47e-916b6afa2e68 tempest-GroupSnapshotsTest-1023701834 None] Lock "cinder-quobyte-1ada3fe3-e400-4ede-b6fc-483a6e1a097d" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:54:05 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-bfe1eb9a-79f6-42f2-a47e-916b6afa2e68 tempest-GroupSnapshotsTest-1023701834 None] snapshot: 27a011a5-383f-41aa-b522-8849ae3e9ec1, volume: 1ada3fe3-e400-4ede-b6fc-483a6e1a097d,  {{(pid=82485) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 15 15:54:05 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-bfe1eb9a-79f6-42f2-a47e-916b6afa2e68 tempest-GroupSnapshotsTest-1023701834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:54:05 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-bfe1eb9a-79f6-42f2-a47e-916b6afa2e68 tempest-GroupSnapshotsTest-1023701834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:54:05 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-bfe1eb9a-79f6-42f2-a47e-916b6afa2e68 tempest-GroupSnapshotsTest-1023701834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:54:05 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-bfe1eb9a-79f6-42f2-a47e-916b6afa2e68 tempest-GroupSnapshotsTest-1023701834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:54:05 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-bfe1eb9a-79f6-42f2-a47e-916b6afa2e68 tempest-GroupSnapshotsTest-1023701834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:54:05 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[312071b9-6562-4a0b-93cc-9c9203459619]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:54:05 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-bfe1eb9a-79f6-42f2-a47e-916b6afa2e68 tempest-GroupSnapshotsTest-1023701834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8.27a011a5-383f-41aa-b522-8849ae3e9ec1 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:05 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-20f04680-70ec-482c-9d23-e3c6470289de tempest-GroupsV314Test-1965176933 None] Create group from source-group-a64e21c5-610c-458f-81e8-f1864e965590 completed successfully.
Apr 15 15:54:05 devstack sudo[85576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8.27a011a5-383f-41aa-b522-8849ae3e9ec1
Apr 15 15:54:05 devstack sudo[85576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:06 devstack sudo[85576]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:06 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-bfe1eb9a-79f6-42f2-a47e-916b6afa2e68 tempest-GroupSnapshotsTest-1023701834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8.27a011a5-383f-41aa-b522-8849ae3e9ec1" returned: 0 in 0.602s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:06 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-bfe1eb9a-79f6-42f2-a47e-916b6afa2e68 tempest-GroupSnapshotsTest-1023701834 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82485) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 15:54:06 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-bfe1eb9a-79f6-42f2-a47e-916b6afa2e68 tempest-GroupSnapshotsTest-1023701834 None] will copy from snapshot at /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8 {{(pid=82485) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 15 15:54:06 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-bfe1eb9a-79f6-42f2-a47e-916b6afa2e68 tempest-GroupSnapshotsTest-1023701834 None] Creating direct copy from snapshot {{(pid=82485) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 15 15:54:06 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab06ed6-0397-409d-8609-bccc5aad079b]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:54:06 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-bfe1eb9a-79f6-42f2-a47e-916b6afa2e68 tempest-GroupSnapshotsTest-1023701834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:06 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-c82202d6-77e7-4b36-a83a-e44f88b9db77 tempest-GroupsV314Test-1965176933 None] Acquiring lock "cinder-quobyte-0befda97-37c2-4bd6-8e01-7cf8e5b3973c" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:54:06 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-c82202d6-77e7-4b36-a83a-e44f88b9db77 tempest-GroupsV314Test-1965176933 None] Lock "cinder-quobyte-0befda97-37c2-4bd6-8e01-7cf8e5b3973c" acquired by "delete_volume" :: waited 0.009s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:54:06 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[d683a7e1-7b97-480c-901a-0cf17c9993a3]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:54:06 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-c82202d6-77e7-4b36-a83a-e44f88b9db77 tempest-GroupsV314Test-1965176933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-0befda97-37c2-4bd6-8e01-7cf8e5b3973c {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:06 devstack sudo[85593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8
Apr 15 15:54:06 devstack sudo[85593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:06 devstack sudo[85606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-0befda97-37c2-4bd6-8e01-7cf8e5b3973c
Apr 15 15:54:06 devstack sudo[85606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:07 devstack sudo[85593]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:07 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-bfe1eb9a-79f6-42f2-a47e-916b6afa2e68 tempest-GroupSnapshotsTest-1023701834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8" returned: 0 in 0.611s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:07 devstack cinder-volume[82485]: DEBUG cinder.utils [None req-bfe1eb9a-79f6-42f2-a47e-916b6afa2e68 tempest-GroupSnapshotsTest-1023701834 None] Path /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1ada3fe3-e400-4ede-b6fc-483a6e1a097d not found in is_blk_device check {{(pid=82485) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 15 15:54:07 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-bfe1eb9a-79f6-42f2-a47e-916b6afa2e68 tempest-GroupSnapshotsTest-1023701834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1ada3fe3-e400-4ede-b6fc-483a6e1a097d {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:07 devstack sudo[85621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1ada3fe3-e400-4ede-b6fc-483a6e1a097d
Apr 15 15:54:07 devstack sudo[85621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:07 devstack sudo[85606]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:07 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-c82202d6-77e7-4b36-a83a-e44f88b9db77 tempest-GroupsV314Test-1965176933 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-0befda97-37c2-4bd6-8e01-7cf8e5b3973c" returned: 0 in 0.575s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:07 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-c82202d6-77e7-4b36-a83a-e44f88b9db77 tempest-GroupsV314Test-1965176933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-0befda97-37c2-4bd6-8e01-7cf8e5b3973c {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:07 devstack sudo[85634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-0befda97-37c2-4bd6-8e01-7cf8e5b3973c
Apr 15 15:54:07 devstack sudo[85634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:07 devstack sudo[85634]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:07 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-c82202d6-77e7-4b36-a83a-e44f88b9db77 tempest-GroupsV314Test-1965176933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-0befda97-37c2-4bd6-8e01-7cf8e5b3973c" returned: 0 in 0.673s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:07 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-c82202d6-77e7-4b36-a83a-e44f88b9db77 tempest-GroupsV314Test-1965176933 None] Lock "cinder-quobyte-0befda97-37c2-4bd6-8e01-7cf8e5b3973c" released by "delete_volume" :: held 1.291s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:54:07 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-c82202d6-77e7-4b36-a83a-e44f88b9db77 tempest-GroupsV314Test-1965176933 None] Created reservations ['58c03221-570b-4170-be48-e97ff9f08683'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:54:07 devstack cinder-volume[82485]: WARNING cinder.quota [None req-c82202d6-77e7-4b36-a83a-e44f88b9db77 tempest-GroupsV314Test-1965176933 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1782660026 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1782660026, it is now deprecated. Please use the default quota class for default quota.
Apr 15 15:54:07 devstack cinder-volume[82485]: WARNING cinder.quota [None req-c82202d6-77e7-4b36-a83a-e44f88b9db77 tempest-GroupsV314Test-1965176933 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1782660026 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1782660026, it is now deprecated. Please use the default quota class for default quota.
Apr 15 15:54:07 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-c82202d6-77e7-4b36-a83a-e44f88b9db77 tempest-GroupsV314Test-1965176933 None] Created reservations ['b203fdae-7eb6-499a-ab51-253fc21eeba9', '3a4f94e0-4ae3-41ac-bf8f-95bf60fc93a3', 'dbee370c-170b-4f9f-91d0-0a074b358966', '7d45bdf4-29a5-4be7-9992-7b19c6a5b03a'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:54:08 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-c82202d6-77e7-4b36-a83a-e44f88b9db77 tempest-GroupsV314Test-1965176933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:54:08 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-c82202d6-77e7-4b36-a83a-e44f88b9db77 tempest-GroupsV314Test-1965176933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:54:08 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-c82202d6-77e7-4b36-a83a-e44f88b9db77 tempest-GroupsV314Test-1965176933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:54:08 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-c82202d6-77e7-4b36-a83a-e44f88b9db77 tempest-GroupsV314Test-1965176933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:54:08 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-c82202d6-77e7-4b36-a83a-e44f88b9db77 tempest-GroupsV314Test-1965176933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:54:08 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-c82202d6-77e7-4b36-a83a-e44f88b9db77 tempest-GroupsV314Test-1965176933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:08 devstack sudo[85657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:54:08 devstack sudo[85657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:09 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-7dcf56fb-ff29-4020-ae6b-f909bfec0687 tempest-GroupsV314Test-1965176933 None] Acquiring lock "cinder-quobyte-cd004fd3-4d5d-40fe-887d-d9b30bea8a98" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:54:09 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-7dcf56fb-ff29-4020-ae6b-f909bfec0687 tempest-GroupsV314Test-1965176933 None] Lock "cinder-quobyte-cd004fd3-4d5d-40fe-887d-d9b30bea8a98" acquired by "delete_volume" :: waited 0.017s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:54:09 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2477ae8-0109-42e2-9cfc-8b87ca5fb332]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:54:09 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7dcf56fb-ff29-4020-ae6b-f909bfec0687 tempest-GroupsV314Test-1965176933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:09 devstack sudo[85657]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:09 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-c82202d6-77e7-4b36-a83a-e44f88b9db77 tempest-GroupsV314Test-1965176933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 1.635s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:09 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-c82202d6-77e7-4b36-a83a-e44f88b9db77 tempest-GroupsV314Test-1965176933 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:54:09 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-c82202d6-77e7-4b36-a83a-e44f88b9db77 tempest-GroupsV314Test-1965176933 None] Delete group completed successfully.
Apr 15 15:54:09 devstack sudo[85661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98
Apr 15 15:54:09 devstack sudo[85661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:09 devstack sudo[85621]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:09 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-bfe1eb9a-79f6-42f2-a47e-916b6afa2e68 tempest-GroupSnapshotsTest-1023701834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1ada3fe3-e400-4ede-b6fc-483a6e1a097d" returned: 0 in 2.693s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:09 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea5107ce-24e3-4540-b6d4-133fff001144]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:54:09 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-bfe1eb9a-79f6-42f2-a47e-916b6afa2e68 tempest-GroupSnapshotsTest-1023701834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:09 devstack sudo[85663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8
Apr 15 15:54:09 devstack sudo[85663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:10 devstack sudo[85661]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7dcf56fb-ff29-4020-ae6b-f909bfec0687 tempest-GroupsV314Test-1965176933 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98" returned: 0 in 0.560s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7dcf56fb-ff29-4020-ae6b-f909bfec0687 tempest-GroupsV314Test-1965176933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:10 devstack sudo[85670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98
Apr 15 15:54:10 devstack sudo[85670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:10 devstack sudo[85663]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-bfe1eb9a-79f6-42f2-a47e-916b6afa2e68 tempest-GroupSnapshotsTest-1023701834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8" returned: 0 in 0.681s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:10 devstack cinder-volume[82485]: DEBUG cinder.image.image_utils [None req-bfe1eb9a-79f6-42f2-a47e-916b6afa2e68 tempest-GroupSnapshotsTest-1023701834 None] Image conversion details: src /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8, size 1024.00 MB, duration 2.69 sec, destination /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1ada3fe3-e400-4ede-b6fc-483a6e1a097d {{(pid=82485) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 15:54:10 devstack cinder-volume[82485]: INFO cinder.image.image_utils [None req-bfe1eb9a-79f6-42f2-a47e-916b6afa2e68 tempest-GroupSnapshotsTest-1023701834 None] Converted 1024.00 MB image at 380.13 MB/s
Apr 15 15:54:10 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-bfe1eb9a-79f6-42f2-a47e-916b6afa2e68 tempest-GroupSnapshotsTest-1023701834 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1ada3fe3-e400-4ede-b6fc-483a6e1a097d is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 15:54:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-bfe1eb9a-79f6-42f2-a47e-916b6afa2e68 tempest-GroupSnapshotsTest-1023701834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1ada3fe3-e400-4ede-b6fc-483a6e1a097d {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:10 devstack sudo[85677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1ada3fe3-e400-4ede-b6fc-483a6e1a097d
Apr 15 15:54:10 devstack sudo[85677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:10 devstack sudo[85670]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7dcf56fb-ff29-4020-ae6b-f909bfec0687 tempest-GroupsV314Test-1965176933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-cd004fd3-4d5d-40fe-887d-d9b30bea8a98" returned: 0 in 0.471s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:10 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-7dcf56fb-ff29-4020-ae6b-f909bfec0687 tempest-GroupsV314Test-1965176933 None] Lock "cinder-quobyte-cd004fd3-4d5d-40fe-887d-d9b30bea8a98" released by "delete_volume" :: held 1.126s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:54:10 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-7dcf56fb-ff29-4020-ae6b-f909bfec0687 tempest-GroupsV314Test-1965176933 None] Created reservations ['4d18e166-7ecd-440c-8c73-fa9f13fc6af2'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:54:10 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-7dcf56fb-ff29-4020-ae6b-f909bfec0687 tempest-GroupsV314Test-1965176933 None] Created reservations ['0403faab-5e63-4fd9-96ea-448c4c76333a', '99ac049a-9e46-40f5-afef-e0b2059e787d', '1d72d83a-6018-4815-aaa8-35e8a784a3ba', 'b20a1792-0ff3-4a39-9d04-f20559f1f2cf'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:54:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7dcf56fb-ff29-4020-ae6b-f909bfec0687 tempest-GroupsV314Test-1965176933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:54:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7dcf56fb-ff29-4020-ae6b-f909bfec0687 tempest-GroupsV314Test-1965176933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:54:10 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-7dcf56fb-ff29-4020-ae6b-f909bfec0687 tempest-GroupsV314Test-1965176933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:54:10 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-7dcf56fb-ff29-4020-ae6b-f909bfec0687 tempest-GroupsV314Test-1965176933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:54:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7dcf56fb-ff29-4020-ae6b-f909bfec0687 tempest-GroupsV314Test-1965176933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:54:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7dcf56fb-ff29-4020-ae6b-f909bfec0687 tempest-GroupsV314Test-1965176933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:10 devstack sudo[85682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:54:10 devstack sudo[85682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:10 devstack sudo[85677]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-bfe1eb9a-79f6-42f2-a47e-916b6afa2e68 tempest-GroupSnapshotsTest-1023701834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1ada3fe3-e400-4ede-b6fc-483a6e1a097d" returned: 0 in 0.471s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:10 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-bfe1eb9a-79f6-42f2-a47e-916b6afa2e68 tempest-GroupSnapshotsTest-1023701834 None] Lock "cinder-quobyte-1ada3fe3-e400-4ede-b6fc-483a6e1a097d" released by "_copy_volume_from_snapshot" :: held 5.129s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:54:10 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-bfe1eb9a-79f6-42f2-a47e-916b6afa2e68 tempest-GroupSnapshotsTest-1023701834 None] Lock "cinder-quobyte-27a011a5-383f-41aa-b522-8849ae3e9ec1-1ada3fe3-e400-4ede-b6fc-483a6e1a097d" released by "_create_volume_from_snapshot" :: held 5.154s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:54:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-bfe1eb9a-79f6-42f2-a47e-916b6afa2e68 tempest-GroupSnapshotsTest-1023701834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.168s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:54:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-2d43ff39-a294-4cff-b052-3a61dee017f8 tempest-VolumesTransfersTest-1185850073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.405s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:54:10 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-2d43ff39-a294-4cff-b052-3a61dee017f8 tempest-VolumesTransfersTest-1185850073 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:54:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-964062584',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bfe6d0c-2bbd-403b-b7d1-d6744305be1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f85fe21ff584442bfe8bc1a40fe683c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:54:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:54:05Z,use_quota=True,user_id='5cdf3c807db0486d911cd24d5d49b233',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:54:10 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-2d43ff39-a294-4cff-b052-3a61dee017f8 tempest-VolumesTransfersTest-1185850073 None] Creating volume 1bfe6d0c-2bbd-403b-b7d1-d6744305be1c {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:54:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-2d43ff39-a294-4cff-b052-3a61dee017f8 tempest-VolumesTransfersTest-1185850073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:54:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-2d43ff39-a294-4cff-b052-3a61dee017f8 tempest-VolumesTransfersTest-1185850073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:54:10 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-2d43ff39-a294-4cff-b052-3a61dee017f8 tempest-VolumesTransfersTest-1185850073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:54:10 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-2d43ff39-a294-4cff-b052-3a61dee017f8 tempest-VolumesTransfersTest-1185850073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:54:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-2d43ff39-a294-4cff-b052-3a61dee017f8 tempest-VolumesTransfersTest-1185850073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:54:10 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-2d43ff39-a294-4cff-b052-3a61dee017f8 tempest-VolumesTransfersTest-1185850073 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:54:10 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-2d43ff39-a294-4cff-b052-3a61dee017f8 tempest-VolumesTransfersTest-1185850073 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:54:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-2d43ff39-a294-4cff-b052-3a61dee017f8 tempest-VolumesTransfersTest-1185850073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1bfe6d0c-2bbd-403b-b7d1-d6744305be1c 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:10 devstack sudo[85685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1bfe6d0c-2bbd-403b-b7d1-d6744305be1c 1073741824
Apr 15 15:54:10 devstack sudo[85685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:11 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-bfe1eb9a-79f6-42f2-a47e-916b6afa2e68 tempest-GroupSnapshotsTest-1023701834 None] Create group from source-snapshot-80183f21-4a71-4e04-b3d0-2f365ffdb0ff completed successfully.
Apr 15 15:54:11 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-6b9fdec0-be50-4760-ae35-464d4b649bf2 tempest-GroupSnapshotsTest-1023701834 None] Acquiring lock "cinder-quobyte-1ada3fe3-e400-4ede-b6fc-483a6e1a097d" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:54:11 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-6b9fdec0-be50-4760-ae35-464d4b649bf2 tempest-GroupSnapshotsTest-1023701834 None] Lock "cinder-quobyte-1ada3fe3-e400-4ede-b6fc-483a6e1a097d" acquired by "delete_volume" :: waited 0.011s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:54:11 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7af4a3-4d4e-4842-b1fc-4463bf2ab3be]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:54:11 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6b9fdec0-be50-4760-ae35-464d4b649bf2 tempest-GroupSnapshotsTest-1023701834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1ada3fe3-e400-4ede-b6fc-483a6e1a097d {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:11 devstack sudo[85682]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:11 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7dcf56fb-ff29-4020-ae6b-f909bfec0687 tempest-GroupsV314Test-1965176933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.510s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:11 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-7dcf56fb-ff29-4020-ae6b-f909bfec0687 tempest-GroupsV314Test-1965176933 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:54:11 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-7dcf56fb-ff29-4020-ae6b-f909bfec0687 tempest-GroupsV314Test-1965176933 None] Delete group completed successfully.
Apr 15 15:54:11 devstack sudo[85689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1ada3fe3-e400-4ede-b6fc-483a6e1a097d
Apr 15 15:54:11 devstack sudo[85689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:11 devstack sudo[85685]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:11 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-2d43ff39-a294-4cff-b052-3a61dee017f8 tempest-VolumesTransfersTest-1185850073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1bfe6d0c-2bbd-403b-b7d1-d6744305be1c 1073741824" returned: 0 in 0.620s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:11 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-2d43ff39-a294-4cff-b052-3a61dee017f8 tempest-VolumesTransfersTest-1185850073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1bfe6d0c-2bbd-403b-b7d1-d6744305be1c {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:11 devstack sudo[85693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1bfe6d0c-2bbd-403b-b7d1-d6744305be1c
Apr 15 15:54:11 devstack sudo[85693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:11 devstack sudo[85689]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:11 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6b9fdec0-be50-4760-ae35-464d4b649bf2 tempest-GroupSnapshotsTest-1023701834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1ada3fe3-e400-4ede-b6fc-483a6e1a097d" returned: 0 in 0.552s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:11 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6b9fdec0-be50-4760-ae35-464d4b649bf2 tempest-GroupSnapshotsTest-1023701834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1ada3fe3-e400-4ede-b6fc-483a6e1a097d {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:11 devstack sudo[85698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1ada3fe3-e400-4ede-b6fc-483a6e1a097d
Apr 15 15:54:11 devstack sudo[85698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:12 devstack sudo[85693]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-2d43ff39-a294-4cff-b052-3a61dee017f8 tempest-VolumesTransfersTest-1185850073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1bfe6d0c-2bbd-403b-b7d1-d6744305be1c" returned: 0 in 0.449s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:12 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-2d43ff39-a294-4cff-b052-3a61dee017f8 tempest-VolumesTransfersTest-1185850073 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:54:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-2d43ff39-a294-4cff-b052-3a61dee017f8 tempest-VolumesTransfersTest-1185850073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:54:12 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-2d43ff39-a294-4cff-b052-3a61dee017f8 tempest-VolumesTransfersTest-1185850073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c29597a-c733-44f7-b95d-817bf1a9d445) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bfe6d0c-2bbd-403b-b7d1-d6744305be1c', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:12 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-2d43ff39-a294-4cff-b052-3a61dee017f8 tempest-VolumesTransfersTest-1185850073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (549d9fb8-55c6-46b9-b03e-9b5e37f63bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:12 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-2d43ff39-a294-4cff-b052-3a61dee017f8 tempest-VolumesTransfersTest-1185850073 None] Volume volume-1bfe6d0c-2bbd-403b-b7d1-d6744305be1c (1bfe6d0c-2bbd-403b-b7d1-d6744305be1c): created successfully
Apr 15 15:54:12 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-2d43ff39-a294-4cff-b052-3a61dee017f8 tempest-VolumesTransfersTest-1185850073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (549d9fb8-55c6-46b9-b03e-9b5e37f63bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:12 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-2d43ff39-a294-4cff-b052-3a61dee017f8 tempest-VolumesTransfersTest-1185850073 None] Flow 'volume_create_manager' (925a2be0-e466-40f9-8ea4-4a6ca8a1a424) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:54:12 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-2d43ff39-a294-4cff-b052-3a61dee017f8 tempest-VolumesTransfersTest-1185850073 None] Created volume successfully.
Apr 15 15:54:12 devstack sudo[85698]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6b9fdec0-be50-4760-ae35-464d4b649bf2 tempest-GroupSnapshotsTest-1023701834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1ada3fe3-e400-4ede-b6fc-483a6e1a097d" returned: 0 in 0.506s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:12 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-6b9fdec0-be50-4760-ae35-464d4b649bf2 tempest-GroupSnapshotsTest-1023701834 None] Lock "cinder-quobyte-1ada3fe3-e400-4ede-b6fc-483a6e1a097d" released by "delete_volume" :: held 1.109s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:54:12 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-6b9fdec0-be50-4760-ae35-464d4b649bf2 tempest-GroupSnapshotsTest-1023701834 None] Created reservations ['d6c2ec4c-9134-49d4-918b-db5576c62796'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:54:12 devstack cinder-volume[82485]: WARNING cinder.quota [None req-6b9fdec0-be50-4760-ae35-464d4b649bf2 tempest-GroupSnapshotsTest-1023701834 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1857118429 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1857118429, it is now deprecated. Please use the default quota class for default quota.
Apr 15 15:54:12 devstack cinder-volume[82485]: WARNING cinder.quota [None req-6b9fdec0-be50-4760-ae35-464d4b649bf2 tempest-GroupSnapshotsTest-1023701834 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1857118429 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1857118429, it is now deprecated. Please use the default quota class for default quota.
Apr 15 15:54:12 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-6b9fdec0-be50-4760-ae35-464d4b649bf2 tempest-GroupSnapshotsTest-1023701834 None] Created reservations ['758cda27-158c-43d0-97c9-d20e987cd36a', 'aa95cb44-b75d-45ea-b5f5-132c127f9426', 'bcecb7f5-b701-4966-932a-4161a1106ee4', 'd1e48eff-83fc-4d81-b114-366f995ce99b'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:54:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-6b9fdec0-be50-4760-ae35-464d4b649bf2 tempest-GroupSnapshotsTest-1023701834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:54:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-6b9fdec0-be50-4760-ae35-464d4b649bf2 tempest-GroupSnapshotsTest-1023701834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:54:12 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-6b9fdec0-be50-4760-ae35-464d4b649bf2 tempest-GroupSnapshotsTest-1023701834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:54:12 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-6b9fdec0-be50-4760-ae35-464d4b649bf2 tempest-GroupSnapshotsTest-1023701834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:54:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-6b9fdec0-be50-4760-ae35-464d4b649bf2 tempest-GroupSnapshotsTest-1023701834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:54:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6b9fdec0-be50-4760-ae35-464d4b649bf2 tempest-GroupSnapshotsTest-1023701834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:12 devstack sudo[85702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:54:12 devstack sudo[85702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:13 devstack sudo[85702]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:13 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6b9fdec0-be50-4760-ae35-464d4b649bf2 tempest-GroupSnapshotsTest-1023701834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.539s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:13 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-6b9fdec0-be50-4760-ae35-464d4b649bf2 tempest-GroupSnapshotsTest-1023701834 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:54:13 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-6b9fdec0-be50-4760-ae35-464d4b649bf2 tempest-GroupSnapshotsTest-1023701834 None] Delete group completed successfully.
Apr 15 15:54:13 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-716109fc-aca9-4b22-aebb-c5bcf6fc93ee tempest-VolumesTransfersTest-541203538 None] Transfer volume completed successfully.
Apr 15 15:54:13 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-3ad03dce-8252-447a-9a05-8702ea7fb43c tempest-GroupSnapshotsTest-1023701834 None] group_snapshot 80183f21-4a71-4e04-b3d0-2f365ffdb0ff: deleting
Apr 15 15:54:13 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-3ad03dce-8252-447a-9a05-8702ea7fb43c tempest-GroupSnapshotsTest-1023701834 None] group_snapshot 80183f21-4a71-4e04-b3d0-2f365ffdb0ff: deleting {{(pid=82485) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 15 15:54:13 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-3ad03dce-8252-447a-9a05-8702ea7fb43c tempest-GroupSnapshotsTest-1023701834 None] Acquiring lock "cinder-quobyte-86fb75a3-1f34-438d-bd34-a0fddfe21fd8" by "delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:54:13 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-3ad03dce-8252-447a-9a05-8702ea7fb43c tempest-GroupSnapshotsTest-1023701834 None] Lock "cinder-quobyte-86fb75a3-1f34-438d-bd34-a0fddfe21fd8" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:54:13 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-3ad03dce-8252-447a-9a05-8702ea7fb43c tempest-GroupSnapshotsTest-1023701834 None] Acquiring lock "cinder-quobyte-27a011a5-383f-41aa-b522-8849ae3e9ec1" by "_delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:54:13 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-3ad03dce-8252-447a-9a05-8702ea7fb43c tempest-GroupSnapshotsTest-1023701834 None] Lock "cinder-quobyte-27a011a5-383f-41aa-b522-8849ae3e9ec1" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:54:13 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-3ad03dce-8252-447a-9a05-8702ea7fb43c tempest-GroupSnapshotsTest-1023701834 None] Deleting offline snapshot 27a011a5-383f-41aa-b522-8849ae3e9ec1 of volume 86fb75a3-1f34-438d-bd34-a0fddfe21fd8 {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 15:54:13 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-3ad03dce-8252-447a-9a05-8702ea7fb43c tempest-GroupSnapshotsTest-1023701834 None] snapshot_file for this snap is: volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8.27a011a5-383f-41aa-b522-8849ae3e9ec1 {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 15:54:13 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f5d229-25f1-456f-b55a-3f8d45a9e140]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:54:13 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3ad03dce-8252-447a-9a05-8702ea7fb43c tempest-GroupSnapshotsTest-1023701834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8.27a011a5-383f-41aa-b522-8849ae3e9ec1 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:13 devstack sudo[85705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8.27a011a5-383f-41aa-b522-8849ae3e9ec1
Apr 15 15:54:13 devstack sudo[85705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:14 devstack sudo[85705]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:14 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3ad03dce-8252-447a-9a05-8702ea7fb43c tempest-GroupSnapshotsTest-1023701834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8.27a011a5-383f-41aa-b522-8849ae3e9ec1" returned: 0 in 0.642s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:14 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-3ad03dce-8252-447a-9a05-8702ea7fb43c tempest-GroupSnapshotsTest-1023701834 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82485) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 15:54:14 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[f193a983-90dc-4f43-9721-03a90b9761d8]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:54:14 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3ad03dce-8252-447a-9a05-8702ea7fb43c tempest-GroupSnapshotsTest-1023701834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:14 devstack sudo[85710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8
Apr 15 15:54:14 devstack sudo[85710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:14 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-2b787f10-ec06-4f89-b455-fdcfb422d8dd tempest-VolumesTransfersTest-400323404 None] Acquiring lock "cinder-1bfe6d0c-2bbd-403b-b7d1-d6744305be1c-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:54:14 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-2b787f10-ec06-4f89-b455-fdcfb422d8dd tempest-VolumesTransfersTest-400323404 None] Lock "cinder-1bfe6d0c-2bbd-403b-b7d1-d6744305be1c-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:54:14 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-2b787f10-ec06-4f89-b455-fdcfb422d8dd tempest-VolumesTransfersTest-400323404 None] Acquiring lock "cinder-quobyte-1bfe6d0c-2bbd-403b-b7d1-d6744305be1c" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:54:14 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-2b787f10-ec06-4f89-b455-fdcfb422d8dd tempest-VolumesTransfersTest-400323404 None] Lock "cinder-quobyte-1bfe6d0c-2bbd-403b-b7d1-d6744305be1c" acquired by "delete_volume" :: waited 0.007s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:54:14 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaeff6d7-f760-49d9-923e-a7b2984eb50b]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:54:14 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-2b787f10-ec06-4f89-b455-fdcfb422d8dd tempest-VolumesTransfersTest-400323404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1bfe6d0c-2bbd-403b-b7d1-d6744305be1c {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:14 devstack sudo[85713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1bfe6d0c-2bbd-403b-b7d1-d6744305be1c
Apr 15 15:54:14 devstack sudo[85713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:15 devstack sudo[85710]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:15 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3ad03dce-8252-447a-9a05-8702ea7fb43c tempest-GroupSnapshotsTest-1023701834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8" returned: 0 in 0.668s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:15 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3ad03dce-8252-447a-9a05-8702ea7fb43c tempest-GroupSnapshotsTest-1023701834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8.27a011a5-383f-41aa-b522-8849ae3e9ec1 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:15 devstack sudo[85718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8.27a011a5-383f-41aa-b522-8849ae3e9ec1
Apr 15 15:54:15 devstack sudo[85718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:15 devstack sudo[85713]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:15 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-2b787f10-ec06-4f89-b455-fdcfb422d8dd tempest-VolumesTransfersTest-400323404 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1bfe6d0c-2bbd-403b-b7d1-d6744305be1c" returned: 0 in 0.751s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:15 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-2b787f10-ec06-4f89-b455-fdcfb422d8dd tempest-VolumesTransfersTest-400323404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1bfe6d0c-2bbd-403b-b7d1-d6744305be1c {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:15 devstack sudo[85724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1bfe6d0c-2bbd-403b-b7d1-d6744305be1c
Apr 15 15:54:15 devstack sudo[85724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:15 devstack sudo[85718]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:15 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3ad03dce-8252-447a-9a05-8702ea7fb43c tempest-GroupSnapshotsTest-1023701834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8.27a011a5-383f-41aa-b522-8849ae3e9ec1" returned: 0 in 0.638s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:15 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3ad03dce-8252-447a-9a05-8702ea7fb43c tempest-GroupSnapshotsTest-1023701834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8.27a011a5-383f-41aa-b522-8849ae3e9ec1 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:15 devstack sudo[85729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8.27a011a5-383f-41aa-b522-8849ae3e9ec1
Apr 15 15:54:15 devstack sudo[85729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:15 devstack sudo[85724]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:15 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-2b787f10-ec06-4f89-b455-fdcfb422d8dd tempest-VolumesTransfersTest-400323404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1bfe6d0c-2bbd-403b-b7d1-d6744305be1c" returned: 0 in 0.608s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:15 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-2b787f10-ec06-4f89-b455-fdcfb422d8dd tempest-VolumesTransfersTest-400323404 None] Lock "cinder-quobyte-1bfe6d0c-2bbd-403b-b7d1-d6744305be1c" released by "delete_volume" :: held 1.395s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:54:15 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-2b787f10-ec06-4f89-b455-fdcfb422d8dd tempest-VolumesTransfersTest-400323404 None] Created reservations ['ce662095-4695-4f32-8fd0-d0e389f9661b', '0d821412-2462-417b-9bac-cea8c53afc33', 'bc962ea4-191d-43d2-a3a6-3042b8e1205e', '3bf48520-c027-4645-ae73-77f48db16164'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:54:16 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-2b787f10-ec06-4f89-b455-fdcfb422d8dd tempest-VolumesTransfersTest-400323404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:54:16 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-2b787f10-ec06-4f89-b455-fdcfb422d8dd tempest-VolumesTransfersTest-400323404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:54:16 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-2b787f10-ec06-4f89-b455-fdcfb422d8dd tempest-VolumesTransfersTest-400323404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:54:16 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-2b787f10-ec06-4f89-b455-fdcfb422d8dd tempest-VolumesTransfersTest-400323404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:54:16 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-2b787f10-ec06-4f89-b455-fdcfb422d8dd tempest-VolumesTransfersTest-400323404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:54:16 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-2b787f10-ec06-4f89-b455-fdcfb422d8dd tempest-VolumesTransfersTest-400323404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:16 devstack sudo[85732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:54:16 devstack sudo[85732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:16 devstack sudo[85729]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:16 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3ad03dce-8252-447a-9a05-8702ea7fb43c tempest-GroupSnapshotsTest-1023701834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8.27a011a5-383f-41aa-b522-8849ae3e9ec1" returned: 0 in 0.487s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:16 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-3ad03dce-8252-447a-9a05-8702ea7fb43c tempest-GroupSnapshotsTest-1023701834 None] Lock "cinder-quobyte-27a011a5-383f-41aa-b522-8849ae3e9ec1" released by "_delete_snapshot" :: held 2.519s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:54:16 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-3ad03dce-8252-447a-9a05-8702ea7fb43c tempest-GroupSnapshotsTest-1023701834 None] Lock "cinder-quobyte-86fb75a3-1f34-438d-bd34-a0fddfe21fd8" released by "delete_snapshot" :: held 2.541s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:54:16 devstack cinder-volume[82485]: WARNING cinder.quota [None req-3ad03dce-8252-447a-9a05-8702ea7fb43c tempest-GroupSnapshotsTest-1023701834 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1857118429 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1857118429, it is now deprecated. Please use the default quota class for default quota.
Apr 15 15:54:16 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-3ad03dce-8252-447a-9a05-8702ea7fb43c tempest-GroupSnapshotsTest-1023701834 None] Created reservations ['49bf0610-3cea-44b8-9eb7-463bf8813c45', '36ecd160-e179-4b19-b273-b07ff45ff3a2', '060adf15-c682-4273-a837-b6bb1f8e9000', '8f9419ca-f8e1-497e-bab8-7295cde8ffeb'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:54:16 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-3ad03dce-8252-447a-9a05-8702ea7fb43c tempest-GroupSnapshotsTest-1023701834 None] group_snapshot 80183f21-4a71-4e04-b3d0-2f365ffdb0ff: deleted successfully
Apr 15 15:54:16 devstack sudo[85732]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:16 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-2b787f10-ec06-4f89-b455-fdcfb422d8dd tempest-VolumesTransfersTest-400323404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.578s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:16 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-2b787f10-ec06-4f89-b455-fdcfb422d8dd tempest-VolumesTransfersTest-400323404 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:54:16 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-2b787f10-ec06-4f89-b455-fdcfb422d8dd tempest-VolumesTransfersTest-400323404 None] Deleted volume successfully.
Apr 15 15:54:16 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-2b787f10-ec06-4f89-b455-fdcfb422d8dd tempest-VolumesTransfersTest-400323404 None] Lock "cinder-1bfe6d0c-2bbd-403b-b7d1-d6744305be1c-delete_volume" released by "delete_volume" :: held 2.131s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:54:17 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-8603b8d3-5829-4a8f-8685-f08796cdfd01 tempest-VolumesTransfersTest-1185850073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:54:17 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-8603b8d3-5829-4a8f-8685-f08796cdfd01 tempest-VolumesTransfersTest-1185850073 None] Flow 'volume_create_manager' (03d7fad8-8173-47f7-8102-e37c4781ea3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:54:17 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-8603b8d3-5829-4a8f-8685-f08796cdfd01 tempest-VolumesTransfersTest-1185850073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (092de9ab-3e93-4397-a5ae-69ea04943230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:17 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-378bc561-95db-4687-95e6-21b413fbbd73 tempest-GroupSnapshotsTest-1023701834 None] Acquiring lock "cinder-quobyte-86fb75a3-1f34-438d-bd34-a0fddfe21fd8" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:54:17 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-8603b8d3-5829-4a8f-8685-f08796cdfd01 tempest-VolumesTransfersTest-1185850073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (092de9ab-3e93-4397-a5ae-69ea04943230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:54:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1821871507',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e3d0f4d-f65a-4c1b-9521-4f84cc53fbc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f85fe21ff584442bfe8bc1a40fe683c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:54:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:54:17Z,use_quota=True,user_id='5cdf3c807db0486d911cd24d5d49b233',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:17 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-8603b8d3-5829-4a8f-8685-f08796cdfd01 tempest-VolumesTransfersTest-1185850073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a86d8ce-eba8-4baf-bf0a-08975fe31103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:17 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-8603b8d3-5829-4a8f-8685-f08796cdfd01 tempest-VolumesTransfersTest-1185850073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a86d8ce-eba8-4baf-bf0a-08975fe31103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:17 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-8603b8d3-5829-4a8f-8685-f08796cdfd01 tempest-VolumesTransfersTest-1185850073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d026ffc-dcb4-4c25-858a-4a1595c8d659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:17 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-8603b8d3-5829-4a8f-8685-f08796cdfd01 tempest-VolumesTransfersTest-1185850073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d026ffc-dcb4-4c25-858a-4a1595c8d659) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e3d0f4d-f65a-4c1b-9521-4f84cc53fbc4', 'volume_name': 'volume-9e3d0f4d-f65a-4c1b-9521-4f84cc53fbc4', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:17 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-8603b8d3-5829-4a8f-8685-f08796cdfd01 tempest-VolumesTransfersTest-1185850073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (619b1c07-0843-4b6c-8e85-e6e29dc3aebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:17 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-8603b8d3-5829-4a8f-8685-f08796cdfd01 tempest-VolumesTransfersTest-1185850073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (619b1c07-0843-4b6c-8e85-e6e29dc3aebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:17 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-8603b8d3-5829-4a8f-8685-f08796cdfd01 tempest-VolumesTransfersTest-1185850073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84eb522f-e478-4140-9e2f-368b414583f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:17 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-8603b8d3-5829-4a8f-8685-f08796cdfd01 tempest-VolumesTransfersTest-1185850073 None] Volume 9e3d0f4d-f65a-4c1b-9521-4f84cc53fbc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e3d0f4d-f65a-4c1b-9521-4f84cc53fbc4', 'volume_size': 1}
Apr 15 15:54:17 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-8603b8d3-5829-4a8f-8685-f08796cdfd01 tempest-VolumesTransfersTest-1185850073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:54:17 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-8603b8d3-5829-4a8f-8685-f08796cdfd01 tempest-VolumesTransfersTest-1185850073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:54:17 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-8603b8d3-5829-4a8f-8685-f08796cdfd01 tempest-VolumesTransfersTest-1185850073 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:54:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1821871507',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e3d0f4d-f65a-4c1b-9521-4f84cc53fbc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f85fe21ff584442bfe8bc1a40fe683c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:54:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:54:17Z,use_quota=True,user_id='5cdf3c807db0486d911cd24d5d49b233',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:54:17 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-8603b8d3-5829-4a8f-8685-f08796cdfd01 tempest-VolumesTransfersTest-1185850073 None] Creating volume 9e3d0f4d-f65a-4c1b-9521-4f84cc53fbc4 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:54:17 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-8603b8d3-5829-4a8f-8685-f08796cdfd01 tempest-VolumesTransfersTest-1185850073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:54:17 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-8603b8d3-5829-4a8f-8685-f08796cdfd01 tempest-VolumesTransfersTest-1185850073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:54:17 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-8603b8d3-5829-4a8f-8685-f08796cdfd01 tempest-VolumesTransfersTest-1185850073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:54:17 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-8603b8d3-5829-4a8f-8685-f08796cdfd01 tempest-VolumesTransfersTest-1185850073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:54:17 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-8603b8d3-5829-4a8f-8685-f08796cdfd01 tempest-VolumesTransfersTest-1185850073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:54:17 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-8603b8d3-5829-4a8f-8685-f08796cdfd01 tempest-VolumesTransfersTest-1185850073 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:54:17 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-8603b8d3-5829-4a8f-8685-f08796cdfd01 tempest-VolumesTransfersTest-1185850073 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:54:17 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-8603b8d3-5829-4a8f-8685-f08796cdfd01 tempest-VolumesTransfersTest-1185850073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-9e3d0f4d-f65a-4c1b-9521-4f84cc53fbc4 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:17 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-378bc561-95db-4687-95e6-21b413fbbd73 tempest-GroupSnapshotsTest-1023701834 None] Lock "cinder-quobyte-86fb75a3-1f34-438d-bd34-a0fddfe21fd8" acquired by "delete_volume" :: waited 0.077s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:54:17 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1ce723-9a00-4619-b60e-df08172469d3]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:54:17 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-378bc561-95db-4687-95e6-21b413fbbd73 tempest-GroupSnapshotsTest-1023701834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:17 devstack sudo[85751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-9e3d0f4d-f65a-4c1b-9521-4f84cc53fbc4 1073741824
Apr 15 15:54:17 devstack sudo[85751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:17 devstack sudo[85752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8
Apr 15 15:54:17 devstack sudo[85752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:17 devstack sudo[85751]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:17 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-8603b8d3-5829-4a8f-8685-f08796cdfd01 tempest-VolumesTransfersTest-1185850073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-9e3d0f4d-f65a-4c1b-9521-4f84cc53fbc4 1073741824" returned: 0 in 0.648s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:17 devstack sudo[85752]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:17 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-378bc561-95db-4687-95e6-21b413fbbd73 tempest-GroupSnapshotsTest-1023701834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8" returned: 0 in 0.622s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:17 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-378bc561-95db-4687-95e6-21b413fbbd73 tempest-GroupSnapshotsTest-1023701834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:17 devstack sudo[85763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8
Apr 15 15:54:17 devstack sudo[85763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:17 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-8603b8d3-5829-4a8f-8685-f08796cdfd01 tempest-VolumesTransfersTest-1185850073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-9e3d0f4d-f65a-4c1b-9521-4f84cc53fbc4 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:17 devstack sudo[85765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-9e3d0f4d-f65a-4c1b-9521-4f84cc53fbc4
Apr 15 15:54:17 devstack sudo[85765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:18 devstack sudo[85765]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-8603b8d3-5829-4a8f-8685-f08796cdfd01 tempest-VolumesTransfersTest-1185850073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-9e3d0f4d-f65a-4c1b-9521-4f84cc53fbc4" returned: 0 in 0.474s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:18 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-8603b8d3-5829-4a8f-8685-f08796cdfd01 tempest-VolumesTransfersTest-1185850073 None] <== create_volume: return (1160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:54:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-8603b8d3-5829-4a8f-8685-f08796cdfd01 tempest-VolumesTransfersTest-1185850073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.163s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:54:18 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-8603b8d3-5829-4a8f-8685-f08796cdfd01 tempest-VolumesTransfersTest-1185850073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84eb522f-e478-4140-9e2f-368b414583f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e3d0f4d-f65a-4c1b-9521-4f84cc53fbc4', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:18 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-8603b8d3-5829-4a8f-8685-f08796cdfd01 tempest-VolumesTransfersTest-1185850073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ec9737d-3461-4d78-8b53-e476c51d9786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:18 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-8603b8d3-5829-4a8f-8685-f08796cdfd01 tempest-VolumesTransfersTest-1185850073 None] Volume volume-9e3d0f4d-f65a-4c1b-9521-4f84cc53fbc4 (9e3d0f4d-f65a-4c1b-9521-4f84cc53fbc4): created successfully
Apr 15 15:54:18 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-8603b8d3-5829-4a8f-8685-f08796cdfd01 tempest-VolumesTransfersTest-1185850073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ec9737d-3461-4d78-8b53-e476c51d9786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:18 devstack sudo[85763]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:18 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-8603b8d3-5829-4a8f-8685-f08796cdfd01 tempest-VolumesTransfersTest-1185850073 None] Flow 'volume_create_manager' (03d7fad8-8173-47f7-8102-e37c4781ea3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:54:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-378bc561-95db-4687-95e6-21b413fbbd73 tempest-GroupSnapshotsTest-1023701834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-86fb75a3-1f34-438d-bd34-a0fddfe21fd8" returned: 0 in 0.526s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:18 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-8603b8d3-5829-4a8f-8685-f08796cdfd01 tempest-VolumesTransfersTest-1185850073 None] Created volume successfully.
Apr 15 15:54:18 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-378bc561-95db-4687-95e6-21b413fbbd73 tempest-GroupSnapshotsTest-1023701834 None] Lock "cinder-quobyte-86fb75a3-1f34-438d-bd34-a0fddfe21fd8" released by "delete_volume" :: held 1.193s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:54:18 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-378bc561-95db-4687-95e6-21b413fbbd73 tempest-GroupSnapshotsTest-1023701834 None] Created reservations ['4eabfa2b-d033-428d-81e1-57fcd6f50e83'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:54:18 devstack cinder-volume[82485]: WARNING cinder.db.sqlalchemy.api [None req-378bc561-95db-4687-95e6-21b413fbbd73 tempest-GroupSnapshotsTest-1023701834 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1857118429']
Apr 15 15:54:18 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-378bc561-95db-4687-95e6-21b413fbbd73 tempest-GroupSnapshotsTest-1023701834 None] Created reservations ['46f7cf73-b03a-4f8c-b31f-3419eaeb2ee9', '112eace1-5dc3-4736-a00e-0eaeef7aa59e', '991aec85-53a8-488d-b5e7-e053631d4235', 'c49c5628-cbe0-4754-b585-6a689c100b28'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:54:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-378bc561-95db-4687-95e6-21b413fbbd73 tempest-GroupSnapshotsTest-1023701834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:54:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-378bc561-95db-4687-95e6-21b413fbbd73 tempest-GroupSnapshotsTest-1023701834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:54:18 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-378bc561-95db-4687-95e6-21b413fbbd73 tempest-GroupSnapshotsTest-1023701834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:54:18 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-378bc561-95db-4687-95e6-21b413fbbd73 tempest-GroupSnapshotsTest-1023701834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:54:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-378bc561-95db-4687-95e6-21b413fbbd73 tempest-GroupSnapshotsTest-1023701834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:54:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-378bc561-95db-4687-95e6-21b413fbbd73 tempest-GroupSnapshotsTest-1023701834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:18 devstack sudo[85769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:54:18 devstack sudo[85769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:18 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3a79403-7776-481e-ac51-47f2f487eb59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:54:18 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-e3a79403-7776-481e-ac51-47f2f487eb59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Flow 'volume_create_manager' (70bbc714-38d1-4f6e-ba88-6c922bd42386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:54:18 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-e3a79403-7776-481e-ac51-47f2f487eb59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e043ffc-3c0c-438d-81d8-a0a69c438240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:18 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-e3a79403-7776-481e-ac51-47f2f487eb59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e043ffc-3c0c-438d-81d8-a0a69c438240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:54:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-42544418',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f78522d-8e87-4fb8-ba20-df22f262ccdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6aac6f4ba3534587b33caf1fea81c438',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:54:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:54:19Z,use_quota=True,user_id='2b08435d27d7427c961f71d943ecb533',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:18 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-e3a79403-7776-481e-ac51-47f2f487eb59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4982ae9e-234e-4497-852f-b6ccdb988b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:18 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-e3a79403-7776-481e-ac51-47f2f487eb59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4982ae9e-234e-4497-852f-b6ccdb988b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:18 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-e3a79403-7776-481e-ac51-47f2f487eb59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1824983e-865a-4e05-b9f0-099216347433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:18 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-e3a79403-7776-481e-ac51-47f2f487eb59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1824983e-865a-4e05-b9f0-099216347433) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f78522d-8e87-4fb8-ba20-df22f262ccdb', 'volume_name': 'volume-6f78522d-8e87-4fb8-ba20-df22f262ccdb', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:18 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-e3a79403-7776-481e-ac51-47f2f487eb59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61300a1a-f14f-4dce-aa4d-6a2f9b6b390b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:18 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-e3a79403-7776-481e-ac51-47f2f487eb59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61300a1a-f14f-4dce-aa4d-6a2f9b6b390b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:18 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-e3a79403-7776-481e-ac51-47f2f487eb59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d7f1670-192e-40ee-a744-2fa6ad4366ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:18 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-e3a79403-7776-481e-ac51-47f2f487eb59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Volume 6f78522d-8e87-4fb8-ba20-df22f262ccdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f78522d-8e87-4fb8-ba20-df22f262ccdb', 'volume_size': 1}
Apr 15 15:54:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-e3a79403-7776-481e-ac51-47f2f487eb59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:54:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-e3a79403-7776-481e-ac51-47f2f487eb59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:54:18 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-e3a79403-7776-481e-ac51-47f2f487eb59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:54:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-42544418',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f78522d-8e87-4fb8-ba20-df22f262ccdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6aac6f4ba3534587b33caf1fea81c438',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:54:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:54:19Z,use_quota=True,user_id='2b08435d27d7427c961f71d943ecb533',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:54:18 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-e3a79403-7776-481e-ac51-47f2f487eb59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Creating volume 6f78522d-8e87-4fb8-ba20-df22f262ccdb {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:54:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-e3a79403-7776-481e-ac51-47f2f487eb59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:54:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-e3a79403-7776-481e-ac51-47f2f487eb59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:54:18 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-e3a79403-7776-481e-ac51-47f2f487eb59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:54:18 devstack sudo[85769]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:18 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-e3a79403-7776-481e-ac51-47f2f487eb59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:54:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-e3a79403-7776-481e-ac51-47f2f487eb59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:54:18 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-e3a79403-7776-481e-ac51-47f2f487eb59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:54:18 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-e3a79403-7776-481e-ac51-47f2f487eb59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:54:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-e3a79403-7776-481e-ac51-47f2f487eb59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6f78522d-8e87-4fb8-ba20-df22f262ccdb 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-378bc561-95db-4687-95e6-21b413fbbd73 tempest-GroupSnapshotsTest-1023701834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.500s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:18 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-378bc561-95db-4687-95e6-21b413fbbd73 tempest-GroupSnapshotsTest-1023701834 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:54:18 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-378bc561-95db-4687-95e6-21b413fbbd73 tempest-GroupSnapshotsTest-1023701834 None] Delete group completed successfully.
Apr 15 15:54:18 devstack sudo[85772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6f78522d-8e87-4fb8-ba20-df22f262ccdb 1073741824
Apr 15 15:54:18 devstack sudo[85772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:19 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-dd16634f-64e5-41d3-a473-b281e4aa2abb tempest-VolumesTransfersTest-400323404 None] Acquiring lock "cinder-9e3d0f4d-f65a-4c1b-9521-4f84cc53fbc4-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:54:19 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-dd16634f-64e5-41d3-a473-b281e4aa2abb tempest-VolumesTransfersTest-400323404 None] Lock "cinder-9e3d0f4d-f65a-4c1b-9521-4f84cc53fbc4-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:54:19 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-dd16634f-64e5-41d3-a473-b281e4aa2abb tempest-VolumesTransfersTest-400323404 None] Acquiring lock "cinder-quobyte-9e3d0f4d-f65a-4c1b-9521-4f84cc53fbc4" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:54:19 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-dd16634f-64e5-41d3-a473-b281e4aa2abb tempest-VolumesTransfersTest-400323404 None] Lock "cinder-quobyte-9e3d0f4d-f65a-4c1b-9521-4f84cc53fbc4" acquired by "delete_volume" :: waited 0.009s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:54:19 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[284d2f30-fef8-477b-998e-d2e487e0b79b]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:54:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-dd16634f-64e5-41d3-a473-b281e4aa2abb tempest-VolumesTransfersTest-400323404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-9e3d0f4d-f65a-4c1b-9521-4f84cc53fbc4 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:19 devstack sudo[85777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-9e3d0f4d-f65a-4c1b-9521-4f84cc53fbc4
Apr 15 15:54:19 devstack sudo[85777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:19 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-d5a66076-6bbf-4e3a-9e7c-2e28060e0b16 tempest-GroupSnapshotsTest-1023701834 None] Group tempest-GroupSnapshotsTest-Group-486049961: creating
Apr 15 15:54:19 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-d5a66076-6bbf-4e3a-9e7c-2e28060e0b16 tempest-GroupSnapshotsTest-1023701834 None] Group tempest-GroupSnapshotsTest-Group-486049961: created successfully
Apr 15 15:54:19 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-d5a66076-6bbf-4e3a-9e7c-2e28060e0b16 tempest-GroupSnapshotsTest-1023701834 None] Create group completed successfully.
Apr 15 15:54:19 devstack sudo[85772]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-e3a79403-7776-481e-ac51-47f2f487eb59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6f78522d-8e87-4fb8-ba20-df22f262ccdb 1073741824" returned: 0 in 0.639s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-e3a79403-7776-481e-ac51-47f2f487eb59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6f78522d-8e87-4fb8-ba20-df22f262ccdb {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:19 devstack sudo[85782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6f78522d-8e87-4fb8-ba20-df22f262ccdb
Apr 15 15:54:19 devstack sudo[85782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:19 devstack sudo[85777]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-dd16634f-64e5-41d3-a473-b281e4aa2abb tempest-VolumesTransfersTest-400323404 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-9e3d0f4d-f65a-4c1b-9521-4f84cc53fbc4" returned: 0 in 0.574s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-dd16634f-64e5-41d3-a473-b281e4aa2abb tempest-VolumesTransfersTest-400323404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-9e3d0f4d-f65a-4c1b-9521-4f84cc53fbc4 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:20 devstack sudo[85788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-9e3d0f4d-f65a-4c1b-9521-4f84cc53fbc4
Apr 15 15:54:20 devstack sudo[85788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:20 devstack sudo[85782]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:20 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-e3a79403-7776-481e-ac51-47f2f487eb59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6f78522d-8e87-4fb8-ba20-df22f262ccdb" returned: 0 in 0.417s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:20 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-e3a79403-7776-481e-ac51-47f2f487eb59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:54:20 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-e3a79403-7776-481e-ac51-47f2f487eb59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:54:20 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-e3a79403-7776-481e-ac51-47f2f487eb59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d7f1670-192e-40ee-a744-2fa6ad4366ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f78522d-8e87-4fb8-ba20-df22f262ccdb', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:20 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-e3a79403-7776-481e-ac51-47f2f487eb59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32c3f204-0c0d-4cab-9259-acbc8e32bcbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:20 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-e3a79403-7776-481e-ac51-47f2f487eb59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Volume volume-6f78522d-8e87-4fb8-ba20-df22f262ccdb (6f78522d-8e87-4fb8-ba20-df22f262ccdb): created successfully
Apr 15 15:54:20 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-e3a79403-7776-481e-ac51-47f2f487eb59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32c3f204-0c0d-4cab-9259-acbc8e32bcbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:20 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-e3a79403-7776-481e-ac51-47f2f487eb59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Flow 'volume_create_manager' (70bbc714-38d1-4f6e-ba88-6c922bd42386) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:54:20 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-e3a79403-7776-481e-ac51-47f2f487eb59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Created volume successfully.
Apr 15 15:54:20 devstack sudo[85788]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:20 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-dd16634f-64e5-41d3-a473-b281e4aa2abb tempest-VolumesTransfersTest-400323404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-9e3d0f4d-f65a-4c1b-9521-4f84cc53fbc4" returned: 0 in 0.425s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:20 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-dd16634f-64e5-41d3-a473-b281e4aa2abb tempest-VolumesTransfersTest-400323404 None] Lock "cinder-quobyte-9e3d0f4d-f65a-4c1b-9521-4f84cc53fbc4" released by "delete_volume" :: held 1.043s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:54:20 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-dd16634f-64e5-41d3-a473-b281e4aa2abb tempest-VolumesTransfersTest-400323404 None] Created reservations ['7f535639-3bde-421c-8bee-c0709e535c06', '7ab0b89b-a2d7-4f36-ba79-7702a956bd13', 'de73f2eb-9bc4-49ab-89a8-15f7f9cf0e29', 'ac1f6b1d-55fc-4ed2-8e37-24c90e9e62bb'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:54:20 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-dd16634f-64e5-41d3-a473-b281e4aa2abb tempest-VolumesTransfersTest-400323404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:54:20 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-dd16634f-64e5-41d3-a473-b281e4aa2abb tempest-VolumesTransfersTest-400323404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:54:20 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-dd16634f-64e5-41d3-a473-b281e4aa2abb tempest-VolumesTransfersTest-400323404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:54:20 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-dd16634f-64e5-41d3-a473-b281e4aa2abb tempest-VolumesTransfersTest-400323404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:54:20 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-dd16634f-64e5-41d3-a473-b281e4aa2abb tempest-VolumesTransfersTest-400323404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:54:20 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-dd16634f-64e5-41d3-a473-b281e4aa2abb tempest-VolumesTransfersTest-400323404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:20 devstack sudo[85791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:54:20 devstack sudo[85791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:20 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b860acd-de76-4035-870e-79a22bcca85b tempest-GroupSnapshotsTest-1023701834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:54:20 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7b860acd-de76-4035-870e-79a22bcca85b tempest-GroupSnapshotsTest-1023701834 None] Flow 'volume_create_manager' (f0e62969-6930-4e7f-bd12-a685978aa89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:54:20 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7b860acd-de76-4035-870e-79a22bcca85b tempest-GroupSnapshotsTest-1023701834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02df668e-2748-4fa4-a15f-dc6d82ef66fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:20 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7b860acd-de76-4035-870e-79a22bcca85b tempest-GroupSnapshotsTest-1023701834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02df668e-2748-4fa4-a15f-dc6d82ef66fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:54:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1937887119',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=581e31fd-5b92-470c-b0dc-abc7bed6e96a,host='devstack@QuobyteHD#QuobyteHD',id=ae7fddf4-96da-41c3-85a9-816bc0db8cd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fce0dc69f99342178f01ef06e0beb61c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:54:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:54:21Z,use_quota=True,user_id='065979835d994434a62276753eaa5fcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a2f94b00-0c21-475a-a1ce-060b49a79a4a),volume_type_id=a2f94b00-0c21-475a-a1ce-060b49a79a4a)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:20 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7b860acd-de76-4035-870e-79a22bcca85b tempest-GroupSnapshotsTest-1023701834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a8367e2-8c91-43ef-9c19-9a61524c0568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:20 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7b860acd-de76-4035-870e-79a22bcca85b tempest-GroupSnapshotsTest-1023701834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a8367e2-8c91-43ef-9c19-9a61524c0568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:20 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7b860acd-de76-4035-870e-79a22bcca85b tempest-GroupSnapshotsTest-1023701834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b08891cc-ce81-4c91-ae89-7ca097faa2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:20 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7b860acd-de76-4035-870e-79a22bcca85b tempest-GroupSnapshotsTest-1023701834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b08891cc-ce81-4c91-ae89-7ca097faa2b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae7fddf4-96da-41c3-85a9-816bc0db8cd4', 'volume_name': 'volume-ae7fddf4-96da-41c3-85a9-816bc0db8cd4', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:20 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7b860acd-de76-4035-870e-79a22bcca85b tempest-GroupSnapshotsTest-1023701834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf19c41c-2dfe-4114-bbb5-4ed0fbecfdc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:20 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7b860acd-de76-4035-870e-79a22bcca85b tempest-GroupSnapshotsTest-1023701834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf19c41c-2dfe-4114-bbb5-4ed0fbecfdc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:20 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7b860acd-de76-4035-870e-79a22bcca85b tempest-GroupSnapshotsTest-1023701834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68608113-000f-4e5f-b64d-b6a5141ec607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:20 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-7b860acd-de76-4035-870e-79a22bcca85b tempest-GroupSnapshotsTest-1023701834 None] Volume ae7fddf4-96da-41c3-85a9-816bc0db8cd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae7fddf4-96da-41c3-85a9-816bc0db8cd4', 'volume_size': 1}
Apr 15 15:54:20 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7b860acd-de76-4035-870e-79a22bcca85b tempest-GroupSnapshotsTest-1023701834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:54:20 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7b860acd-de76-4035-870e-79a22bcca85b tempest-GroupSnapshotsTest-1023701834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:54:20 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-7b860acd-de76-4035-870e-79a22bcca85b tempest-GroupSnapshotsTest-1023701834 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=581e31fd-5b92-470c-b0dc-abc7bed6e96a,created_at=2026-04-15T13:54:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1937887119',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=581e31fd-5b92-470c-b0dc-abc7bed6e96a,host='devstack@QuobyteHD#QuobyteHD',id=ae7fddf4-96da-41c3-85a9-816bc0db8cd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fce0dc69f99342178f01ef06e0beb61c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:54:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:54:21Z,use_quota=True,user_id='065979835d994434a62276753eaa5fcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a2f94b00-0c21-475a-a1ce-060b49a79a4a),volume_type_id=a2f94b00-0c21-475a-a1ce-060b49a79a4a)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:54:20 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-7b860acd-de76-4035-870e-79a22bcca85b tempest-GroupSnapshotsTest-1023701834 None] Creating volume ae7fddf4-96da-41c3-85a9-816bc0db8cd4 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:54:20 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7b860acd-de76-4035-870e-79a22bcca85b tempest-GroupSnapshotsTest-1023701834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:54:20 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7b860acd-de76-4035-870e-79a22bcca85b tempest-GroupSnapshotsTest-1023701834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:54:20 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-7b860acd-de76-4035-870e-79a22bcca85b tempest-GroupSnapshotsTest-1023701834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:54:20 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-7b860acd-de76-4035-870e-79a22bcca85b tempest-GroupSnapshotsTest-1023701834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:54:20 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7b860acd-de76-4035-870e-79a22bcca85b tempest-GroupSnapshotsTest-1023701834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:54:20 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-7b860acd-de76-4035-870e-79a22bcca85b tempest-GroupSnapshotsTest-1023701834 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:54:20 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-7b860acd-de76-4035-870e-79a22bcca85b tempest-GroupSnapshotsTest-1023701834 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:54:20 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7b860acd-de76-4035-870e-79a22bcca85b tempest-GroupSnapshotsTest-1023701834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ae7fddf4-96da-41c3-85a9-816bc0db8cd4 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:20 devstack sudo[85801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ae7fddf4-96da-41c3-85a9-816bc0db8cd4 1073741824
Apr 15 15:54:20 devstack sudo[85801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:21 devstack sudo[85791]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-dd16634f-64e5-41d3-a473-b281e4aa2abb tempest-VolumesTransfersTest-400323404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.535s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:21 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-dd16634f-64e5-41d3-a473-b281e4aa2abb tempest-VolumesTransfersTest-400323404 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:54:21 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-dd16634f-64e5-41d3-a473-b281e4aa2abb tempest-VolumesTransfersTest-400323404 None] Deleted volume successfully.
Apr 15 15:54:21 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-dd16634f-64e5-41d3-a473-b281e4aa2abb tempest-VolumesTransfersTest-400323404 None] Lock "cinder-9e3d0f4d-f65a-4c1b-9521-4f84cc53fbc4-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:54:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-9f3bf87d-69bf-4fea-967f-4fb6fa1a01ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:54:21 devstack sudo[85801]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7b860acd-de76-4035-870e-79a22bcca85b tempest-GroupSnapshotsTest-1023701834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ae7fddf4-96da-41c3-85a9-816bc0db8cd4 1073741824" returned: 0 in 0.863s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7b860acd-de76-4035-870e-79a22bcca85b tempest-GroupSnapshotsTest-1023701834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ae7fddf4-96da-41c3-85a9-816bc0db8cd4 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:21 devstack sudo[85835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ae7fddf4-96da-41c3-85a9-816bc0db8cd4
Apr 15 15:54:21 devstack sudo[85835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:22 devstack sudo[85835]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:22 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7b860acd-de76-4035-870e-79a22bcca85b tempest-GroupSnapshotsTest-1023701834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ae7fddf4-96da-41c3-85a9-816bc0db8cd4" returned: 0 in 0.546s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:22 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-7b860acd-de76-4035-870e-79a22bcca85b tempest-GroupSnapshotsTest-1023701834 None] <== create_volume: return (1450ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:54:22 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7b860acd-de76-4035-870e-79a22bcca85b tempest-GroupSnapshotsTest-1023701834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.452s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:54:22 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-9f3bf87d-69bf-4fea-967f-4fb6fa1a01ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.166s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:54:22 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7b860acd-de76-4035-870e-79a22bcca85b tempest-GroupSnapshotsTest-1023701834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68608113-000f-4e5f-b64d-b6a5141ec607) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae7fddf4-96da-41c3-85a9-816bc0db8cd4', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:22 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7b860acd-de76-4035-870e-79a22bcca85b tempest-GroupSnapshotsTest-1023701834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa64d0aa-aea4-4205-b9e4-e269fdfc75e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:22 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-9f3bf87d-69bf-4fea-967f-4fb6fa1a01ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Creating offline snapshot 43c72950-2f7f-4ade-9a30-d92729247464 of volume 6f78522d-8e87-4fb8-ba20-df22f262ccdb {{(pid=82485) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 15:54:22 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-7b860acd-de76-4035-870e-79a22bcca85b tempest-GroupSnapshotsTest-1023701834 None] Volume volume-ae7fddf4-96da-41c3-85a9-816bc0db8cd4 (ae7fddf4-96da-41c3-85a9-816bc0db8cd4): created successfully
Apr 15 15:54:22 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7b860acd-de76-4035-870e-79a22bcca85b tempest-GroupSnapshotsTest-1023701834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa64d0aa-aea4-4205-b9e4-e269fdfc75e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:22 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7b860acd-de76-4035-870e-79a22bcca85b tempest-GroupSnapshotsTest-1023701834 None] Flow 'volume_create_manager' (f0e62969-6930-4e7f-bd12-a685978aa89d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:54:22 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27dacba-41ac-4920-8918-ec5cc7d998d2]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:54:22 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9f3bf87d-69bf-4fea-967f-4fb6fa1a01ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6f78522d-8e87-4fb8-ba20-df22f262ccdb {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:22 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-7b860acd-de76-4035-870e-79a22bcca85b tempest-GroupSnapshotsTest-1023701834 None] Created volume successfully.
Apr 15 15:54:22 devstack sudo[85838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6f78522d-8e87-4fb8-ba20-df22f262ccdb
Apr 15 15:54:22 devstack sudo[85838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:23 devstack sudo[85838]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:23 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9f3bf87d-69bf-4fea-967f-4fb6fa1a01ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6f78522d-8e87-4fb8-ba20-df22f262ccdb" returned: 0 in 0.704s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:23 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9f3bf87d-69bf-4fea-967f-4fb6fa1a01ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6f78522d-8e87-4fb8-ba20-df22f262ccdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6f78522d-8e87-4fb8-ba20-df22f262ccdb.43c72950-2f7f-4ade-9a30-d92729247464 1G {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:23 devstack sudo[85843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6f78522d-8e87-4fb8-ba20-df22f262ccdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6f78522d-8e87-4fb8-ba20-df22f262ccdb.43c72950-2f7f-4ade-9a30-d92729247464 1G
Apr 15 15:54:23 devstack sudo[85843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:23 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-247c5854-2fab-4d4f-bb38-32900a9ade4e tempest-GroupSnapshotsTest-1023701834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:54:23 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-247c5854-2fab-4d4f-bb38-32900a9ade4e tempest-GroupSnapshotsTest-1023701834 None] Flow 'volume_create_manager' (a5a16bb8-f73c-4c75-b81c-8fbd46b2b0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:54:23 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-247c5854-2fab-4d4f-bb38-32900a9ade4e tempest-GroupSnapshotsTest-1023701834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fe8c611-365b-4c09-bc50-a7e82040c5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:23 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-247c5854-2fab-4d4f-bb38-32900a9ade4e tempest-GroupSnapshotsTest-1023701834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fe8c611-365b-4c09-bc50-a7e82040c5ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-773872415',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=581e31fd-5b92-470c-b0dc-abc7bed6e96a,host='devstack@QuobyteHD#QuobyteHD',id=b9d72d14-2a39-47e0-ac1d-83dd05a84ced,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fce0dc69f99342178f01ef06e0beb61c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:54:23Z,use_quota=True,user_id='065979835d994434a62276753eaa5fcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a2f94b00-0c21-475a-a1ce-060b49a79a4a),volume_type_id=a2f94b00-0c21-475a-a1ce-060b49a79a4a)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:23 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-247c5854-2fab-4d4f-bb38-32900a9ade4e tempest-GroupSnapshotsTest-1023701834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (469ae009-1698-4ef5-956f-b95e3af62046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:23 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-247c5854-2fab-4d4f-bb38-32900a9ade4e tempest-GroupSnapshotsTest-1023701834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (469ae009-1698-4ef5-956f-b95e3af62046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:23 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-247c5854-2fab-4d4f-bb38-32900a9ade4e tempest-GroupSnapshotsTest-1023701834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (844efe58-8eaf-4ba6-8d09-24575f1eadc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:23 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-247c5854-2fab-4d4f-bb38-32900a9ade4e tempest-GroupSnapshotsTest-1023701834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (844efe58-8eaf-4ba6-8d09-24575f1eadc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9d72d14-2a39-47e0-ac1d-83dd05a84ced', 'volume_name': 'volume-b9d72d14-2a39-47e0-ac1d-83dd05a84ced', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:23 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-247c5854-2fab-4d4f-bb38-32900a9ade4e tempest-GroupSnapshotsTest-1023701834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03a8aa9b-b2b4-4903-980e-f4a201487350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:23 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-247c5854-2fab-4d4f-bb38-32900a9ade4e tempest-GroupSnapshotsTest-1023701834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03a8aa9b-b2b4-4903-980e-f4a201487350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:23 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-247c5854-2fab-4d4f-bb38-32900a9ade4e tempest-GroupSnapshotsTest-1023701834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecb7d74a-b360-4002-b241-18b5845065af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:23 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-247c5854-2fab-4d4f-bb38-32900a9ade4e tempest-GroupSnapshotsTest-1023701834 None] Volume b9d72d14-2a39-47e0-ac1d-83dd05a84ced: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9d72d14-2a39-47e0-ac1d-83dd05a84ced', 'volume_size': 1}
Apr 15 15:54:23 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-247c5854-2fab-4d4f-bb38-32900a9ade4e tempest-GroupSnapshotsTest-1023701834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:54:23 devstack sudo[85843]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:23 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9f3bf87d-69bf-4fea-967f-4fb6fa1a01ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6f78522d-8e87-4fb8-ba20-df22f262ccdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6f78522d-8e87-4fb8-ba20-df22f262ccdb.43c72950-2f7f-4ade-9a30-d92729247464 1G" returned: 0 in 0.576s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:23 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9f3bf87d-69bf-4fea-967f-4fb6fa1a01ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f78522d-8e87-4fb8-ba20-df22f262ccdb -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6f78522d-8e87-4fb8-ba20-df22f262ccdb.43c72950-2f7f-4ade-9a30-d92729247464 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:23 devstack sudo[85849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f78522d-8e87-4fb8-ba20-df22f262ccdb -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6f78522d-8e87-4fb8-ba20-df22f262ccdb.43c72950-2f7f-4ade-9a30-d92729247464
Apr 15 15:54:23 devstack sudo[85849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:24 devstack sudo[85849]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:24 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9f3bf87d-69bf-4fea-967f-4fb6fa1a01ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f78522d-8e87-4fb8-ba20-df22f262ccdb -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6f78522d-8e87-4fb8-ba20-df22f262ccdb.43c72950-2f7f-4ade-9a30-d92729247464" returned: 0 in 0.585s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:24 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-9f3bf87d-69bf-4fea-967f-4fb6fa1a01ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6f78522d-8e87-4fb8-ba20-df22f262ccdb.43c72950-2f7f-4ade-9a30-d92729247464 is being set with open permissions: ugo+rw
Apr 15 15:54:24 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9f3bf87d-69bf-4fea-967f-4fb6fa1a01ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6f78522d-8e87-4fb8-ba20-df22f262ccdb.43c72950-2f7f-4ade-9a30-d92729247464 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:24 devstack sudo[85854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6f78522d-8e87-4fb8-ba20-df22f262ccdb.43c72950-2f7f-4ade-9a30-d92729247464
Apr 15 15:54:24 devstack sudo[85854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:24 devstack sudo[85854]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:24 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9f3bf87d-69bf-4fea-967f-4fb6fa1a01ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6f78522d-8e87-4fb8-ba20-df22f262ccdb.43c72950-2f7f-4ade-9a30-d92729247464" returned: 0 in 0.551s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:24 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9f3bf87d-69bf-4fea-967f-4fb6fa1a01ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6f78522d-8e87-4fb8-ba20-df22f262ccdb.info {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:24 devstack sudo[85859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6f78522d-8e87-4fb8-ba20-df22f262ccdb.info
Apr 15 15:54:24 devstack sudo[85859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:25 devstack sudo[85859]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:25 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9f3bf87d-69bf-4fea-967f-4fb6fa1a01ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6f78522d-8e87-4fb8-ba20-df22f262ccdb.info" returned: 0 in 0.467s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:25 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-9f3bf87d-69bf-4fea-967f-4fb6fa1a01ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6f78522d-8e87-4fb8-ba20-df22f262ccdb.info is being set with open permissions: ugo+rw
Apr 15 15:54:25 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9f3bf87d-69bf-4fea-967f-4fb6fa1a01ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6f78522d-8e87-4fb8-ba20-df22f262ccdb.info {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:25 devstack sudo[85862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6f78522d-8e87-4fb8-ba20-df22f262ccdb.info
Apr 15 15:54:25 devstack sudo[85862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:25 devstack sudo[85862]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:25 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9f3bf87d-69bf-4fea-967f-4fb6fa1a01ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6f78522d-8e87-4fb8-ba20-df22f262ccdb.info" returned: 0 in 0.451s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:25 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-9f3bf87d-69bf-4fea-967f-4fb6fa1a01ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.426s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:54:25 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-247c5854-2fab-4d4f-bb38-32900a9ade4e tempest-GroupSnapshotsTest-1023701834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.298s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:54:25 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-247c5854-2fab-4d4f-bb38-32900a9ade4e tempest-GroupSnapshotsTest-1023701834 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=581e31fd-5b92-470c-b0dc-abc7bed6e96a,created_at=2026-04-15T13:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-773872415',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=581e31fd-5b92-470c-b0dc-abc7bed6e96a,host='devstack@QuobyteHD#QuobyteHD',id=b9d72d14-2a39-47e0-ac1d-83dd05a84ced,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fce0dc69f99342178f01ef06e0beb61c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:54:23Z,use_quota=True,user_id='065979835d994434a62276753eaa5fcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a2f94b00-0c21-475a-a1ce-060b49a79a4a),volume_type_id=a2f94b00-0c21-475a-a1ce-060b49a79a4a)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:54:25 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-247c5854-2fab-4d4f-bb38-32900a9ade4e tempest-GroupSnapshotsTest-1023701834 None] Creating volume b9d72d14-2a39-47e0-ac1d-83dd05a84ced {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:54:25 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-247c5854-2fab-4d4f-bb38-32900a9ade4e tempest-GroupSnapshotsTest-1023701834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:54:25 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-247c5854-2fab-4d4f-bb38-32900a9ade4e tempest-GroupSnapshotsTest-1023701834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:54:25 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-247c5854-2fab-4d4f-bb38-32900a9ade4e tempest-GroupSnapshotsTest-1023701834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:54:25 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-247c5854-2fab-4d4f-bb38-32900a9ade4e tempest-GroupSnapshotsTest-1023701834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:54:25 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-247c5854-2fab-4d4f-bb38-32900a9ade4e tempest-GroupSnapshotsTest-1023701834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:54:25 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-247c5854-2fab-4d4f-bb38-32900a9ade4e tempest-GroupSnapshotsTest-1023701834 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:54:25 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-247c5854-2fab-4d4f-bb38-32900a9ade4e tempest-GroupSnapshotsTest-1023701834 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:54:25 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-247c5854-2fab-4d4f-bb38-32900a9ade4e tempest-GroupSnapshotsTest-1023701834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b9d72d14-2a39-47e0-ac1d-83dd05a84ced 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:25 devstack sudo[85865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b9d72d14-2a39-47e0-ac1d-83dd05a84ced 1073741824
Apr 15 15:54:25 devstack sudo[85865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:25 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-9f3bf87d-69bf-4fea-967f-4fb6fa1a01ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Create snapshot completed successfully
Apr 15 15:54:26 devstack sudo[85865]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-247c5854-2fab-4d4f-bb38-32900a9ade4e tempest-GroupSnapshotsTest-1023701834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b9d72d14-2a39-47e0-ac1d-83dd05a84ced 1073741824" returned: 0 in 0.644s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-247c5854-2fab-4d4f-bb38-32900a9ade4e tempest-GroupSnapshotsTest-1023701834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b9d72d14-2a39-47e0-ac1d-83dd05a84ced {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:26 devstack sudo[85870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b9d72d14-2a39-47e0-ac1d-83dd05a84ced
Apr 15 15:54:26 devstack sudo[85870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:26 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fe19516-d27f-42ee-8ce4-9cb8af33c68b tempest-VolumesTransfersV355Test-1449073520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:54:26 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-8fe19516-d27f-42ee-8ce4-9cb8af33c68b tempest-VolumesTransfersV355Test-1449073520 None] Flow 'volume_create_manager' (c19a4f70-f876-4238-8f3f-48ed63cbdce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:54:26 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-8fe19516-d27f-42ee-8ce4-9cb8af33c68b tempest-VolumesTransfersV355Test-1449073520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12dc3f2f-8d2b-4dc4-bdde-2ea33515ad63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:26 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-8fe19516-d27f-42ee-8ce4-9cb8af33c68b tempest-VolumesTransfersV355Test-1449073520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12dc3f2f-8d2b-4dc4-bdde-2ea33515ad63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:54:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-764617456',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be1d7543-3956-4cd0-ac35-5e54e1ca368b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cc767534627472586b15c3c0856a65b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:54:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:54:27Z,use_quota=True,user_id='07bcf4acb54a4752befc0a84cd7c2c6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:26 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-8fe19516-d27f-42ee-8ce4-9cb8af33c68b tempest-VolumesTransfersV355Test-1449073520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45d47113-5098-492c-9806-ecd87da0b9d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:26 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-8fe19516-d27f-42ee-8ce4-9cb8af33c68b tempest-VolumesTransfersV355Test-1449073520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45d47113-5098-492c-9806-ecd87da0b9d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:26 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-8fe19516-d27f-42ee-8ce4-9cb8af33c68b tempest-VolumesTransfersV355Test-1449073520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (409b47dd-7bb4-48a6-8f01-c8882947ef9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:26 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-8fe19516-d27f-42ee-8ce4-9cb8af33c68b tempest-VolumesTransfersV355Test-1449073520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (409b47dd-7bb4-48a6-8f01-c8882947ef9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be1d7543-3956-4cd0-ac35-5e54e1ca368b', 'volume_name': 'volume-be1d7543-3956-4cd0-ac35-5e54e1ca368b', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:26 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-8fe19516-d27f-42ee-8ce4-9cb8af33c68b tempest-VolumesTransfersV355Test-1449073520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c3695f5-3703-424c-997e-71aee6d98661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:26 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-8fe19516-d27f-42ee-8ce4-9cb8af33c68b tempest-VolumesTransfersV355Test-1449073520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c3695f5-3703-424c-997e-71aee6d98661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:26 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-8fe19516-d27f-42ee-8ce4-9cb8af33c68b tempest-VolumesTransfersV355Test-1449073520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d88dfd32-aeaf-4e66-9533-2565f43ed29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:26 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-8fe19516-d27f-42ee-8ce4-9cb8af33c68b tempest-VolumesTransfersV355Test-1449073520 None] Volume be1d7543-3956-4cd0-ac35-5e54e1ca368b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be1d7543-3956-4cd0-ac35-5e54e1ca368b', 'volume_size': 1}
Apr 15 15:54:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-8fe19516-d27f-42ee-8ce4-9cb8af33c68b tempest-VolumesTransfersV355Test-1449073520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:54:26 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-3826786b-58d2-4344-8e6e-85115afd0ecb tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Acquiring lock "cinder-43c72950-2f7f-4ade-9a30-d92729247464-delete_snapshot" by "delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:54:26 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-3826786b-58d2-4344-8e6e-85115afd0ecb tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Lock "cinder-43c72950-2f7f-4ade-9a30-d92729247464-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:54:26 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-3826786b-58d2-4344-8e6e-85115afd0ecb tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Acquiring lock "cinder-quobyte-6f78522d-8e87-4fb8-ba20-df22f262ccdb" by "delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:54:26 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-3826786b-58d2-4344-8e6e-85115afd0ecb tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Lock "cinder-quobyte-6f78522d-8e87-4fb8-ba20-df22f262ccdb" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:54:26 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-3826786b-58d2-4344-8e6e-85115afd0ecb tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Acquiring lock "cinder-quobyte-43c72950-2f7f-4ade-9a30-d92729247464" by "_delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:54:26 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-3826786b-58d2-4344-8e6e-85115afd0ecb tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Lock "cinder-quobyte-43c72950-2f7f-4ade-9a30-d92729247464" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:54:26 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-3826786b-58d2-4344-8e6e-85115afd0ecb tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Deleting offline snapshot 43c72950-2f7f-4ade-9a30-d92729247464 of volume 6f78522d-8e87-4fb8-ba20-df22f262ccdb {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 15:54:26 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-3826786b-58d2-4344-8e6e-85115afd0ecb tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] snapshot_file for this snap is: volume-6f78522d-8e87-4fb8-ba20-df22f262ccdb.43c72950-2f7f-4ade-9a30-d92729247464 {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 15:54:26 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2c15e4-902d-4d5d-b67d-eae60458127b]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:54:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3826786b-58d2-4344-8e6e-85115afd0ecb tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6f78522d-8e87-4fb8-ba20-df22f262ccdb.43c72950-2f7f-4ade-9a30-d92729247464 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:26 devstack sudo[85873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6f78522d-8e87-4fb8-ba20-df22f262ccdb.43c72950-2f7f-4ade-9a30-d92729247464
Apr 15 15:54:26 devstack sudo[85873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:27 devstack sudo[85870]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:27 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-247c5854-2fab-4d4f-bb38-32900a9ade4e tempest-GroupSnapshotsTest-1023701834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b9d72d14-2a39-47e0-ac1d-83dd05a84ced" returned: 0 in 0.543s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:27 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-247c5854-2fab-4d4f-bb38-32900a9ade4e tempest-GroupSnapshotsTest-1023701834 None] <== create_volume: return (1215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:54:27 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-247c5854-2fab-4d4f-bb38-32900a9ade4e tempest-GroupSnapshotsTest-1023701834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.218s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:54:27 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-8fe19516-d27f-42ee-8ce4-9cb8af33c68b tempest-VolumesTransfersV355Test-1449073520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.301s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:54:27 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-8fe19516-d27f-42ee-8ce4-9cb8af33c68b tempest-VolumesTransfersV355Test-1449073520 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:54:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-764617456',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be1d7543-3956-4cd0-ac35-5e54e1ca368b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cc767534627472586b15c3c0856a65b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:54:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:54:27Z,use_quota=True,user_id='07bcf4acb54a4752befc0a84cd7c2c6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:54:27 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-8fe19516-d27f-42ee-8ce4-9cb8af33c68b tempest-VolumesTransfersV355Test-1449073520 None] Creating volume be1d7543-3956-4cd0-ac35-5e54e1ca368b {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:54:27 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-8fe19516-d27f-42ee-8ce4-9cb8af33c68b tempest-VolumesTransfersV355Test-1449073520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:54:27 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-8fe19516-d27f-42ee-8ce4-9cb8af33c68b tempest-VolumesTransfersV355Test-1449073520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:54:27 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-8fe19516-d27f-42ee-8ce4-9cb8af33c68b tempest-VolumesTransfersV355Test-1449073520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:54:27 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-8fe19516-d27f-42ee-8ce4-9cb8af33c68b tempest-VolumesTransfersV355Test-1449073520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:54:27 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-8fe19516-d27f-42ee-8ce4-9cb8af33c68b tempest-VolumesTransfersV355Test-1449073520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:54:27 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-8fe19516-d27f-42ee-8ce4-9cb8af33c68b tempest-VolumesTransfersV355Test-1449073520 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:54:27 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-8fe19516-d27f-42ee-8ce4-9cb8af33c68b tempest-VolumesTransfersV355Test-1449073520 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:54:27 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-8fe19516-d27f-42ee-8ce4-9cb8af33c68b tempest-VolumesTransfersV355Test-1449073520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-be1d7543-3956-4cd0-ac35-5e54e1ca368b 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:27 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-247c5854-2fab-4d4f-bb38-32900a9ade4e tempest-GroupSnapshotsTest-1023701834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecb7d74a-b360-4002-b241-18b5845065af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9d72d14-2a39-47e0-ac1d-83dd05a84ced', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:27 devstack sudo[85876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-be1d7543-3956-4cd0-ac35-5e54e1ca368b 1073741824
Apr 15 15:54:27 devstack sudo[85876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:27 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-247c5854-2fab-4d4f-bb38-32900a9ade4e tempest-GroupSnapshotsTest-1023701834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b72d4ae-4528-493b-8acb-2bed51a7fc09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:27 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-247c5854-2fab-4d4f-bb38-32900a9ade4e tempest-GroupSnapshotsTest-1023701834 None] Volume volume-b9d72d14-2a39-47e0-ac1d-83dd05a84ced (b9d72d14-2a39-47e0-ac1d-83dd05a84ced): created successfully
Apr 15 15:54:27 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-247c5854-2fab-4d4f-bb38-32900a9ade4e tempest-GroupSnapshotsTest-1023701834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b72d4ae-4528-493b-8acb-2bed51a7fc09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:27 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-247c5854-2fab-4d4f-bb38-32900a9ade4e tempest-GroupSnapshotsTest-1023701834 None] Flow 'volume_create_manager' (a5a16bb8-f73c-4c75-b81c-8fbd46b2b0d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:54:27 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-247c5854-2fab-4d4f-bb38-32900a9ade4e tempest-GroupSnapshotsTest-1023701834 None] Created volume successfully.
Apr 15 15:54:27 devstack sudo[85873]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:27 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3826786b-58d2-4344-8e6e-85115afd0ecb tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6f78522d-8e87-4fb8-ba20-df22f262ccdb.43c72950-2f7f-4ade-9a30-d92729247464" returned: 0 in 0.516s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:27 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-3826786b-58d2-4344-8e6e-85115afd0ecb tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f78522d-8e87-4fb8-ba20-df22f262ccdb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82485) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 15:54:27 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[80fdd866-8b73-4901-9941-07c985c7399f]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:54:27 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3826786b-58d2-4344-8e6e-85115afd0ecb tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6f78522d-8e87-4fb8-ba20-df22f262ccdb {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:27 devstack sudo[85882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6f78522d-8e87-4fb8-ba20-df22f262ccdb
Apr 15 15:54:27 devstack sudo[85882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:27 devstack sudo[85876]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:27 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-8fe19516-d27f-42ee-8ce4-9cb8af33c68b tempest-VolumesTransfersV355Test-1449073520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-be1d7543-3956-4cd0-ac35-5e54e1ca368b 1073741824" returned: 0 in 0.499s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:27 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-8fe19516-d27f-42ee-8ce4-9cb8af33c68b tempest-VolumesTransfersV355Test-1449073520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-be1d7543-3956-4cd0-ac35-5e54e1ca368b {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:27 devstack sudo[85886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-be1d7543-3956-4cd0-ac35-5e54e1ca368b
Apr 15 15:54:27 devstack sudo[85886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:27 devstack sudo[85882]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:27 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3826786b-58d2-4344-8e6e-85115afd0ecb tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6f78522d-8e87-4fb8-ba20-df22f262ccdb" returned: 0 in 0.538s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:27 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3826786b-58d2-4344-8e6e-85115afd0ecb tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6f78522d-8e87-4fb8-ba20-df22f262ccdb.43c72950-2f7f-4ade-9a30-d92729247464 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:28 devstack sudo[85891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6f78522d-8e87-4fb8-ba20-df22f262ccdb.43c72950-2f7f-4ade-9a30-d92729247464
Apr 15 15:54:28 devstack sudo[85891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:28 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-36fa6429-e7c5-446a-8e37-8bcc9982e2a1 tempest-GroupSnapshotsTest-1023701834 None] Update group completed successfully.
Apr 15 15:54:28 devstack sudo[85886]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:28 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-8fe19516-d27f-42ee-8ce4-9cb8af33c68b tempest-VolumesTransfersV355Test-1449073520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-be1d7543-3956-4cd0-ac35-5e54e1ca368b" returned: 0 in 0.482s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:28 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-8fe19516-d27f-42ee-8ce4-9cb8af33c68b tempest-VolumesTransfersV355Test-1449073520 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:54:28 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-8fe19516-d27f-42ee-8ce4-9cb8af33c68b tempest-VolumesTransfersV355Test-1449073520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:54:28 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-8fe19516-d27f-42ee-8ce4-9cb8af33c68b tempest-VolumesTransfersV355Test-1449073520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d88dfd32-aeaf-4e66-9533-2565f43ed29a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be1d7543-3956-4cd0-ac35-5e54e1ca368b', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:28 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-8fe19516-d27f-42ee-8ce4-9cb8af33c68b tempest-VolumesTransfersV355Test-1449073520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d30b526b-08e8-44fa-a77d-48aa6e065f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:28 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-8fe19516-d27f-42ee-8ce4-9cb8af33c68b tempest-VolumesTransfersV355Test-1449073520 None] Volume volume-be1d7543-3956-4cd0-ac35-5e54e1ca368b (be1d7543-3956-4cd0-ac35-5e54e1ca368b): created successfully
Apr 15 15:54:28 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-8fe19516-d27f-42ee-8ce4-9cb8af33c68b tempest-VolumesTransfersV355Test-1449073520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d30b526b-08e8-44fa-a77d-48aa6e065f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:28 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-8fe19516-d27f-42ee-8ce4-9cb8af33c68b tempest-VolumesTransfersV355Test-1449073520 None] Flow 'volume_create_manager' (c19a4f70-f876-4238-8f3f-48ed63cbdce8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:54:28 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-8fe19516-d27f-42ee-8ce4-9cb8af33c68b tempest-VolumesTransfersV355Test-1449073520 None] Created volume successfully.
Apr 15 15:54:28 devstack sudo[85891]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:28 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3826786b-58d2-4344-8e6e-85115afd0ecb tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6f78522d-8e87-4fb8-ba20-df22f262ccdb.43c72950-2f7f-4ade-9a30-d92729247464" returned: 0 in 0.552s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:28 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3826786b-58d2-4344-8e6e-85115afd0ecb tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6f78522d-8e87-4fb8-ba20-df22f262ccdb.43c72950-2f7f-4ade-9a30-d92729247464 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:28 devstack sudo[85923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6f78522d-8e87-4fb8-ba20-df22f262ccdb.43c72950-2f7f-4ade-9a30-d92729247464
Apr 15 15:54:28 devstack sudo[85923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:28 devstack sudo[85923]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:28 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3826786b-58d2-4344-8e6e-85115afd0ecb tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6f78522d-8e87-4fb8-ba20-df22f262ccdb.43c72950-2f7f-4ade-9a30-d92729247464" returned: 0 in 0.446s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:28 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-3826786b-58d2-4344-8e6e-85115afd0ecb tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Lock "cinder-quobyte-43c72950-2f7f-4ade-9a30-d92729247464" released by "_delete_snapshot" :: held 2.117s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:54:28 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-3826786b-58d2-4344-8e6e-85115afd0ecb tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Lock "cinder-quobyte-6f78522d-8e87-4fb8-ba20-df22f262ccdb" released by "delete_snapshot" :: held 2.131s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:54:29 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-3826786b-58d2-4344-8e6e-85115afd0ecb tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Created reservations ['3c301b6f-3b3f-4738-a26d-944121786703', '70769e86-a1fc-4768-b236-7541c63ad5d0', 'e611149f-f46d-4f38-a1be-2ae37dd0004e', '22cd52cc-238a-48e3-ae79-91dc887af7d0'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:54:29 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-3826786b-58d2-4344-8e6e-85115afd0ecb tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Delete snapshot completed successfully.
Apr 15 15:54:29 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-76e36986-22ad-4c8f-8cc7-10d5c3ae4bdf tempest-GroupSnapshotsTest-1023701834 None] Update group completed successfully.
Apr 15 15:54:29 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-3826786b-58d2-4344-8e6e-85115afd0ecb tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Lock "cinder-43c72950-2f7f-4ade-9a30-d92729247464-delete_snapshot" released by "delete_snapshot" :: held 2.365s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:54:29 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-998f2325-6b5c-4cf6-bc1f-95344f2386ee tempest-VolumesTransfersV355Test-53642355 None] Transfer volume completed successfully.
Apr 15 15:54:30 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-fdf84250-8809-44f4-9095-ffe6b5c4e285 tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Acquiring lock "cinder-6f78522d-8e87-4fb8-ba20-df22f262ccdb-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:54:30 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-fdf84250-8809-44f4-9095-ffe6b5c4e285 tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Lock "cinder-6f78522d-8e87-4fb8-ba20-df22f262ccdb-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:54:30 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-fdf84250-8809-44f4-9095-ffe6b5c4e285 tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Acquiring lock "cinder-quobyte-6f78522d-8e87-4fb8-ba20-df22f262ccdb" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:54:30 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-fdf84250-8809-44f4-9095-ffe6b5c4e285 tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Lock "cinder-quobyte-6f78522d-8e87-4fb8-ba20-df22f262ccdb" acquired by "delete_volume" :: waited 0.027s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:54:30 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-76ba0dd1-43b7-4d31-b923-21518ab42c38 tempest-VolumesTransfersV355Test-1584049048 None] Acquiring lock "cinder-be1d7543-3956-4cd0-ac35-5e54e1ca368b-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:54:30 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[4273cb44-f0f6-40e2-9370-7baf7fe0ff7d]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:54:30 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-fdf84250-8809-44f4-9095-ffe6b5c4e285 tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6f78522d-8e87-4fb8-ba20-df22f262ccdb {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:30 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-76ba0dd1-43b7-4d31-b923-21518ab42c38 tempest-VolumesTransfersV355Test-1584049048 None] Lock "cinder-be1d7543-3956-4cd0-ac35-5e54e1ca368b-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:54:30 devstack sudo[85926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6f78522d-8e87-4fb8-ba20-df22f262ccdb
Apr 15 15:54:30 devstack sudo[85926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:30 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-5765b1f5-4dcd-4b28-820b-6b90c7119a17 tempest-GroupSnapshotsTest-1023701834 None] Update group completed successfully.
Apr 15 15:54:30 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-76ba0dd1-43b7-4d31-b923-21518ab42c38 tempest-VolumesTransfersV355Test-1584049048 None] Acquiring lock "cinder-quobyte-be1d7543-3956-4cd0-ac35-5e54e1ca368b" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:54:30 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-76ba0dd1-43b7-4d31-b923-21518ab42c38 tempest-VolumesTransfersV355Test-1584049048 None] Lock "cinder-quobyte-be1d7543-3956-4cd0-ac35-5e54e1ca368b" acquired by "delete_volume" :: waited 0.009s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:54:30 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0bf6dba-552d-404c-9c1d-4da11966c116]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:54:30 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-76ba0dd1-43b7-4d31-b923-21518ab42c38 tempest-VolumesTransfersV355Test-1584049048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-be1d7543-3956-4cd0-ac35-5e54e1ca368b {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:30 devstack sudo[85928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-be1d7543-3956-4cd0-ac35-5e54e1ca368b
Apr 15 15:54:30 devstack sudo[85928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:30 devstack sudo[85926]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:30 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-fdf84250-8809-44f4-9095-ffe6b5c4e285 tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6f78522d-8e87-4fb8-ba20-df22f262ccdb" returned: 0 in 0.579s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:30 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-fdf84250-8809-44f4-9095-ffe6b5c4e285 tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6f78522d-8e87-4fb8-ba20-df22f262ccdb {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:30 devstack sudo[85933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6f78522d-8e87-4fb8-ba20-df22f262ccdb
Apr 15 15:54:30 devstack sudo[85933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:30 devstack sudo[85928]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:30 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-76ba0dd1-43b7-4d31-b923-21518ab42c38 tempest-VolumesTransfersV355Test-1584049048 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-be1d7543-3956-4cd0-ac35-5e54e1ca368b" returned: 0 in 0.497s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:30 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-76ba0dd1-43b7-4d31-b923-21518ab42c38 tempest-VolumesTransfersV355Test-1584049048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-be1d7543-3956-4cd0-ac35-5e54e1ca368b {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:30 devstack sudo[85938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-be1d7543-3956-4cd0-ac35-5e54e1ca368b
Apr 15 15:54:30 devstack sudo[85938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:31 devstack sudo[85933]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:31 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-fdf84250-8809-44f4-9095-ffe6b5c4e285 tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6f78522d-8e87-4fb8-ba20-df22f262ccdb" returned: 0 in 0.452s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:31 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-fdf84250-8809-44f4-9095-ffe6b5c4e285 tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Lock "cinder-quobyte-6f78522d-8e87-4fb8-ba20-df22f262ccdb" released by "delete_volume" :: held 1.074s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:54:31 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-fdf84250-8809-44f4-9095-ffe6b5c4e285 tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Created reservations ['50212b32-b2bc-4c08-a33e-0cb2b9510830', '7d71cca5-ece6-4a67-a318-2c630b3e5ed0', '33f640a4-d58f-47af-ab19-02423be6232e', '405b913a-8864-44fe-b550-6e452a6e068f'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:54:31 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-fdf84250-8809-44f4-9095-ffe6b5c4e285 tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:54:31 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-fdf84250-8809-44f4-9095-ffe6b5c4e285 tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:54:31 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-fdf84250-8809-44f4-9095-ffe6b5c4e285 tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:54:31 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-fdf84250-8809-44f4-9095-ffe6b5c4e285 tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:54:31 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-fdf84250-8809-44f4-9095-ffe6b5c4e285 tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:54:31 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-fdf84250-8809-44f4-9095-ffe6b5c4e285 tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:31 devstack sudo[85942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:54:31 devstack sudo[85942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:31 devstack sudo[85938]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:31 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-76ba0dd1-43b7-4d31-b923-21518ab42c38 tempest-VolumesTransfersV355Test-1584049048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-be1d7543-3956-4cd0-ac35-5e54e1ca368b" returned: 0 in 0.524s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:31 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-76ba0dd1-43b7-4d31-b923-21518ab42c38 tempest-VolumesTransfersV355Test-1584049048 None] Lock "cinder-quobyte-be1d7543-3956-4cd0-ac35-5e54e1ca368b" released by "delete_volume" :: held 1.044s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:54:31 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-76ba0dd1-43b7-4d31-b923-21518ab42c38 tempest-VolumesTransfersV355Test-1584049048 None] Created reservations ['371fc5b3-97a5-4af6-8d6a-ac9b1ee20df2', '4399981d-12c5-4a8a-a6e6-ebfb01a424e6', '795bdb22-0206-4f20-96d5-998a81f3b3fb', '4078b4e0-4ad7-473b-bd73-ab55e2c46a54'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:54:31 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-76ba0dd1-43b7-4d31-b923-21518ab42c38 tempest-VolumesTransfersV355Test-1584049048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:54:31 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-76ba0dd1-43b7-4d31-b923-21518ab42c38 tempest-VolumesTransfersV355Test-1584049048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:54:31 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-76ba0dd1-43b7-4d31-b923-21518ab42c38 tempest-VolumesTransfersV355Test-1584049048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:54:31 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-76ba0dd1-43b7-4d31-b923-21518ab42c38 tempest-VolumesTransfersV355Test-1584049048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:54:31 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-76ba0dd1-43b7-4d31-b923-21518ab42c38 tempest-VolumesTransfersV355Test-1584049048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:54:31 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-76ba0dd1-43b7-4d31-b923-21518ab42c38 tempest-VolumesTransfersV355Test-1584049048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:31 devstack sudo[85944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:54:31 devstack sudo[85944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:31 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-c747ceac-5e9f-461b-8781-4c3001f56605 tempest-GroupSnapshotsTest-1023701834 None] Update group completed successfully.
Apr 15 15:54:31 devstack sudo[85942]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:31 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-fdf84250-8809-44f4-9095-ffe6b5c4e285 tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.514s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:31 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-fdf84250-8809-44f4-9095-ffe6b5c4e285 tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:54:31 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-fdf84250-8809-44f4-9095-ffe6b5c4e285 tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Deleted volume successfully.
Apr 15 15:54:31 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-fdf84250-8809-44f4-9095-ffe6b5c4e285 tempest-VolumeSnapshotQuotasNegativeTestJSON-1002885661 None] Lock "cinder-6f78522d-8e87-4fb8-ba20-df22f262ccdb-delete_volume" released by "delete_volume" :: held 1.816s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:54:32 devstack sudo[85944]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:32 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-76ba0dd1-43b7-4d31-b923-21518ab42c38 tempest-VolumesTransfersV355Test-1584049048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.583s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:32 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-76ba0dd1-43b7-4d31-b923-21518ab42c38 tempest-VolumesTransfersV355Test-1584049048 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:54:32 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-76ba0dd1-43b7-4d31-b923-21518ab42c38 tempest-VolumesTransfersV355Test-1584049048 None] Deleted volume successfully.
Apr 15 15:54:32 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-76ba0dd1-43b7-4d31-b923-21518ab42c38 tempest-VolumesTransfersV355Test-1584049048 None] Lock "cinder-be1d7543-3956-4cd0-ac35-5e54e1ca368b-delete_volume" released by "delete_volume" :: held 1.857s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:54:32 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-b25cf5b0-857b-42ca-8583-4f067592d0dc tempest-VolumesTransfersV355Test-1449073520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:54:32 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b25cf5b0-857b-42ca-8583-4f067592d0dc tempest-VolumesTransfersV355Test-1449073520 None] Flow 'volume_create_manager' (6a947b38-ef7b-4ebf-b1fd-1be803125380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:54:32 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b25cf5b0-857b-42ca-8583-4f067592d0dc tempest-VolumesTransfersV355Test-1449073520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fa1ac63-db89-4e3a-84e6-9400e71a1aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:32 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b25cf5b0-857b-42ca-8583-4f067592d0dc tempest-VolumesTransfersV355Test-1449073520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fa1ac63-db89-4e3a-84e6-9400e71a1aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1634586399',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc28efba-9a4c-4ed2-ba85-eccbb54a27c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cc767534627472586b15c3c0856a65b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:54:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:54:33Z,use_quota=True,user_id='07bcf4acb54a4752befc0a84cd7c2c6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:32 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b25cf5b0-857b-42ca-8583-4f067592d0dc tempest-VolumesTransfersV355Test-1449073520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c628bd5c-a26c-482b-97bc-127ec2df3bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:32 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b25cf5b0-857b-42ca-8583-4f067592d0dc tempest-VolumesTransfersV355Test-1449073520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c628bd5c-a26c-482b-97bc-127ec2df3bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:32 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b25cf5b0-857b-42ca-8583-4f067592d0dc tempest-VolumesTransfersV355Test-1449073520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bf1b24a-d967-4f77-a785-d0c29d38ffc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:32 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b25cf5b0-857b-42ca-8583-4f067592d0dc tempest-VolumesTransfersV355Test-1449073520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bf1b24a-d967-4f77-a785-d0c29d38ffc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc28efba-9a4c-4ed2-ba85-eccbb54a27c1', 'volume_name': 'volume-bc28efba-9a4c-4ed2-ba85-eccbb54a27c1', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:32 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b25cf5b0-857b-42ca-8583-4f067592d0dc tempest-VolumesTransfersV355Test-1449073520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c4e510c-322a-4771-90c9-7ee1c33c59d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:32 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b25cf5b0-857b-42ca-8583-4f067592d0dc tempest-VolumesTransfersV355Test-1449073520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c4e510c-322a-4771-90c9-7ee1c33c59d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:32 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b25cf5b0-857b-42ca-8583-4f067592d0dc tempest-VolumesTransfersV355Test-1449073520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a00c602c-8cd5-4578-8396-6354e4a604a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:32 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-b25cf5b0-857b-42ca-8583-4f067592d0dc tempest-VolumesTransfersV355Test-1449073520 None] Volume bc28efba-9a4c-4ed2-ba85-eccbb54a27c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc28efba-9a4c-4ed2-ba85-eccbb54a27c1', 'volume_size': 1}
Apr 15 15:54:32 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-b25cf5b0-857b-42ca-8583-4f067592d0dc tempest-VolumesTransfersV355Test-1449073520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:54:32 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-b25cf5b0-857b-42ca-8583-4f067592d0dc tempest-VolumesTransfersV355Test-1449073520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:54:32 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-b25cf5b0-857b-42ca-8583-4f067592d0dc tempest-VolumesTransfersV355Test-1449073520 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1634586399',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc28efba-9a4c-4ed2-ba85-eccbb54a27c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cc767534627472586b15c3c0856a65b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:54:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:54:33Z,use_quota=True,user_id='07bcf4acb54a4752befc0a84cd7c2c6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:54:32 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-b25cf5b0-857b-42ca-8583-4f067592d0dc tempest-VolumesTransfersV355Test-1449073520 None] Creating volume bc28efba-9a4c-4ed2-ba85-eccbb54a27c1 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:54:32 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-b25cf5b0-857b-42ca-8583-4f067592d0dc tempest-VolumesTransfersV355Test-1449073520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:54:32 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-b25cf5b0-857b-42ca-8583-4f067592d0dc tempest-VolumesTransfersV355Test-1449073520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:54:32 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-b25cf5b0-857b-42ca-8583-4f067592d0dc tempest-VolumesTransfersV355Test-1449073520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:54:32 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-b25cf5b0-857b-42ca-8583-4f067592d0dc tempest-VolumesTransfersV355Test-1449073520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:54:32 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-b25cf5b0-857b-42ca-8583-4f067592d0dc tempest-VolumesTransfersV355Test-1449073520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:54:32 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-b25cf5b0-857b-42ca-8583-4f067592d0dc tempest-VolumesTransfersV355Test-1449073520 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:54:32 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-b25cf5b0-857b-42ca-8583-4f067592d0dc tempest-VolumesTransfersV355Test-1449073520 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:54:32 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b25cf5b0-857b-42ca-8583-4f067592d0dc tempest-VolumesTransfersV355Test-1449073520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-bc28efba-9a4c-4ed2-ba85-eccbb54a27c1 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:32 devstack sudo[85952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-bc28efba-9a4c-4ed2-ba85-eccbb54a27c1 1073741824
Apr 15 15:54:32 devstack sudo[85952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:32 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-10133a8e-4044-4714-9d0e-eba638c79f15 tempest-GroupSnapshotsTest-1023701834 None] GroupSnapshot d0f8630d-3b7d-4bec-bf74-922db884734f: creating.
Apr 15 15:54:32 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-10133a8e-4044-4714-9d0e-eba638c79f15 tempest-GroupSnapshotsTest-1023701834 None] Group snapshot d0f8630d-3b7d-4bec-bf74-922db884734f: creating. {{(pid=82485) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 15 15:54:32 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-10133a8e-4044-4714-9d0e-eba638c79f15 tempest-GroupSnapshotsTest-1023701834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:54:33 devstack sudo[85952]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:33 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b25cf5b0-857b-42ca-8583-4f067592d0dc tempest-VolumesTransfersV355Test-1449073520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-bc28efba-9a4c-4ed2-ba85-eccbb54a27c1 1073741824" returned: 0 in 0.723s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:33 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b25cf5b0-857b-42ca-8583-4f067592d0dc tempest-VolumesTransfersV355Test-1449073520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-bc28efba-9a4c-4ed2-ba85-eccbb54a27c1 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:33 devstack sudo[85958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-bc28efba-9a4c-4ed2-ba85-eccbb54a27c1
Apr 15 15:54:33 devstack sudo[85958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:34 devstack sudo[85958]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:34 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b25cf5b0-857b-42ca-8583-4f067592d0dc tempest-VolumesTransfersV355Test-1449073520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-bc28efba-9a4c-4ed2-ba85-eccbb54a27c1" returned: 0 in 0.519s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:34 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-b25cf5b0-857b-42ca-8583-4f067592d0dc tempest-VolumesTransfersV355Test-1449073520 None] <== create_volume: return (1279ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:54:34 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-b25cf5b0-857b-42ca-8583-4f067592d0dc tempest-VolumesTransfersV355Test-1449073520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.281s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:54:34 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-10133a8e-4044-4714-9d0e-eba638c79f15 tempest-GroupSnapshotsTest-1023701834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.021s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:54:34 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-10133a8e-4044-4714-9d0e-eba638c79f15 tempest-GroupSnapshotsTest-1023701834 None] Creating offline snapshot 4d1addb7-9c29-4c58-adc4-7af041a94f10 of volume b9d72d14-2a39-47e0-ac1d-83dd05a84ced {{(pid=82485) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 15:54:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b25cf5b0-857b-42ca-8583-4f067592d0dc tempest-VolumesTransfersV355Test-1449073520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a00c602c-8cd5-4578-8396-6354e4a604a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc28efba-9a4c-4ed2-ba85-eccbb54a27c1', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b25cf5b0-857b-42ca-8583-4f067592d0dc tempest-VolumesTransfersV355Test-1449073520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dfa739d-8947-4b2f-b5ae-ff5221036e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:34 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[6875ee91-7408-4ea6-9207-5c93465f6a1e]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:54:34 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-10133a8e-4044-4714-9d0e-eba638c79f15 tempest-GroupSnapshotsTest-1023701834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b9d72d14-2a39-47e0-ac1d-83dd05a84ced {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:34 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-b25cf5b0-857b-42ca-8583-4f067592d0dc tempest-VolumesTransfersV355Test-1449073520 None] Volume volume-bc28efba-9a4c-4ed2-ba85-eccbb54a27c1 (bc28efba-9a4c-4ed2-ba85-eccbb54a27c1): created successfully
Apr 15 15:54:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b25cf5b0-857b-42ca-8583-4f067592d0dc tempest-VolumesTransfersV355Test-1449073520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dfa739d-8947-4b2f-b5ae-ff5221036e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b25cf5b0-857b-42ca-8583-4f067592d0dc tempest-VolumesTransfersV355Test-1449073520 None] Flow 'volume_create_manager' (6a947b38-ef7b-4ebf-b1fd-1be803125380) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:54:34 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-b25cf5b0-857b-42ca-8583-4f067592d0dc tempest-VolumesTransfersV355Test-1449073520 None] Created volume successfully.
Apr 15 15:54:34 devstack sudo[85961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b9d72d14-2a39-47e0-ac1d-83dd05a84ced
Apr 15 15:54:34 devstack sudo[85961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:34 devstack sudo[85961]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:34 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-10133a8e-4044-4714-9d0e-eba638c79f15 tempest-GroupSnapshotsTest-1023701834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b9d72d14-2a39-47e0-ac1d-83dd05a84ced" returned: 0 in 0.600s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:34 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-10133a8e-4044-4714-9d0e-eba638c79f15 tempest-GroupSnapshotsTest-1023701834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b9d72d14-2a39-47e0-ac1d-83dd05a84ced,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b9d72d14-2a39-47e0-ac1d-83dd05a84ced.4d1addb7-9c29-4c58-adc4-7af041a94f10 1G {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:34 devstack sudo[85967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b9d72d14-2a39-47e0-ac1d-83dd05a84ced,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b9d72d14-2a39-47e0-ac1d-83dd05a84ced.4d1addb7-9c29-4c58-adc4-7af041a94f10 1G
Apr 15 15:54:34 devstack sudo[85967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:35 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-fb4aaf75-8832-463a-898b-96c725b5766d tempest-VolumesTransfersV355Test-1584049048 None] Acquiring lock "cinder-bc28efba-9a4c-4ed2-ba85-eccbb54a27c1-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:54:35 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-fb4aaf75-8832-463a-898b-96c725b5766d tempest-VolumesTransfersV355Test-1584049048 None] Lock "cinder-bc28efba-9a4c-4ed2-ba85-eccbb54a27c1-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:54:35 devstack cinder-volume[82485]: DEBUG dbcounter [-] [82485] Writing DB stats cinder:SELECT=148,cinder:UPDATE=136,cinder:INSERT=37,cinder:DELETE=9 {{(pid=82485) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 15:54:35 devstack cinder-volume[82485]: DEBUG dbcounter [-] [82485] Writing DB stats cinder:UPDATE=152,cinder:SELECT=133,cinder:INSERT=26,cinder:DELETE=6 {{(pid=82485) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 15:54:35 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-fb4aaf75-8832-463a-898b-96c725b5766d tempest-VolumesTransfersV355Test-1584049048 None] Acquiring lock "cinder-quobyte-bc28efba-9a4c-4ed2-ba85-eccbb54a27c1" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:54:35 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-fb4aaf75-8832-463a-898b-96c725b5766d tempest-VolumesTransfersV355Test-1584049048 None] Lock "cinder-quobyte-bc28efba-9a4c-4ed2-ba85-eccbb54a27c1" acquired by "delete_volume" :: waited 0.016s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:54:35 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[4572826f-2809-4768-aed8-dd6b4960f64c]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:54:35 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-fb4aaf75-8832-463a-898b-96c725b5766d tempest-VolumesTransfersV355Test-1584049048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-bc28efba-9a4c-4ed2-ba85-eccbb54a27c1 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:35 devstack sudo[85975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-bc28efba-9a4c-4ed2-ba85-eccbb54a27c1
Apr 15 15:54:35 devstack sudo[85975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:35 devstack sudo[85967]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:35 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-10133a8e-4044-4714-9d0e-eba638c79f15 tempest-GroupSnapshotsTest-1023701834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b9d72d14-2a39-47e0-ac1d-83dd05a84ced,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b9d72d14-2a39-47e0-ac1d-83dd05a84ced.4d1addb7-9c29-4c58-adc4-7af041a94f10 1G" returned: 0 in 0.738s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:35 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-10133a8e-4044-4714-9d0e-eba638c79f15 tempest-GroupSnapshotsTest-1023701834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9d72d14-2a39-47e0-ac1d-83dd05a84ced -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b9d72d14-2a39-47e0-ac1d-83dd05a84ced.4d1addb7-9c29-4c58-adc4-7af041a94f10 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:35 devstack sudo[85980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9d72d14-2a39-47e0-ac1d-83dd05a84ced -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b9d72d14-2a39-47e0-ac1d-83dd05a84ced.4d1addb7-9c29-4c58-adc4-7af041a94f10
Apr 15 15:54:35 devstack sudo[85980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:35 devstack sudo[85975]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:35 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-fb4aaf75-8832-463a-898b-96c725b5766d tempest-VolumesTransfersV355Test-1584049048 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-bc28efba-9a4c-4ed2-ba85-eccbb54a27c1" returned: 0 in 0.568s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:35 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-fb4aaf75-8832-463a-898b-96c725b5766d tempest-VolumesTransfersV355Test-1584049048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-bc28efba-9a4c-4ed2-ba85-eccbb54a27c1 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:35 devstack sudo[85985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-bc28efba-9a4c-4ed2-ba85-eccbb54a27c1
Apr 15 15:54:35 devstack sudo[85985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:35 devstack sudo[85980]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:35 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-10133a8e-4044-4714-9d0e-eba638c79f15 tempest-GroupSnapshotsTest-1023701834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9d72d14-2a39-47e0-ac1d-83dd05a84ced -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b9d72d14-2a39-47e0-ac1d-83dd05a84ced.4d1addb7-9c29-4c58-adc4-7af041a94f10" returned: 0 in 0.568s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:35 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-10133a8e-4044-4714-9d0e-eba638c79f15 tempest-GroupSnapshotsTest-1023701834 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b9d72d14-2a39-47e0-ac1d-83dd05a84ced.4d1addb7-9c29-4c58-adc4-7af041a94f10 is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 15:54:35 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-10133a8e-4044-4714-9d0e-eba638c79f15 tempest-GroupSnapshotsTest-1023701834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b9d72d14-2a39-47e0-ac1d-83dd05a84ced.4d1addb7-9c29-4c58-adc4-7af041a94f10 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:35 devstack sudo[85990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b9d72d14-2a39-47e0-ac1d-83dd05a84ced.4d1addb7-9c29-4c58-adc4-7af041a94f10
Apr 15 15:54:36 devstack sudo[85990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:36 devstack sudo[85985]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:36 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-fb4aaf75-8832-463a-898b-96c725b5766d tempest-VolumesTransfersV355Test-1584049048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-bc28efba-9a4c-4ed2-ba85-eccbb54a27c1" returned: 0 in 0.634s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:36 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-fb4aaf75-8832-463a-898b-96c725b5766d tempest-VolumesTransfersV355Test-1584049048 None] Lock "cinder-quobyte-bc28efba-9a4c-4ed2-ba85-eccbb54a27c1" released by "delete_volume" :: held 1.227s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:54:36 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-fb4aaf75-8832-463a-898b-96c725b5766d tempest-VolumesTransfersV355Test-1584049048 None] Created reservations ['fe186dc3-723d-4ad0-9725-d63b3ba76203', 'f2b6cf0d-bc3f-447b-a53e-92e033850139', 'e63d17b8-eeb3-491a-85d6-eec5b6599a39', '017460f5-1cf1-45d4-b159-6d48830696be'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:54:36 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-fb4aaf75-8832-463a-898b-96c725b5766d tempest-VolumesTransfersV355Test-1584049048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:54:36 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-fb4aaf75-8832-463a-898b-96c725b5766d tempest-VolumesTransfersV355Test-1584049048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:54:36 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-fb4aaf75-8832-463a-898b-96c725b5766d tempest-VolumesTransfersV355Test-1584049048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:54:36 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-fb4aaf75-8832-463a-898b-96c725b5766d tempest-VolumesTransfersV355Test-1584049048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:54:36 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-fb4aaf75-8832-463a-898b-96c725b5766d tempest-VolumesTransfersV355Test-1584049048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:54:36 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-fb4aaf75-8832-463a-898b-96c725b5766d tempest-VolumesTransfersV355Test-1584049048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:36 devstack sudo[85990]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:36 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-10133a8e-4044-4714-9d0e-eba638c79f15 tempest-GroupSnapshotsTest-1023701834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b9d72d14-2a39-47e0-ac1d-83dd05a84ced.4d1addb7-9c29-4c58-adc4-7af041a94f10" returned: 0 in 0.488s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:36 devstack sudo[85994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:54:36 devstack sudo[85994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:36 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-10133a8e-4044-4714-9d0e-eba638c79f15 tempest-GroupSnapshotsTest-1023701834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b9d72d14-2a39-47e0-ac1d-83dd05a84ced.info {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:36 devstack sudo[85996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b9d72d14-2a39-47e0-ac1d-83dd05a84ced.info
Apr 15 15:54:36 devstack sudo[85996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:37 devstack sudo[85994]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:37 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-fb4aaf75-8832-463a-898b-96c725b5766d tempest-VolumesTransfersV355Test-1584049048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.585s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:37 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-fb4aaf75-8832-463a-898b-96c725b5766d tempest-VolumesTransfersV355Test-1584049048 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:54:37 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-fb4aaf75-8832-463a-898b-96c725b5766d tempest-VolumesTransfersV355Test-1584049048 None] Deleted volume successfully.
Apr 15 15:54:37 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-fb4aaf75-8832-463a-898b-96c725b5766d tempest-VolumesTransfersV355Test-1584049048 None] Lock "cinder-bc28efba-9a4c-4ed2-ba85-eccbb54a27c1-delete_volume" released by "delete_volume" :: held 1.999s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:54:37 devstack sudo[85996]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:37 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-10133a8e-4044-4714-9d0e-eba638c79f15 tempest-GroupSnapshotsTest-1023701834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b9d72d14-2a39-47e0-ac1d-83dd05a84ced.info" returned: 0 in 0.735s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:37 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-10133a8e-4044-4714-9d0e-eba638c79f15 tempest-GroupSnapshotsTest-1023701834 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b9d72d14-2a39-47e0-ac1d-83dd05a84ced.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 15:54:37 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-10133a8e-4044-4714-9d0e-eba638c79f15 tempest-GroupSnapshotsTest-1023701834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b9d72d14-2a39-47e0-ac1d-83dd05a84ced.info {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:37 devstack sudo[86000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b9d72d14-2a39-47e0-ac1d-83dd05a84ced.info
Apr 15 15:54:37 devstack sudo[86000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:37 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-730208ff-8c8e-4f9f-a8f2-4c4cd5849f8b tempest-VolumesMetadataTest-644818559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:54:37 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-730208ff-8c8e-4f9f-a8f2-4c4cd5849f8b tempest-VolumesMetadataTest-644818559 None] Flow 'volume_create_manager' (293b5c8c-0708-4cf0-a2d1-ff4402b24d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:54:37 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-730208ff-8c8e-4f9f-a8f2-4c4cd5849f8b tempest-VolumesMetadataTest-644818559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be7c7bfe-c304-4c5c-8d0f-5a82e79e8d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:37 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-730208ff-8c8e-4f9f-a8f2-4c4cd5849f8b tempest-VolumesMetadataTest-644818559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be7c7bfe-c304-4c5c-8d0f-5a82e79e8d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1582350895',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59557be6-f3f1-4b73-b5eb-8dea0cc94fa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3535b12d42d24959b83aa092326f6288',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:54:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:54:37Z,use_quota=True,user_id='2b83d378499d4b6593833ef02aa802fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:37 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-730208ff-8c8e-4f9f-a8f2-4c4cd5849f8b tempest-VolumesMetadataTest-644818559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (951c746d-a004-4714-a24e-58f7233ab0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:37 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-730208ff-8c8e-4f9f-a8f2-4c4cd5849f8b tempest-VolumesMetadataTest-644818559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (951c746d-a004-4714-a24e-58f7233ab0f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:37 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-730208ff-8c8e-4f9f-a8f2-4c4cd5849f8b tempest-VolumesMetadataTest-644818559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cea7e86f-f3d6-445b-847c-8baec4653605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:37 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-730208ff-8c8e-4f9f-a8f2-4c4cd5849f8b tempest-VolumesMetadataTest-644818559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cea7e86f-f3d6-445b-847c-8baec4653605) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59557be6-f3f1-4b73-b5eb-8dea0cc94fa7', 'volume_name': 'volume-59557be6-f3f1-4b73-b5eb-8dea0cc94fa7', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:37 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-730208ff-8c8e-4f9f-a8f2-4c4cd5849f8b tempest-VolumesMetadataTest-644818559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7938ed47-3313-40b6-8801-5aadb89364a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:37 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-730208ff-8c8e-4f9f-a8f2-4c4cd5849f8b tempest-VolumesMetadataTest-644818559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7938ed47-3313-40b6-8801-5aadb89364a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:37 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-730208ff-8c8e-4f9f-a8f2-4c4cd5849f8b tempest-VolumesMetadataTest-644818559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (286bb2d7-04c2-4d3d-b094-ea1d655c5811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:37 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-730208ff-8c8e-4f9f-a8f2-4c4cd5849f8b tempest-VolumesMetadataTest-644818559 None] Volume 59557be6-f3f1-4b73-b5eb-8dea0cc94fa7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59557be6-f3f1-4b73-b5eb-8dea0cc94fa7', 'volume_size': 1}
Apr 15 15:54:37 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-730208ff-8c8e-4f9f-a8f2-4c4cd5849f8b tempest-VolumesMetadataTest-644818559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:54:37 devstack sudo[86000]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:37 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-10133a8e-4044-4714-9d0e-eba638c79f15 tempest-GroupSnapshotsTest-1023701834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b9d72d14-2a39-47e0-ac1d-83dd05a84ced.info" returned: 0 in 0.641s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:37 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-10133a8e-4044-4714-9d0e-eba638c79f15 tempest-GroupSnapshotsTest-1023701834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.855s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:54:37 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-10133a8e-4044-4714-9d0e-eba638c79f15 tempest-GroupSnapshotsTest-1023701834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:54:37 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-10133a8e-4044-4714-9d0e-eba638c79f15 tempest-GroupSnapshotsTest-1023701834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:54:37 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-10133a8e-4044-4714-9d0e-eba638c79f15 tempest-GroupSnapshotsTest-1023701834 None] Creating offline snapshot 919877bc-4a76-48bd-b3da-cdd014573025 of volume ae7fddf4-96da-41c3-85a9-816bc0db8cd4 {{(pid=82485) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 15:54:37 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[4525b5b1-850f-4df5-b208-22e601da5d3e]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:54:37 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-10133a8e-4044-4714-9d0e-eba638c79f15 tempest-GroupSnapshotsTest-1023701834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ae7fddf4-96da-41c3-85a9-816bc0db8cd4 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:38 devstack sudo[86003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ae7fddf4-96da-41c3-85a9-816bc0db8cd4
Apr 15 15:54:38 devstack sudo[86003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:38 devstack sudo[86003]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:38 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-10133a8e-4044-4714-9d0e-eba638c79f15 tempest-GroupSnapshotsTest-1023701834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ae7fddf4-96da-41c3-85a9-816bc0db8cd4" returned: 0 in 0.826s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:38 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-10133a8e-4044-4714-9d0e-eba638c79f15 tempest-GroupSnapshotsTest-1023701834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ae7fddf4-96da-41c3-85a9-816bc0db8cd4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ae7fddf4-96da-41c3-85a9-816bc0db8cd4.919877bc-4a76-48bd-b3da-cdd014573025 1G {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:38 devstack sudo[86011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ae7fddf4-96da-41c3-85a9-816bc0db8cd4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ae7fddf4-96da-41c3-85a9-816bc0db8cd4.919877bc-4a76-48bd-b3da-cdd014573025 1G
Apr 15 15:54:38 devstack sudo[86011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:39 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:54:39 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Flow 'volume_create_manager' (cefd03da-a6c4-4d98-8afe-93c334d726e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:54:39 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e989decb-b5dc-4bde-a81e-69afa4e48cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:39 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e989decb-b5dc-4bde-a81e-69afa4e48cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:54:39Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b957df94-c7a9-4bbe-9ebc-d676656906f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d04dec0f5d04abb90a11fceb752a2c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:54:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:54:39Z,use_quota=True,user_id='35fd433b182747e0901b8a99e1a04327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:39 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2781e787-1f41-4fbc-9333-2ec462b4bb26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:39 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2781e787-1f41-4fbc-9333-2ec462b4bb26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:39 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad668055-a8c0-4735-aac3-d90f4acf90bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:39 devstack cinder-volume[82485]: DEBUG cinder.image.glance [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Creating Keystone auth plugin from conf {{(pid=82485) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 15 15:54:39 devstack sudo[86011]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:39 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-10133a8e-4044-4714-9d0e-eba638c79f15 tempest-GroupSnapshotsTest-1023701834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ae7fddf4-96da-41c3-85a9-816bc0db8cd4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ae7fddf4-96da-41c3-85a9-816bc0db8cd4.919877bc-4a76-48bd-b3da-cdd014573025 1G" returned: 0 in 0.822s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:39 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-10133a8e-4044-4714-9d0e-eba638c79f15 tempest-GroupSnapshotsTest-1023701834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae7fddf4-96da-41c3-85a9-816bc0db8cd4 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ae7fddf4-96da-41c3-85a9-816bc0db8cd4.919877bc-4a76-48bd-b3da-cdd014573025 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:39 devstack sudo[86016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae7fddf4-96da-41c3-85a9-816bc0db8cd4 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ae7fddf4-96da-41c3-85a9-816bc0db8cd4.919877bc-4a76-48bd-b3da-cdd014573025
Apr 15 15:54:39 devstack sudo[86016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:39 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad668055-a8c0-4735-aac3-d90f4acf90bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b957df94-c7a9-4bbe-9ebc-d676656906f6', 'volume_name': 'volume-b957df94-c7a9-4bbe-9ebc-d676656906f6', 'volume_size': 1, 'image_id': '0fe37db8-916e-4521-8f72-73003c13994a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0fe37db8-916e-4521-8f72-73003c13994a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '57491fc0e71d4fad9011d017ccefe515', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0fe37db8-916e-4521-8f72-73003c13994a', 'created_at': datetime.datetime(2026, 4, 15, 13, 47, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 13, 47, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0fe37db8-916e-4521-8f72-73003c13994a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f1549cad330>}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:39 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2ea7162-51d5-476e-90ee-c9adee8fae4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:39 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2ea7162-51d5-476e-90ee-c9adee8fae4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:39 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d184d670-b4eb-43f4-a01c-c3c2ae294b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:39 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Volume b957df94-c7a9-4bbe-9ebc-d676656906f6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b957df94-c7a9-4bbe-9ebc-d676656906f6', 'volume_size': 1, 'image_id': '0fe37db8-916e-4521-8f72-73003c13994a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0fe37db8-916e-4521-8f72-73003c13994a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '57491fc0e71d4fad9011d017ccefe515', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0fe37db8-916e-4521-8f72-73003c13994a', 'created_at': datetime.datetime(2026, 4, 15, 13, 47, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 13, 47, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0fe37db8-916e-4521-8f72-73003c13994a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f1549cad330>}
Apr 15 15:54:39 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Trying to clone b957df94-c7a9-4bbe-9ebc-d676656906f6 from image 0fe37db8-916e-4521-8f72-73003c13994a at location (None, [{'url': 'file:///opt/stack/data/glance/images/0fe37db8-916e-4521-8f72-73003c13994a', 'metadata': {}}]). {{(pid=82485) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 15 15:54:40 devstack cinder-volume[82485]: DEBUG cinder.image.image_utils [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0fe37db8-916e-4521-8f72-73003c13994a_mfavg7v_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82485) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 15 15:54:40 devstack cinder-volume[82485]: INFO cinder.image.image_utils [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Image download 20.69 MB at 20.69 MB/s
Apr 15 15:54:40 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[67839f81-490d-4954-87d8-ae36a5358f5c]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:54:40 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fe37db8-916e-4521-8f72-73003c13994a_mfavg7v_devstack@QuobyteHD {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:40 devstack sudo[86075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fe37db8-916e-4521-8f72-73003c13994a_mfavg7v_devstack@QuobyteHD
Apr 15 15:54:40 devstack sudo[86075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:40 devstack sudo[86016]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:40 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-10133a8e-4044-4714-9d0e-eba638c79f15 tempest-GroupSnapshotsTest-1023701834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae7fddf4-96da-41c3-85a9-816bc0db8cd4 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ae7fddf4-96da-41c3-85a9-816bc0db8cd4.919877bc-4a76-48bd-b3da-cdd014573025" returned: 0 in 0.670s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:40 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-10133a8e-4044-4714-9d0e-eba638c79f15 tempest-GroupSnapshotsTest-1023701834 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ae7fddf4-96da-41c3-85a9-816bc0db8cd4.919877bc-4a76-48bd-b3da-cdd014573025 is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 15:54:40 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-10133a8e-4044-4714-9d0e-eba638c79f15 tempest-GroupSnapshotsTest-1023701834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ae7fddf4-96da-41c3-85a9-816bc0db8cd4.919877bc-4a76-48bd-b3da-cdd014573025 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:40 devstack sudo[86078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ae7fddf4-96da-41c3-85a9-816bc0db8cd4.919877bc-4a76-48bd-b3da-cdd014573025
Apr 15 15:54:40 devstack sudo[86078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:40 devstack sudo[86075]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:40 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fe37db8-916e-4521-8f72-73003c13994a_mfavg7v_devstack@QuobyteHD" returned: 0 in 0.677s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:40 devstack cinder-volume[82485]: DEBUG cinder.image.image_utils [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Temporary image 0fe37db8-916e-4521-8f72-73003c13994a is fetched for user 35fd433b182747e0901b8a99e1a04327. {{(pid=82485) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 15 15:54:40 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[660f8812-1ff6-4a94-955d-a57ba81488ec]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:54:40 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fe37db8-916e-4521-8f72-73003c13994a_mfavg7v_devstack@QuobyteHD {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:40 devstack sudo[86078]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:40 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-10133a8e-4044-4714-9d0e-eba638c79f15 tempest-GroupSnapshotsTest-1023701834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ae7fddf4-96da-41c3-85a9-816bc0db8cd4.919877bc-4a76-48bd-b3da-cdd014573025" returned: 0 in 0.632s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:40 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-10133a8e-4044-4714-9d0e-eba638c79f15 tempest-GroupSnapshotsTest-1023701834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ae7fddf4-96da-41c3-85a9-816bc0db8cd4.info {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:40 devstack sudo[86085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ae7fddf4-96da-41c3-85a9-816bc0db8cd4.info
Apr 15 15:54:40 devstack sudo[86085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:40 devstack sudo[86084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fe37db8-916e-4521-8f72-73003c13994a_mfavg7v_devstack@QuobyteHD
Apr 15 15:54:40 devstack sudo[86084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:41 devstack sudo[86084]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:41 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fe37db8-916e-4521-8f72-73003c13994a_mfavg7v_devstack@QuobyteHD" returned: 0 in 0.669s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:41 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:54:41 devstack sudo[86085]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:41 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-10133a8e-4044-4714-9d0e-eba638c79f15 tempest-GroupSnapshotsTest-1023701834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ae7fddf4-96da-41c3-85a9-816bc0db8cd4.info" returned: 0 in 0.624s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:41 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-10133a8e-4044-4714-9d0e-eba638c79f15 tempest-GroupSnapshotsTest-1023701834 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ae7fddf4-96da-41c3-85a9-816bc0db8cd4.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 15:54:41 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-10133a8e-4044-4714-9d0e-eba638c79f15 tempest-GroupSnapshotsTest-1023701834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ae7fddf4-96da-41c3-85a9-816bc0db8cd4.info {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:41 devstack sudo[86092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ae7fddf4-96da-41c3-85a9-816bc0db8cd4.info
Apr 15 15:54:41 devstack sudo[86092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:41 devstack sudo[86092]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:41 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-10133a8e-4044-4714-9d0e-eba638c79f15 tempest-GroupSnapshotsTest-1023701834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ae7fddf4-96da-41c3-85a9-816bc0db8cd4.info" returned: 0 in 0.440s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:41 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-10133a8e-4044-4714-9d0e-eba638c79f15 tempest-GroupSnapshotsTest-1023701834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.078s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:54:41 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-730208ff-8c8e-4f9f-a8f2-4c4cd5849f8b tempest-VolumesMetadataTest-644818559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.492s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:54:41 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-730208ff-8c8e-4f9f-a8f2-4c4cd5849f8b tempest-VolumesMetadataTest-644818559 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1582350895',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59557be6-f3f1-4b73-b5eb-8dea0cc94fa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3535b12d42d24959b83aa092326f6288',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:54:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:54:37Z,use_quota=True,user_id='2b83d378499d4b6593833ef02aa802fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:54:41 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-730208ff-8c8e-4f9f-a8f2-4c4cd5849f8b tempest-VolumesMetadataTest-644818559 None] Creating volume 59557be6-f3f1-4b73-b5eb-8dea0cc94fa7 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:54:41 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-730208ff-8c8e-4f9f-a8f2-4c4cd5849f8b tempest-VolumesMetadataTest-644818559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:54:41 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-730208ff-8c8e-4f9f-a8f2-4c4cd5849f8b tempest-VolumesMetadataTest-644818559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:54:41 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-730208ff-8c8e-4f9f-a8f2-4c4cd5849f8b tempest-VolumesMetadataTest-644818559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:54:41 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-730208ff-8c8e-4f9f-a8f2-4c4cd5849f8b tempest-VolumesMetadataTest-644818559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:54:41 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-730208ff-8c8e-4f9f-a8f2-4c4cd5849f8b tempest-VolumesMetadataTest-644818559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:54:41 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-730208ff-8c8e-4f9f-a8f2-4c4cd5849f8b tempest-VolumesMetadataTest-644818559 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:54:41 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-730208ff-8c8e-4f9f-a8f2-4c4cd5849f8b tempest-VolumesMetadataTest-644818559 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:54:41 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-730208ff-8c8e-4f9f-a8f2-4c4cd5849f8b tempest-VolumesMetadataTest-644818559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-59557be6-f3f1-4b73-b5eb-8dea0cc94fa7 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:41 devstack sudo[86095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-59557be6-f3f1-4b73-b5eb-8dea0cc94fa7 1073741824
Apr 15 15:54:41 devstack sudo[86095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:42 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-10133a8e-4044-4714-9d0e-eba638c79f15 tempest-GroupSnapshotsTest-1023701834 None] group_snapshot d0f8630d-3b7d-4bec-bf74-922db884734f: created successfully
Apr 15 15:54:42 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-098ae478-07de-47af-bb2b-905f5255ed4b tempest-VolumesCloneTest-1231922057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:54:42 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-098ae478-07de-47af-bb2b-905f5255ed4b tempest-VolumesCloneTest-1231922057 None] Flow 'volume_create_manager' (f65b4066-8b3e-4325-8ef4-460cb847a6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:54:42 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-098ae478-07de-47af-bb2b-905f5255ed4b tempest-VolumesCloneTest-1231922057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e670a662-715a-4a42-9832-82d2e70301ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:42 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-098ae478-07de-47af-bb2b-905f5255ed4b tempest-VolumesCloneTest-1231922057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e670a662-715a-4a42-9832-82d2e70301ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:54:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2072983670',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d199e20-bb53-4541-b56f-03aeb0bf2f09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5c995063c854b2aa6e9cf83ef79edc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:54:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:54:42Z,use_quota=True,user_id='2094733baff444a497ef7096beb35683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:42 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-098ae478-07de-47af-bb2b-905f5255ed4b tempest-VolumesCloneTest-1231922057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e39fc340-aedc-4c4b-9814-bbb9c6d1777a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:42 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-098ae478-07de-47af-bb2b-905f5255ed4b tempest-VolumesCloneTest-1231922057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e39fc340-aedc-4c4b-9814-bbb9c6d1777a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:42 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-098ae478-07de-47af-bb2b-905f5255ed4b tempest-VolumesCloneTest-1231922057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0bf3202-4637-47e4-84cd-fb97e3782683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:42 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-098ae478-07de-47af-bb2b-905f5255ed4b tempest-VolumesCloneTest-1231922057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0bf3202-4637-47e4-84cd-fb97e3782683) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d199e20-bb53-4541-b56f-03aeb0bf2f09', 'volume_name': 'volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:42 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-098ae478-07de-47af-bb2b-905f5255ed4b tempest-VolumesCloneTest-1231922057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2cc024d-7467-42ac-a367-48bb246fcbdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:42 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-098ae478-07de-47af-bb2b-905f5255ed4b tempest-VolumesCloneTest-1231922057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2cc024d-7467-42ac-a367-48bb246fcbdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:42 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-098ae478-07de-47af-bb2b-905f5255ed4b tempest-VolumesCloneTest-1231922057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e27b7fed-4e30-4bbd-9eb4-1d8e01baed26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:42 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-098ae478-07de-47af-bb2b-905f5255ed4b tempest-VolumesCloneTest-1231922057 None] Volume 5d199e20-bb53-4541-b56f-03aeb0bf2f09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09', 'volume_size': 1}
Apr 15 15:54:42 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-098ae478-07de-47af-bb2b-905f5255ed4b tempest-VolumesCloneTest-1231922057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:54:42 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-44f67dcd-d28d-4acf-aa42-41ad8dede414 tempest-GroupSnapshotsTest-1023701834 None] group_snapshot d0f8630d-3b7d-4bec-bf74-922db884734f: deleting
Apr 15 15:54:42 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-44f67dcd-d28d-4acf-aa42-41ad8dede414 tempest-GroupSnapshotsTest-1023701834 None] group_snapshot d0f8630d-3b7d-4bec-bf74-922db884734f: deleting {{(pid=82485) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 15 15:54:42 devstack sudo[86095]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:42 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-44f67dcd-d28d-4acf-aa42-41ad8dede414 tempest-GroupSnapshotsTest-1023701834 None] Acquiring lock "cinder-quobyte-b9d72d14-2a39-47e0-ac1d-83dd05a84ced" by "delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:54:42 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-730208ff-8c8e-4f9f-a8f2-4c4cd5849f8b tempest-VolumesMetadataTest-644818559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-59557be6-f3f1-4b73-b5eb-8dea0cc94fa7 1073741824" returned: 0 in 0.595s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:42 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-44f67dcd-d28d-4acf-aa42-41ad8dede414 tempest-GroupSnapshotsTest-1023701834 None] Lock "cinder-quobyte-b9d72d14-2a39-47e0-ac1d-83dd05a84ced" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:54:42 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-44f67dcd-d28d-4acf-aa42-41ad8dede414 tempest-GroupSnapshotsTest-1023701834 None] Acquiring lock "cinder-quobyte-4d1addb7-9c29-4c58-adc4-7af041a94f10" by "_delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:54:42 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-44f67dcd-d28d-4acf-aa42-41ad8dede414 tempest-GroupSnapshotsTest-1023701834 None] Lock "cinder-quobyte-4d1addb7-9c29-4c58-adc4-7af041a94f10" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:54:42 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-44f67dcd-d28d-4acf-aa42-41ad8dede414 tempest-GroupSnapshotsTest-1023701834 None] Deleting offline snapshot 4d1addb7-9c29-4c58-adc4-7af041a94f10 of volume b9d72d14-2a39-47e0-ac1d-83dd05a84ced {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 15:54:42 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-44f67dcd-d28d-4acf-aa42-41ad8dede414 tempest-GroupSnapshotsTest-1023701834 None] snapshot_file for this snap is: volume-b9d72d14-2a39-47e0-ac1d-83dd05a84ced.4d1addb7-9c29-4c58-adc4-7af041a94f10 {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 15:54:42 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1133bb-d4b6-4a76-a326-d705faacaebc]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:54:42 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-44f67dcd-d28d-4acf-aa42-41ad8dede414 tempest-GroupSnapshotsTest-1023701834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b9d72d14-2a39-47e0-ac1d-83dd05a84ced.4d1addb7-9c29-4c58-adc4-7af041a94f10 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:42 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-730208ff-8c8e-4f9f-a8f2-4c4cd5849f8b tempest-VolumesMetadataTest-644818559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-59557be6-f3f1-4b73-b5eb-8dea0cc94fa7 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:42 devstack sudo[86112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-59557be6-f3f1-4b73-b5eb-8dea0cc94fa7
Apr 15 15:54:42 devstack sudo[86112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:42 devstack sudo[86111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b9d72d14-2a39-47e0-ac1d-83dd05a84ced.4d1addb7-9c29-4c58-adc4-7af041a94f10
Apr 15 15:54:42 devstack sudo[86111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:43 devstack sudo[86112]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:43 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-730208ff-8c8e-4f9f-a8f2-4c4cd5849f8b tempest-VolumesMetadataTest-644818559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-59557be6-f3f1-4b73-b5eb-8dea0cc94fa7" returned: 0 in 0.495s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:43 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-730208ff-8c8e-4f9f-a8f2-4c4cd5849f8b tempest-VolumesMetadataTest-644818559 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:54:43 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-730208ff-8c8e-4f9f-a8f2-4c4cd5849f8b tempest-VolumesMetadataTest-644818559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:54:43 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.645s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:54:43 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:54:39Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b957df94-c7a9-4bbe-9ebc-d676656906f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d04dec0f5d04abb90a11fceb752a2c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:54:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:54:39Z,use_quota=True,user_id='35fd433b182747e0901b8a99e1a04327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:54:43 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Creating volume b957df94-c7a9-4bbe-9ebc-d676656906f6 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:54:43 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:54:43 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:54:43 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:54:43 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:54:43 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:54:43 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:54:43 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:54:43 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b957df94-c7a9-4bbe-9ebc-d676656906f6 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:43 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-730208ff-8c8e-4f9f-a8f2-4c4cd5849f8b tempest-VolumesMetadataTest-644818559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (286bb2d7-04c2-4d3d-b094-ea1d655c5811) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59557be6-f3f1-4b73-b5eb-8dea0cc94fa7', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:43 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-730208ff-8c8e-4f9f-a8f2-4c4cd5849f8b tempest-VolumesMetadataTest-644818559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e04a784-ff42-41bc-bd53-c724b39de942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:43 devstack sudo[86132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b957df94-c7a9-4bbe-9ebc-d676656906f6 1073741824
Apr 15 15:54:43 devstack sudo[86132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:43 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-730208ff-8c8e-4f9f-a8f2-4c4cd5849f8b tempest-VolumesMetadataTest-644818559 None] Volume volume-59557be6-f3f1-4b73-b5eb-8dea0cc94fa7 (59557be6-f3f1-4b73-b5eb-8dea0cc94fa7): created successfully
Apr 15 15:54:43 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-730208ff-8c8e-4f9f-a8f2-4c4cd5849f8b tempest-VolumesMetadataTest-644818559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e04a784-ff42-41bc-bd53-c724b39de942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:43 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-730208ff-8c8e-4f9f-a8f2-4c4cd5849f8b tempest-VolumesMetadataTest-644818559 None] Flow 'volume_create_manager' (293b5c8c-0708-4cf0-a2d1-ff4402b24d7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:54:43 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-730208ff-8c8e-4f9f-a8f2-4c4cd5849f8b tempest-VolumesMetadataTest-644818559 None] Created volume successfully.
Apr 15 15:54:43 devstack sudo[86111]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:43 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-44f67dcd-d28d-4acf-aa42-41ad8dede414 tempest-GroupSnapshotsTest-1023701834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b9d72d14-2a39-47e0-ac1d-83dd05a84ced.4d1addb7-9c29-4c58-adc4-7af041a94f10" returned: 0 in 0.589s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:43 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-44f67dcd-d28d-4acf-aa42-41ad8dede414 tempest-GroupSnapshotsTest-1023701834 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9d72d14-2a39-47e0-ac1d-83dd05a84ced(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82485) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 15:54:43 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[2155342f-2448-4dd4-a64a-deb58c466eb7]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:54:43 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-44f67dcd-d28d-4acf-aa42-41ad8dede414 tempest-GroupSnapshotsTest-1023701834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b9d72d14-2a39-47e0-ac1d-83dd05a84ced {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:43 devstack sudo[86134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b9d72d14-2a39-47e0-ac1d-83dd05a84ced
Apr 15 15:54:43 devstack sudo[86134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:43 devstack sudo[86132]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:43 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b957df94-c7a9-4bbe-9ebc-d676656906f6 1073741824" returned: 0 in 0.509s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:43 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b957df94-c7a9-4bbe-9ebc-d676656906f6 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:43 devstack sudo[86142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b957df94-c7a9-4bbe-9ebc-d676656906f6
Apr 15 15:54:43 devstack sudo[86142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:43 devstack sudo[86134]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:43 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-44f67dcd-d28d-4acf-aa42-41ad8dede414 tempest-GroupSnapshotsTest-1023701834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b9d72d14-2a39-47e0-ac1d-83dd05a84ced" returned: 0 in 0.518s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:43 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-44f67dcd-d28d-4acf-aa42-41ad8dede414 tempest-GroupSnapshotsTest-1023701834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b9d72d14-2a39-47e0-ac1d-83dd05a84ced.4d1addb7-9c29-4c58-adc4-7af041a94f10 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:43 devstack sudo[86144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b9d72d14-2a39-47e0-ac1d-83dd05a84ced.4d1addb7-9c29-4c58-adc4-7af041a94f10
Apr 15 15:54:43 devstack sudo[86144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:44 devstack sudo[86142]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b957df94-c7a9-4bbe-9ebc-d676656906f6" returned: 0 in 0.461s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:44 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:54:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:54:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-098ae478-07de-47af-bb2b-905f5255ed4b tempest-VolumesCloneTest-1231922057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.902s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:54:44 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-098ae478-07de-47af-bb2b-905f5255ed4b tempest-VolumesCloneTest-1231922057 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:54:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2072983670',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d199e20-bb53-4541-b56f-03aeb0bf2f09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5c995063c854b2aa6e9cf83ef79edc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:54:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:54:42Z,use_quota=True,user_id='2094733baff444a497ef7096beb35683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:54:44 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-098ae478-07de-47af-bb2b-905f5255ed4b tempest-VolumesCloneTest-1231922057 None] Creating volume 5d199e20-bb53-4541-b56f-03aeb0bf2f09 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:54:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-098ae478-07de-47af-bb2b-905f5255ed4b tempest-VolumesCloneTest-1231922057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:54:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-098ae478-07de-47af-bb2b-905f5255ed4b tempest-VolumesCloneTest-1231922057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:54:44 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-098ae478-07de-47af-bb2b-905f5255ed4b tempest-VolumesCloneTest-1231922057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:54:44 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-098ae478-07de-47af-bb2b-905f5255ed4b tempest-VolumesCloneTest-1231922057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:54:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-098ae478-07de-47af-bb2b-905f5255ed4b tempest-VolumesCloneTest-1231922057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:54:44 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-098ae478-07de-47af-bb2b-905f5255ed4b tempest-VolumesCloneTest-1231922057 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:54:44 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-098ae478-07de-47af-bb2b-905f5255ed4b tempest-VolumesCloneTest-1231922057 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:54:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-098ae478-07de-47af-bb2b-905f5255ed4b tempest-VolumesCloneTest-1231922057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:44 devstack cinder-volume[82485]: DEBUG cinder.volume.volume_utils [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Attempting download of 0fe37db8-916e-4521-8f72-73003c13994a ((None, [{'url': 'file:///opt/stack/data/glance/images/0fe37db8-916e-4521-8f72-73003c13994a', 'metadata': {}}])) to volume b957df94-c7a9-4bbe-9ebc-d676656906f6. {{(pid=82485) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 15 15:54:44 devstack sudo[86148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09 1073741824
Apr 15 15:54:44 devstack sudo[86148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:44 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d5ec59-fb73-4692-ad2b-f015949bb80c]: (4, 'raw') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:54:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0fe37db8-916e-4521-8f72-73003c13994a_751ocmbr {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:44 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-9dcc5ca0-47dc-41ea-bdc1-92ca1203f0e1 tempest-VolumesMetadataTest-644818559 None] Acquiring lock "cinder-59557be6-f3f1-4b73-b5eb-8dea0cc94fa7-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:54:44 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-9dcc5ca0-47dc-41ea-bdc1-92ca1203f0e1 tempest-VolumesMetadataTest-644818559 None] Lock "cinder-59557be6-f3f1-4b73-b5eb-8dea0cc94fa7-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:54:44 devstack cinder-volume[82485]: DEBUG oslo_service.periodic_task [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82485) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 15 15:54:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:54:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:54:44 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:54:44 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:54:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:54:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:44 devstack sudo[86144]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:44 devstack sudo[86154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:54:44 devstack sudo[86154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-44f67dcd-d28d-4acf-aa42-41ad8dede414 tempest-GroupSnapshotsTest-1023701834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b9d72d14-2a39-47e0-ac1d-83dd05a84ced.4d1addb7-9c29-4c58-adc4-7af041a94f10" returned: 0 in 0.727s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-44f67dcd-d28d-4acf-aa42-41ad8dede414 tempest-GroupSnapshotsTest-1023701834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b9d72d14-2a39-47e0-ac1d-83dd05a84ced.4d1addb7-9c29-4c58-adc4-7af041a94f10 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:44 devstack sudo[86152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0fe37db8-916e-4521-8f72-73003c13994a_751ocmbr
Apr 15 15:54:44 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-9dcc5ca0-47dc-41ea-bdc1-92ca1203f0e1 tempest-VolumesMetadataTest-644818559 None] Acquiring lock "cinder-quobyte-59557be6-f3f1-4b73-b5eb-8dea0cc94fa7" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:54:44 devstack sudo[86152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:44 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-9dcc5ca0-47dc-41ea-bdc1-92ca1203f0e1 tempest-VolumesMetadataTest-644818559 None] Lock "cinder-quobyte-59557be6-f3f1-4b73-b5eb-8dea0cc94fa7" acquired by "delete_volume" :: waited 0.012s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:54:44 devstack sudo[86156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b9d72d14-2a39-47e0-ac1d-83dd05a84ced.4d1addb7-9c29-4c58-adc4-7af041a94f10
Apr 15 15:54:44 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06d873c-b5f6-4260-a267-38750968ad06]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:54:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9dcc5ca0-47dc-41ea-bdc1-92ca1203f0e1 tempest-VolumesMetadataTest-644818559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-59557be6-f3f1-4b73-b5eb-8dea0cc94fa7 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:44 devstack sudo[86156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:44 devstack sudo[86159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-59557be6-f3f1-4b73-b5eb-8dea0cc94fa7
Apr 15 15:54:44 devstack sudo[86159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:45 devstack sudo[86156]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:45 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-44f67dcd-d28d-4acf-aa42-41ad8dede414 tempest-GroupSnapshotsTest-1023701834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b9d72d14-2a39-47e0-ac1d-83dd05a84ced.4d1addb7-9c29-4c58-adc4-7af041a94f10" returned: 0 in 0.624s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:45 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-44f67dcd-d28d-4acf-aa42-41ad8dede414 tempest-GroupSnapshotsTest-1023701834 None] Lock "cinder-quobyte-4d1addb7-9c29-4c58-adc4-7af041a94f10" released by "_delete_snapshot" :: held 2.530s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:54:45 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-44f67dcd-d28d-4acf-aa42-41ad8dede414 tempest-GroupSnapshotsTest-1023701834 None] Lock "cinder-quobyte-b9d72d14-2a39-47e0-ac1d-83dd05a84ced" released by "delete_snapshot" :: held 2.550s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:54:45 devstack sudo[86148]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:45 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-44f67dcd-d28d-4acf-aa42-41ad8dede414 tempest-GroupSnapshotsTest-1023701834 None] Acquiring lock "cinder-quobyte-ae7fddf4-96da-41c3-85a9-816bc0db8cd4" by "delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:54:45 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-098ae478-07de-47af-bb2b-905f5255ed4b tempest-VolumesCloneTest-1231922057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09 1073741824" returned: 0 in 1.003s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:45 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-44f67dcd-d28d-4acf-aa42-41ad8dede414 tempest-GroupSnapshotsTest-1023701834 None] Lock "cinder-quobyte-ae7fddf4-96da-41c3-85a9-816bc0db8cd4" acquired by "delete_snapshot" :: waited 0.030s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:54:45 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-44f67dcd-d28d-4acf-aa42-41ad8dede414 tempest-GroupSnapshotsTest-1023701834 None] Acquiring lock "cinder-quobyte-919877bc-4a76-48bd-b3da-cdd014573025" by "_delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:54:45 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-44f67dcd-d28d-4acf-aa42-41ad8dede414 tempest-GroupSnapshotsTest-1023701834 None] Lock "cinder-quobyte-919877bc-4a76-48bd-b3da-cdd014573025" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:54:45 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-44f67dcd-d28d-4acf-aa42-41ad8dede414 tempest-GroupSnapshotsTest-1023701834 None] Deleting offline snapshot 919877bc-4a76-48bd-b3da-cdd014573025 of volume ae7fddf4-96da-41c3-85a9-816bc0db8cd4 {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 15:54:45 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-44f67dcd-d28d-4acf-aa42-41ad8dede414 tempest-GroupSnapshotsTest-1023701834 None] snapshot_file for this snap is: volume-ae7fddf4-96da-41c3-85a9-816bc0db8cd4.919877bc-4a76-48bd-b3da-cdd014573025 {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 15:54:45 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-098ae478-07de-47af-bb2b-905f5255ed4b tempest-VolumesCloneTest-1231922057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:45 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6fe4a3-6eb7-437c-b6f5-8cef22f7d3b7]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:54:45 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-44f67dcd-d28d-4acf-aa42-41ad8dede414 tempest-GroupSnapshotsTest-1023701834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ae7fddf4-96da-41c3-85a9-816bc0db8cd4.919877bc-4a76-48bd-b3da-cdd014573025 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:45 devstack sudo[86169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09
Apr 15 15:54:45 devstack sudo[86169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:45 devstack sudo[86154]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:45 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.934s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:45 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:54:45 devstack sudo[86159]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:45 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9dcc5ca0-47dc-41ea-bdc1-92ca1203f0e1 tempest-VolumesMetadataTest-644818559 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-59557be6-f3f1-4b73-b5eb-8dea0cc94fa7" returned: 0 in 0.844s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:45 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9dcc5ca0-47dc-41ea-bdc1-92ca1203f0e1 tempest-VolumesMetadataTest-644818559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-59557be6-f3f1-4b73-b5eb-8dea0cc94fa7 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:45 devstack sudo[86170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ae7fddf4-96da-41c3-85a9-816bc0db8cd4.919877bc-4a76-48bd-b3da-cdd014573025
Apr 15 15:54:45 devstack sudo[86170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:45 devstack sudo[86152]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:45 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0fe37db8-916e-4521-8f72-73003c13994a_751ocmbr" returned: 0 in 1.161s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:45 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0fe37db8-916e-4521-8f72-73003c13994a_751ocmbr {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:45 devstack sudo[86174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-59557be6-f3f1-4b73-b5eb-8dea0cc94fa7
Apr 15 15:54:45 devstack sudo[86174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:45 devstack sudo[86176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0fe37db8-916e-4521-8f72-73003c13994a_751ocmbr
Apr 15 15:54:45 devstack sudo[86176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:46 devstack sudo[86174]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:46 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9dcc5ca0-47dc-41ea-bdc1-92ca1203f0e1 tempest-VolumesMetadataTest-644818559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-59557be6-f3f1-4b73-b5eb-8dea0cc94fa7" returned: 0 in 0.639s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:46 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-9dcc5ca0-47dc-41ea-bdc1-92ca1203f0e1 tempest-VolumesMetadataTest-644818559 None] Lock "cinder-quobyte-59557be6-f3f1-4b73-b5eb-8dea0cc94fa7" released by "delete_volume" :: held 1.511s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:54:46 devstack sudo[86176]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:46 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0fe37db8-916e-4521-8f72-73003c13994a_751ocmbr" returned: 1 in 0.637s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:46 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0fe37db8-916e-4521-8f72-73003c13994a_751ocmbr' failed. Not Retrying. {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 15:54:46 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[9108632d-a85d-4f0e-8f38-cbf57d87abe3]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:54:46 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fe37db8-916e-4521-8f72-73003c13994a_mfavg7v_devstack@QuobyteHD {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:46 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-9dcc5ca0-47dc-41ea-bdc1-92ca1203f0e1 tempest-VolumesMetadataTest-644818559 None] Created reservations ['09023f31-19a3-4f4f-ab0a-a1756ee768a1', '394ec051-4344-4740-baff-8534f1ff63af', '38a8064a-a400-44f9-a0ef-b037506f719f', 'e5e80c44-0667-45d8-b5c5-ce1882522ae6'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:54:46 devstack sudo[86170]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:46 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-44f67dcd-d28d-4acf-aa42-41ad8dede414 tempest-GroupSnapshotsTest-1023701834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ae7fddf4-96da-41c3-85a9-816bc0db8cd4.919877bc-4a76-48bd-b3da-cdd014573025" returned: 0 in 0.850s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:46 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-44f67dcd-d28d-4acf-aa42-41ad8dede414 tempest-GroupSnapshotsTest-1023701834 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae7fddf4-96da-41c3-85a9-816bc0db8cd4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82485) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 15:54:46 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1cadad0-3ca6-4577-9641-bc7e0ff25560]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:54:46 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-44f67dcd-d28d-4acf-aa42-41ad8dede414 tempest-GroupSnapshotsTest-1023701834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ae7fddf4-96da-41c3-85a9-816bc0db8cd4 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:46 devstack sudo[86169]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:46 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-098ae478-07de-47af-bb2b-905f5255ed4b tempest-VolumesCloneTest-1231922057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09" returned: 0 in 0.903s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:46 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-098ae478-07de-47af-bb2b-905f5255ed4b tempest-VolumesCloneTest-1231922057 None] <== create_volume: return (1996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:54:46 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-098ae478-07de-47af-bb2b-905f5255ed4b tempest-VolumesCloneTest-1231922057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:54:46 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-098ae478-07de-47af-bb2b-905f5255ed4b tempest-VolumesCloneTest-1231922057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e27b7fed-4e30-4bbd-9eb4-1d8e01baed26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:46 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-098ae478-07de-47af-bb2b-905f5255ed4b tempest-VolumesCloneTest-1231922057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f986fd29-eadd-49aa-8696-478e794a442d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:46 devstack sudo[86186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fe37db8-916e-4521-8f72-73003c13994a_mfavg7v_devstack@QuobyteHD
Apr 15 15:54:46 devstack sudo[86186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:46 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-098ae478-07de-47af-bb2b-905f5255ed4b tempest-VolumesCloneTest-1231922057 None] Volume volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09 (5d199e20-bb53-4541-b56f-03aeb0bf2f09): created successfully
Apr 15 15:54:46 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-098ae478-07de-47af-bb2b-905f5255ed4b tempest-VolumesCloneTest-1231922057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f986fd29-eadd-49aa-8696-478e794a442d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:46 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-098ae478-07de-47af-bb2b-905f5255ed4b tempest-VolumesCloneTest-1231922057 None] Flow 'volume_create_manager' (f65b4066-8b3e-4325-8ef4-460cb847a6a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:54:46 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-098ae478-07de-47af-bb2b-905f5255ed4b tempest-VolumesCloneTest-1231922057 None] Created volume successfully.
Apr 15 15:54:46 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-9dcc5ca0-47dc-41ea-bdc1-92ca1203f0e1 tempest-VolumesMetadataTest-644818559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:54:46 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-9dcc5ca0-47dc-41ea-bdc1-92ca1203f0e1 tempest-VolumesMetadataTest-644818559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:54:46 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-9dcc5ca0-47dc-41ea-bdc1-92ca1203f0e1 tempest-VolumesMetadataTest-644818559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:54:46 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-9dcc5ca0-47dc-41ea-bdc1-92ca1203f0e1 tempest-VolumesMetadataTest-644818559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:54:46 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-9dcc5ca0-47dc-41ea-bdc1-92ca1203f0e1 tempest-VolumesMetadataTest-644818559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:54:46 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9dcc5ca0-47dc-41ea-bdc1-92ca1203f0e1 tempest-VolumesMetadataTest-644818559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:46 devstack sudo[86187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ae7fddf4-96da-41c3-85a9-816bc0db8cd4
Apr 15 15:54:46 devstack sudo[86187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:46 devstack sudo[86189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:54:46 devstack sudo[86189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:46 devstack sudo[86187]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:46 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-44f67dcd-d28d-4acf-aa42-41ad8dede414 tempest-GroupSnapshotsTest-1023701834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ae7fddf4-96da-41c3-85a9-816bc0db8cd4" returned: 0 in 0.658s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:46 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-44f67dcd-d28d-4acf-aa42-41ad8dede414 tempest-GroupSnapshotsTest-1023701834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ae7fddf4-96da-41c3-85a9-816bc0db8cd4.919877bc-4a76-48bd-b3da-cdd014573025 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:46 devstack sudo[86189]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:46 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9dcc5ca0-47dc-41ea-bdc1-92ca1203f0e1 tempest-VolumesMetadataTest-644818559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.593s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:46 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-9dcc5ca0-47dc-41ea-bdc1-92ca1203f0e1 tempest-VolumesMetadataTest-644818559 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:54:46 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-9dcc5ca0-47dc-41ea-bdc1-92ca1203f0e1 tempest-VolumesMetadataTest-644818559 None] Deleted volume successfully.
Apr 15 15:54:46 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-9dcc5ca0-47dc-41ea-bdc1-92ca1203f0e1 tempest-VolumesMetadataTest-644818559 None] Lock "cinder-59557be6-f3f1-4b73-b5eb-8dea0cc94fa7-delete_volume" released by "delete_volume" :: held 2.462s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:54:46 devstack sudo[86199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ae7fddf4-96da-41c3-85a9-816bc0db8cd4.919877bc-4a76-48bd-b3da-cdd014573025
Apr 15 15:54:46 devstack sudo[86199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:46 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:54:46 devstack sudo[86186]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:46 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fe37db8-916e-4521-8f72-73003c13994a_mfavg7v_devstack@QuobyteHD" returned: 0 in 0.924s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:47 devstack cinder-volume[82485]: DEBUG cinder.image.image_utils [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] 0fe37db8-916e-4521-8f72-73003c13994a was qcow2, converting to raw {{(pid=82485) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 15 15:54:47 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0fe37db8-916e-4521-8f72-73003c13994a_mfavg7v_devstack@QuobyteHD /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b957df94-c7a9-4bbe-9ebc-d676656906f6 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:47 devstack sudo[86201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0fe37db8-916e-4521-8f72-73003c13994a_mfavg7v_devstack@QuobyteHD /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b957df94-c7a9-4bbe-9ebc-d676656906f6
Apr 15 15:54:47 devstack sudo[86201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:47 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] Flow 'volume_create_manager' (6f672d43-d8e7-45f2-956a-cf38cd50834d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:54:47 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9027309f-d00a-4611-a2b1-8075778b8e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:47 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9027309f-d00a-4611-a2b1-8075778b8e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:54:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1937808136',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97729677-f88b-43bc-ab27-9c7a40d6f97b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5c995063c854b2aa6e9cf83ef79edc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:54:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=5d199e20-bb53-4541-b56f-03aeb0bf2f09,status='creating',terminated_at=None,updated_at=2026-04-15T13:54:47Z,use_quota=True,user_id='2094733baff444a497ef7096beb35683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:47 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8ac7e95-c6b7-4608-882a-7ba92587bb77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:47 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8ac7e95-c6b7-4608-882a-7ba92587bb77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:47 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ae29275-57fc-4d25-91b5-5db134925eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:47 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ae29275-57fc-4d25-91b5-5db134925eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '97729677-f88b-43bc-ab27-9c7a40d6f97b', 'volume_name': 'volume-97729677-f88b-43bc-ab27-9c7a40d6f97b', 'volume_size': 2, 'source_volid': '5d199e20-bb53-4541-b56f-03aeb0bf2f09', 'source_volstatus': 'available'}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:47 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d50135b2-698f-4f2e-b384-0072c5ab4d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:47 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d50135b2-698f-4f2e-b384-0072c5ab4d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:47 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0b3364d-bc6b-4f4c-965b-1cfd4f21b972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:47 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] Volume 97729677-f88b-43bc-ab27-9c7a40d6f97b: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-97729677-f88b-43bc-ab27-9c7a40d6f97b', 'volume_size': 2, 'source_volid': '5d199e20-bb53-4541-b56f-03aeb0bf2f09', 'source_volstatus': 'available'}
Apr 15 15:54:47 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:54:47 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:54:47 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] Cloning volume 5d199e20-bb53-4541-b56f-03aeb0bf2f09 to volume 97729677-f88b-43bc-ab27-9c7a40d6f97b
Apr 15 15:54:47 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] Creating offline snapshot c7ac2648-b5ef-4615-89a7-47095d160c8f of volume 5d199e20-bb53-4541-b56f-03aeb0bf2f09 {{(pid=82485) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 15:54:47 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f6016fe-c82f-4090-bb8a-523288b62962]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:54:47 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:47 devstack sudo[86203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09
Apr 15 15:54:47 devstack sudo[86203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:47 devstack sudo[86199]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:47 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-44f67dcd-d28d-4acf-aa42-41ad8dede414 tempest-GroupSnapshotsTest-1023701834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ae7fddf4-96da-41c3-85a9-816bc0db8cd4.919877bc-4a76-48bd-b3da-cdd014573025" returned: 0 in 0.755s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:47 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-44f67dcd-d28d-4acf-aa42-41ad8dede414 tempest-GroupSnapshotsTest-1023701834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ae7fddf4-96da-41c3-85a9-816bc0db8cd4.919877bc-4a76-48bd-b3da-cdd014573025 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:47 devstack sudo[86208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ae7fddf4-96da-41c3-85a9-816bc0db8cd4.919877bc-4a76-48bd-b3da-cdd014573025
Apr 15 15:54:47 devstack sudo[86208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:48 devstack sudo[86203]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:48 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09" returned: 0 in 0.796s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:48 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09.c7ac2648-b5ef-4615-89a7-47095d160c8f 1G {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:48 devstack sudo[86222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09.c7ac2648-b5ef-4615-89a7-47095d160c8f 1G
Apr 15 15:54:48 devstack sudo[86222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:48 devstack sudo[86208]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:48 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-44f67dcd-d28d-4acf-aa42-41ad8dede414 tempest-GroupSnapshotsTest-1023701834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ae7fddf4-96da-41c3-85a9-816bc0db8cd4.919877bc-4a76-48bd-b3da-cdd014573025" returned: 0 in 0.621s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:48 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-44f67dcd-d28d-4acf-aa42-41ad8dede414 tempest-GroupSnapshotsTest-1023701834 None] Lock "cinder-quobyte-919877bc-4a76-48bd-b3da-cdd014573025" released by "_delete_snapshot" :: held 2.970s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:54:48 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-44f67dcd-d28d-4acf-aa42-41ad8dede414 tempest-GroupSnapshotsTest-1023701834 None] Lock "cinder-quobyte-ae7fddf4-96da-41c3-85a9-816bc0db8cd4" released by "delete_snapshot" :: held 3.000s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:54:48 devstack cinder-volume[82485]: WARNING cinder.quota [None req-44f67dcd-d28d-4acf-aa42-41ad8dede414 tempest-GroupSnapshotsTest-1023701834 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-260477211 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-260477211, it is now deprecated. Please use the default quota class for default quota.
Apr 15 15:54:48 devstack cinder-volume[82485]: WARNING cinder.quota [None req-44f67dcd-d28d-4acf-aa42-41ad8dede414 tempest-GroupSnapshotsTest-1023701834 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-260477211 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-260477211, it is now deprecated. Please use the default quota class for default quota.
Apr 15 15:54:48 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-44f67dcd-d28d-4acf-aa42-41ad8dede414 tempest-GroupSnapshotsTest-1023701834 None] Created reservations ['1e2c3052-7e19-4f37-92f0-0999b14c2641', '7cf87b77-24b1-4c92-9c9e-ad0d033f628c', 'aeff7f30-afe9-42da-88c8-29f3ff4eab1d', 'ff0fdb25-bec4-4205-a5e7-230cccb64d54'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:54:48 devstack sudo[86201]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:48 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0fe37db8-916e-4521-8f72-73003c13994a_mfavg7v_devstack@QuobyteHD /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b957df94-c7a9-4bbe-9ebc-d676656906f6" returned: 0 in 1.479s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:48 devstack cinder-volume[82485]: DEBUG cinder.image.image_utils [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0fe37db8-916e-4521-8f72-73003c13994a_mfavg7v_devstack@QuobyteHD, size 112.00 MB, duration 1.48 sec, destination /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b957df94-c7a9-4bbe-9ebc-d676656906f6 {{(pid=82485) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 15:54:48 devstack cinder-volume[82485]: INFO cinder.image.image_utils [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Converted 112.00 MB image at 75.47 MB/s
Apr 15 15:54:48 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b957df94-c7a9-4bbe-9ebc-d676656906f6 1G {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:48 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-44f67dcd-d28d-4acf-aa42-41ad8dede414 tempest-GroupSnapshotsTest-1023701834 None] Created reservations ['a8ffc273-a02e-4f84-b5b8-55a7ee906623', '1eacbc5c-a7ac-4440-a805-42c55caa62fb', '783ebe4e-6502-4d3e-b8c9-c14f18e53a73', 'bf88aeba-3945-4201-b19e-e612010a93c7'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:54:48 devstack sudo[86224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b957df94-c7a9-4bbe-9ebc-d676656906f6 1G
Apr 15 15:54:48 devstack sudo[86224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:48 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-44f67dcd-d28d-4acf-aa42-41ad8dede414 tempest-GroupSnapshotsTest-1023701834 None] group_snapshot d0f8630d-3b7d-4bec-bf74-922db884734f: deleted successfully
Apr 15 15:54:48 devstack sudo[86222]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:48 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09.c7ac2648-b5ef-4615-89a7-47095d160c8f 1G" returned: 0 in 0.771s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:48 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09.c7ac2648-b5ef-4615-89a7-47095d160c8f {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:48 devstack sudo[86229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09.c7ac2648-b5ef-4615-89a7-47095d160c8f
Apr 15 15:54:48 devstack sudo[86229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:49 devstack sudo[86224]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:49 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b957df94-c7a9-4bbe-9ebc-d676656906f6 1G" returned: 0 in 0.813s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:49 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-1eee0d54-27a3-4cee-affc-28473e40c58d tempest-GroupSnapshotsTest-1023701834 None] Acquiring lock "cinder-quobyte-ae7fddf4-96da-41c3-85a9-816bc0db8cd4" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:54:49 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-1eee0d54-27a3-4cee-affc-28473e40c58d tempest-GroupSnapshotsTest-1023701834 None] Lock "cinder-quobyte-ae7fddf4-96da-41c3-85a9-816bc0db8cd4" acquired by "delete_volume" :: waited 0.015s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:54:49 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[840596e6-d04a-45f2-955e-a5017c855b94]: (4, 'raw') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:54:49 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b957df94-c7a9-4bbe-9ebc-d676656906f6 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:49 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef2cd52-2b29-4958-90ec-394fe715523e]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:54:49 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-1eee0d54-27a3-4cee-affc-28473e40c58d tempest-GroupSnapshotsTest-1023701834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ae7fddf4-96da-41c3-85a9-816bc0db8cd4 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:49 devstack sudo[86234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b957df94-c7a9-4bbe-9ebc-d676656906f6
Apr 15 15:54:49 devstack sudo[86234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:49 devstack sudo[86235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ae7fddf4-96da-41c3-85a9-816bc0db8cd4
Apr 15 15:54:49 devstack sudo[86235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:49 devstack sudo[86229]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:49 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09.c7ac2648-b5ef-4615-89a7-47095d160c8f" returned: 0 in 0.775s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:49 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09.c7ac2648-b5ef-4615-89a7-47095d160c8f is being set with open permissions: ugo+rw
Apr 15 15:54:49 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09.c7ac2648-b5ef-4615-89a7-47095d160c8f {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:49 devstack sudo[86241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09.c7ac2648-b5ef-4615-89a7-47095d160c8f
Apr 15 15:54:49 devstack sudo[86241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:49 devstack sudo[86234]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:49 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b957df94-c7a9-4bbe-9ebc-d676656906f6" returned: 0 in 0.595s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:49 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b957df94-c7a9-4bbe-9ebc-d676656906f6 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:50 devstack sudo[86245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b957df94-c7a9-4bbe-9ebc-d676656906f6
Apr 15 15:54:50 devstack sudo[86245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:50 devstack sudo[86235]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:50 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-1eee0d54-27a3-4cee-affc-28473e40c58d tempest-GroupSnapshotsTest-1023701834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ae7fddf4-96da-41c3-85a9-816bc0db8cd4" returned: 0 in 0.838s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:50 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-1eee0d54-27a3-4cee-affc-28473e40c58d tempest-GroupSnapshotsTest-1023701834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ae7fddf4-96da-41c3-85a9-816bc0db8cd4 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:50 devstack sudo[86251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ae7fddf4-96da-41c3-85a9-816bc0db8cd4
Apr 15 15:54:50 devstack sudo[86251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:50 devstack sudo[86241]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:50 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09.c7ac2648-b5ef-4615-89a7-47095d160c8f" returned: 0 in 0.671s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:50 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09.info {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:50 devstack sudo[86253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09.info
Apr 15 15:54:50 devstack sudo[86253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:50 devstack sudo[86245]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:50 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b957df94-c7a9-4bbe-9ebc-d676656906f6" returned: 1 in 0.682s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:50 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b957df94-c7a9-4bbe-9ebc-d676656906f6' failed. Not Retrying. {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 15:54:50 devstack cinder-volume[82485]: DEBUG cinder.volume.volume_utils [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Downloaded image 0fe37db8-916e-4521-8f72-73003c13994a ((None, [{'url': 'file:///opt/stack/data/glance/images/0fe37db8-916e-4521-8f72-73003c13994a', 'metadata': {}}])) to volume b957df94-c7a9-4bbe-9ebc-d676656906f6 successfully. {{(pid=82485) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 15 15:54:50 devstack cinder-volume[82485]: DEBUG cinder.image.image_utils [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Temporary image 0fe37db8-916e-4521-8f72-73003c13994a for user 35fd433b182747e0901b8a99e1a04327 is deleted. {{(pid=82485) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 15 15:54:50 devstack cinder-volume[82485]: DEBUG cinder.volume.volume_utils [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Marking volume b957df94-c7a9-4bbe-9ebc-d676656906f6 as bootable. {{(pid=82485) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 15 15:54:50 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Copying metadata from image 0fe37db8-916e-4521-8f72-73003c13994a to b957df94-c7a9-4bbe-9ebc-d676656906f6. {{(pid=82485) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 15 15:54:50 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Creating volume glance metadata for volume b957df94-c7a9-4bbe-9ebc-d676656906f6 backed by image 0fe37db8-916e-4521-8f72-73003c13994a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0fe37db8-916e-4521-8f72-73003c13994a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82485) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 15 15:54:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d184d670-b4eb-43f4-a01c-c3c2ae294b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b957df94-c7a9-4bbe-9ebc-d676656906f6', 'volume_size': 1, 'image_id': '0fe37db8-916e-4521-8f72-73003c13994a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0fe37db8-916e-4521-8f72-73003c13994a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '57491fc0e71d4fad9011d017ccefe515', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0fe37db8-916e-4521-8f72-73003c13994a', 'created_at': datetime.datetime(2026, 4, 15, 13, 47, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 13, 47, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0fe37db8-916e-4521-8f72-73003c13994a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f1549cad330>}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (345fe8b9-8329-474d-b6b1-efbadd1b656a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:50 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Volume volume-b957df94-c7a9-4bbe-9ebc-d676656906f6 (b957df94-c7a9-4bbe-9ebc-d676656906f6): created successfully
Apr 15 15:54:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (345fe8b9-8329-474d-b6b1-efbadd1b656a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Flow 'volume_create_manager' (cefd03da-a6c4-4d98-8afe-93c334d726e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:54:50 devstack cinder-volume[82485]: INFO cinder.volume.manager [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-c7254f3e-d504-4ba9-a3bf-7bc03dcb4d76 tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Created volume successfully.
Apr 15 15:54:50 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-70a209cd-0b95-450f-8712-d13ae29db00b tempest-VolumesTransfersV357Test-2107673843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:54:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-70a209cd-0b95-450f-8712-d13ae29db00b tempest-VolumesTransfersV357Test-2107673843 None] Flow 'volume_create_manager' (a823b0f5-aee7-493c-b5ed-b6329cd358cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:54:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-70a209cd-0b95-450f-8712-d13ae29db00b tempest-VolumesTransfersV357Test-2107673843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acda2a95-f1bd-4e60-9daa-429db34f8a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-70a209cd-0b95-450f-8712-d13ae29db00b tempest-VolumesTransfersV357Test-2107673843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acda2a95-f1bd-4e60-9daa-429db34f8a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:54:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-290773944',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d7679c6-fc71-4196-b9d1-ac11d6804ea0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12f562e437904c28ad6718126f40d7ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:54:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:54:51Z,use_quota=True,user_id='e915b5c66b5a40b4b1c282bb75003d17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-70a209cd-0b95-450f-8712-d13ae29db00b tempest-VolumesTransfersV357Test-2107673843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fd05aec-4119-4675-bb8d-41e7330bca66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-70a209cd-0b95-450f-8712-d13ae29db00b tempest-VolumesTransfersV357Test-2107673843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fd05aec-4119-4675-bb8d-41e7330bca66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-70a209cd-0b95-450f-8712-d13ae29db00b tempest-VolumesTransfersV357Test-2107673843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (135442eb-e8cb-4f10-9fc2-259914b2b33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-70a209cd-0b95-450f-8712-d13ae29db00b tempest-VolumesTransfersV357Test-2107673843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (135442eb-e8cb-4f10-9fc2-259914b2b33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d7679c6-fc71-4196-b9d1-ac11d6804ea0', 'volume_name': 'volume-3d7679c6-fc71-4196-b9d1-ac11d6804ea0', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-70a209cd-0b95-450f-8712-d13ae29db00b tempest-VolumesTransfersV357Test-2107673843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b83d86a-99d6-4210-a073-3fea3603b239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-70a209cd-0b95-450f-8712-d13ae29db00b tempest-VolumesTransfersV357Test-2107673843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b83d86a-99d6-4210-a073-3fea3603b239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-70a209cd-0b95-450f-8712-d13ae29db00b tempest-VolumesTransfersV357Test-2107673843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf8fbd4c-396a-4890-8e50-9ec36da7a0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:50 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-70a209cd-0b95-450f-8712-d13ae29db00b tempest-VolumesTransfersV357Test-2107673843 None] Volume 3d7679c6-fc71-4196-b9d1-ac11d6804ea0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d7679c6-fc71-4196-b9d1-ac11d6804ea0', 'volume_size': 1}
Apr 15 15:54:50 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-70a209cd-0b95-450f-8712-d13ae29db00b tempest-VolumesTransfersV357Test-2107673843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:54:50 devstack sudo[86251]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:50 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-1eee0d54-27a3-4cee-affc-28473e40c58d tempest-GroupSnapshotsTest-1023701834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ae7fddf4-96da-41c3-85a9-816bc0db8cd4" returned: 0 in 0.677s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:50 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-1eee0d54-27a3-4cee-affc-28473e40c58d tempest-GroupSnapshotsTest-1023701834 None] Lock "cinder-quobyte-ae7fddf4-96da-41c3-85a9-816bc0db8cd4" released by "delete_volume" :: held 1.586s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:54:50 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-1eee0d54-27a3-4cee-affc-28473e40c58d tempest-GroupSnapshotsTest-1023701834 None] Acquiring lock "cinder-quobyte-b9d72d14-2a39-47e0-ac1d-83dd05a84ced" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:54:50 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-1eee0d54-27a3-4cee-affc-28473e40c58d tempest-GroupSnapshotsTest-1023701834 None] Lock "cinder-quobyte-b9d72d14-2a39-47e0-ac1d-83dd05a84ced" acquired by "delete_volume" :: waited 0.006s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:54:50 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[614e6994-ad07-41eb-a50b-d2fbee7e92f9]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:54:51 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-1eee0d54-27a3-4cee-affc-28473e40c58d tempest-GroupSnapshotsTest-1023701834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b9d72d14-2a39-47e0-ac1d-83dd05a84ced {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:51 devstack sudo[86259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b9d72d14-2a39-47e0-ac1d-83dd05a84ced
Apr 15 15:54:51 devstack sudo[86259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:51 devstack sudo[86253]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:51 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09.info" returned: 0 in 0.816s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:51 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09.info is being set with open permissions: ugo+rw
Apr 15 15:54:51 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09.info {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:51 devstack sudo[86262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09.info
Apr 15 15:54:51 devstack sudo[86262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:51 devstack sudo[86259]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:51 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-1eee0d54-27a3-4cee-affc-28473e40c58d tempest-GroupSnapshotsTest-1023701834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b9d72d14-2a39-47e0-ac1d-83dd05a84ced" returned: 0 in 0.537s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:51 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-1eee0d54-27a3-4cee-affc-28473e40c58d tempest-GroupSnapshotsTest-1023701834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b9d72d14-2a39-47e0-ac1d-83dd05a84ced {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:51 devstack sudo[86268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b9d72d14-2a39-47e0-ac1d-83dd05a84ced
Apr 15 15:54:51 devstack sudo[86268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:51 devstack sudo[86262]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:51 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09.info" returned: 0 in 0.484s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:51 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] Acquiring lock "cinder-quobyte-97729677-f88b-43bc-ab27-9c7a40d6f97b" by "_copy_volume_from_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:54:51 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] Lock "cinder-quobyte-97729677-f88b-43bc-ab27-9c7a40d6f97b" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:54:51 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] snapshot: c7ac2648-b5ef-4615-89a7-47095d160c8f, volume: 97729677-f88b-43bc-ab27-9c7a40d6f97b,  {{(pid=82485) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 15 15:54:51 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:54:51 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:54:51 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:54:51 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:54:51 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:54:51 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee868a0c-61c8-41fe-81f8-17ec83f96acc]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:54:51 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09.c7ac2648-b5ef-4615-89a7-47095d160c8f {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:51 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-cd3c7455-f690-461e-a4c6-f90450219aae tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:54:51 devstack sudo[86278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09.c7ac2648-b5ef-4615-89a7-47095d160c8f
Apr 15 15:54:51 devstack sudo[86278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:52 devstack sudo[86268]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:52 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-1eee0d54-27a3-4cee-affc-28473e40c58d tempest-GroupSnapshotsTest-1023701834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b9d72d14-2a39-47e0-ac1d-83dd05a84ced" returned: 0 in 0.494s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:52 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-1eee0d54-27a3-4cee-affc-28473e40c58d tempest-GroupSnapshotsTest-1023701834 None] Lock "cinder-quobyte-b9d72d14-2a39-47e0-ac1d-83dd05a84ced" released by "delete_volume" :: held 1.087s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:54:52 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-1eee0d54-27a3-4cee-affc-28473e40c58d tempest-GroupSnapshotsTest-1023701834 None] Created reservations ['814dc634-934b-4c2e-95ba-d51108a81de8'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:54:52 devstack cinder-volume[82485]: WARNING cinder.quota [None req-1eee0d54-27a3-4cee-affc-28473e40c58d tempest-GroupSnapshotsTest-1023701834 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-260477211 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-260477211, it is now deprecated. Please use the default quota class for default quota.
Apr 15 15:54:52 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-1eee0d54-27a3-4cee-affc-28473e40c58d tempest-GroupSnapshotsTest-1023701834 None] Created reservations ['d977bb7c-51f8-4f97-96e9-191f69f2a7b8', 'b612e8b9-ec4e-45bf-b441-2315873399a3', '1666f98e-0392-4780-b2a6-0d84fc27d92d', 'db8c7c19-3741-419d-8a90-e690b4d60e17'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:54:52 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-1eee0d54-27a3-4cee-affc-28473e40c58d tempest-GroupSnapshotsTest-1023701834 None] Created reservations ['03abb273-afa1-4139-b018-9d4ca90d789b', '2c9de64c-ef3e-4b0f-9a95-8e641ad0d1ef', '99a98902-93fd-4756-b4ba-ce81bc63f96c', 'd0df7396-01d2-4229-94a7-2f41580b7b0b'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:54:52 devstack sudo[86278]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:52 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-1eee0d54-27a3-4cee-affc-28473e40c58d tempest-GroupSnapshotsTest-1023701834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:54:52 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-1eee0d54-27a3-4cee-affc-28473e40c58d tempest-GroupSnapshotsTest-1023701834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:54:52 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-1eee0d54-27a3-4cee-affc-28473e40c58d tempest-GroupSnapshotsTest-1023701834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:54:52 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-1eee0d54-27a3-4cee-affc-28473e40c58d tempest-GroupSnapshotsTest-1023701834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:54:52 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-1eee0d54-27a3-4cee-affc-28473e40c58d tempest-GroupSnapshotsTest-1023701834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:54:52 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-1eee0d54-27a3-4cee-affc-28473e40c58d tempest-GroupSnapshotsTest-1023701834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:52 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09.c7ac2648-b5ef-4615-89a7-47095d160c8f" returned: 0 in 0.648s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:52 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82485) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 15:54:52 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] will copy from snapshot at /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09 {{(pid=82485) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 15 15:54:52 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] Creating direct copy from snapshot {{(pid=82485) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 15 15:54:52 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57c837c-d34a-4de7-a839-6ed66f11a765]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:54:52 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:52 devstack sudo[86284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:54:52 devstack sudo[86284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:52 devstack sudo[86285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09
Apr 15 15:54:52 devstack sudo[86285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:52 devstack sudo[86284]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:52 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-1eee0d54-27a3-4cee-affc-28473e40c58d tempest-GroupSnapshotsTest-1023701834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.482s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:52 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-1eee0d54-27a3-4cee-affc-28473e40c58d tempest-GroupSnapshotsTest-1023701834 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:54:52 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-1eee0d54-27a3-4cee-affc-28473e40c58d tempest-GroupSnapshotsTest-1023701834 None] Delete group completed successfully.
Apr 15 15:54:52 devstack sudo[86285]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:52 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09" returned: 0 in 0.535s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:52 devstack cinder-volume[82485]: DEBUG cinder.utils [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] Path /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-97729677-f88b-43bc-ab27-9c7a40d6f97b not found in is_blk_device check {{(pid=82485) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 15 15:54:52 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-97729677-f88b-43bc-ab27-9c7a40d6f97b {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:52 devstack sudo[86292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-97729677-f88b-43bc-ab27-9c7a40d6f97b
Apr 15 15:54:52 devstack sudo[86292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:52 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-358e7710-55f3-4d84-8cd7-8577918692b2 tempest-GroupSnapshotsTest-1023701834 None] Group tempest-GroupSnapshotsTest-Group-1643064538: creating
Apr 15 15:54:52 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-358e7710-55f3-4d84-8cd7-8577918692b2 tempest-GroupSnapshotsTest-1023701834 None] Group tempest-GroupSnapshotsTest-Group-1643064538: created successfully
Apr 15 15:54:52 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-358e7710-55f3-4d84-8cd7-8577918692b2 tempest-GroupSnapshotsTest-1023701834 None] Create group completed successfully.
Apr 15 15:54:54 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-a37c6acd-ef3e-4390-952c-56a57ee752d4 tempest-GroupSnapshotsTest-1023701834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:54:55 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-a37c6acd-ef3e-4390-952c-56a57ee752d4 tempest-GroupSnapshotsTest-1023701834 None] Flow 'volume_create_manager' (ea840a74-13d3-44a4-a56d-b60d0a11aa57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:54:55 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-a37c6acd-ef3e-4390-952c-56a57ee752d4 tempest-GroupSnapshotsTest-1023701834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b356ce73-8784-436e-844f-011fc73d3a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:55 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-a37c6acd-ef3e-4390-952c-56a57ee752d4 tempest-GroupSnapshotsTest-1023701834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b356ce73-8784-436e-844f-011fc73d3a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:54:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1603774301',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=02e3daa9-7c81-4354-b8c1-c00c063e8019,host='devstack@QuobyteHD#QuobyteHD',id=331ec049-e057-45e5-a7fc-535bc0fe64ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fce0dc69f99342178f01ef06e0beb61c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:54:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:54:55Z,use_quota=True,user_id='065979835d994434a62276753eaa5fcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c42710cc-3555-47ed-a8af-b9b675c36f15),volume_type_id=c42710cc-3555-47ed-a8af-b9b675c36f15)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:55 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-a37c6acd-ef3e-4390-952c-56a57ee752d4 tempest-GroupSnapshotsTest-1023701834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e449e06-833e-4fcb-915c-286faf09e974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:55 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-a37c6acd-ef3e-4390-952c-56a57ee752d4 tempest-GroupSnapshotsTest-1023701834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e449e06-833e-4fcb-915c-286faf09e974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:55 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-a37c6acd-ef3e-4390-952c-56a57ee752d4 tempest-GroupSnapshotsTest-1023701834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b50646b6-0b1c-4ee3-8630-ea36465b38af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:55 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-a37c6acd-ef3e-4390-952c-56a57ee752d4 tempest-GroupSnapshotsTest-1023701834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b50646b6-0b1c-4ee3-8630-ea36465b38af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '331ec049-e057-45e5-a7fc-535bc0fe64ad', 'volume_name': 'volume-331ec049-e057-45e5-a7fc-535bc0fe64ad', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:55 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-a37c6acd-ef3e-4390-952c-56a57ee752d4 tempest-GroupSnapshotsTest-1023701834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (876da5f7-e3c4-4fae-bec9-85e774e685e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:55 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-a37c6acd-ef3e-4390-952c-56a57ee752d4 tempest-GroupSnapshotsTest-1023701834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (876da5f7-e3c4-4fae-bec9-85e774e685e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:55 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-a37c6acd-ef3e-4390-952c-56a57ee752d4 tempest-GroupSnapshotsTest-1023701834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91d477d9-6e48-48c6-9481-ea77e2a167d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:55 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-a37c6acd-ef3e-4390-952c-56a57ee752d4 tempest-GroupSnapshotsTest-1023701834 None] Volume 331ec049-e057-45e5-a7fc-535bc0fe64ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-331ec049-e057-45e5-a7fc-535bc0fe64ad', 'volume_size': 1}
Apr 15 15:54:55 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-a37c6acd-ef3e-4390-952c-56a57ee752d4 tempest-GroupSnapshotsTest-1023701834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:54:55 devstack sudo[86292]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:55 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-97729677-f88b-43bc-ab27-9c7a40d6f97b" returned: 0 in 2.416s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:55 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[26602448-cdbc-4e15-8b73-7442c19b2241]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:54:55 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:55 devstack sudo[86308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09
Apr 15 15:54:55 devstack sudo[86308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:55 devstack sudo[86308]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:55 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09" returned: 0 in 0.565s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:55 devstack cinder-volume[82485]: DEBUG cinder.image.image_utils [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] Image conversion details: src /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09, size 1024.00 MB, duration 2.42 sec, destination /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-97729677-f88b-43bc-ab27-9c7a40d6f97b {{(pid=82485) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 15:54:55 devstack cinder-volume[82485]: INFO cinder.image.image_utils [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] Converted 1024.00 MB image at 423.75 MB/s
Apr 15 15:54:55 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-97729677-f88b-43bc-ab27-9c7a40d6f97b is being set with open permissions: ugo+rw
Apr 15 15:54:55 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-97729677-f88b-43bc-ab27-9c7a40d6f97b {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:55 devstack sudo[86313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-97729677-f88b-43bc-ab27-9c7a40d6f97b
Apr 15 15:54:55 devstack sudo[86313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:56 devstack sudo[86313]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:56 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-97729677-f88b-43bc-ab27-9c7a40d6f97b" returned: 0 in 0.424s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:56 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] Lock "cinder-quobyte-97729677-f88b-43bc-ab27-9c7a40d6f97b" released by "_copy_volume_from_snapshot" :: held 4.639s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:54:56 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] Acquiring lock "cinder-quobyte-c7ac2648-b5ef-4615-89a7-47095d160c8f" by "_delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:54:56 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] Lock "cinder-quobyte-c7ac2648-b5ef-4615-89a7-47095d160c8f" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:54:56 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] Deleting offline snapshot c7ac2648-b5ef-4615-89a7-47095d160c8f of volume 5d199e20-bb53-4541-b56f-03aeb0bf2f09 {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 15:54:56 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] snapshot_file for this snap is: volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09.c7ac2648-b5ef-4615-89a7-47095d160c8f {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 15:54:56 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[14477f6e-1169-4eb9-84b6-058564d06ff5]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:54:56 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09.c7ac2648-b5ef-4615-89a7-47095d160c8f {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:56 devstack sudo[86316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09.c7ac2648-b5ef-4615-89a7-47095d160c8f
Apr 15 15:54:56 devstack sudo[86316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:56 devstack sudo[86316]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:56 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09.c7ac2648-b5ef-4615-89a7-47095d160c8f" returned: 0 in 0.471s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:56 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82485) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 15:54:56 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[660741a4-7311-4f9c-a10f-f77ef7f64a2c]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:54:56 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:56 devstack sudo[86321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09
Apr 15 15:54:56 devstack sudo[86321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:57 devstack sudo[86321]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09" returned: 0 in 0.487s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09.c7ac2648-b5ef-4615-89a7-47095d160c8f {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:57 devstack sudo[86326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09.c7ac2648-b5ef-4615-89a7-47095d160c8f
Apr 15 15:54:57 devstack sudo[86326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:57 devstack sudo[86326]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09.c7ac2648-b5ef-4615-89a7-47095d160c8f" returned: 0 in 0.435s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09.c7ac2648-b5ef-4615-89a7-47095d160c8f {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:57 devstack sudo[86331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09.c7ac2648-b5ef-4615-89a7-47095d160c8f
Apr 15 15:54:57 devstack sudo[86331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:58 devstack sudo[86331]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09.c7ac2648-b5ef-4615-89a7-47095d160c8f" returned: 0 in 0.404s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:58 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] Lock "cinder-quobyte-c7ac2648-b5ef-4615-89a7-47095d160c8f" released by "_delete_snapshot" :: held 1.849s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:54:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.952s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:54:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-70a209cd-0b95-450f-8712-d13ae29db00b tempest-VolumesTransfersV357Test-2107673843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.296s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:54:58 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-70a209cd-0b95-450f-8712-d13ae29db00b tempest-VolumesTransfersV357Test-2107673843 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:54:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-290773944',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d7679c6-fc71-4196-b9d1-ac11d6804ea0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12f562e437904c28ad6718126f40d7ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:54:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:54:51Z,use_quota=True,user_id='e915b5c66b5a40b4b1c282bb75003d17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:54:58 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-70a209cd-0b95-450f-8712-d13ae29db00b tempest-VolumesTransfersV357Test-2107673843 None] Creating volume 3d7679c6-fc71-4196-b9d1-ac11d6804ea0 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:54:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-70a209cd-0b95-450f-8712-d13ae29db00b tempest-VolumesTransfersV357Test-2107673843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:54:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-70a209cd-0b95-450f-8712-d13ae29db00b tempest-VolumesTransfersV357Test-2107673843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:54:58 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-70a209cd-0b95-450f-8712-d13ae29db00b tempest-VolumesTransfersV357Test-2107673843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:54:58 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-70a209cd-0b95-450f-8712-d13ae29db00b tempest-VolumesTransfersV357Test-2107673843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:54:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-70a209cd-0b95-450f-8712-d13ae29db00b tempest-VolumesTransfersV357Test-2107673843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:54:58 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-70a209cd-0b95-450f-8712-d13ae29db00b tempest-VolumesTransfersV357Test-2107673843 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:54:58 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-70a209cd-0b95-450f-8712-d13ae29db00b tempest-VolumesTransfersV357Test-2107673843 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:54:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-70a209cd-0b95-450f-8712-d13ae29db00b tempest-VolumesTransfersV357Test-2107673843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3d7679c6-fc71-4196-b9d1-ac11d6804ea0 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:58 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0b3364d-bc6b-4f4c-965b-1cfd4f21b972) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97729677-f88b-43bc-ab27-9c7a40d6f97b', 'volume_size': 2, 'source_volid': '5d199e20-bb53-4541-b56f-03aeb0bf2f09', 'source_volstatus': 'available'}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:58 devstack sudo[86334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3d7679c6-fc71-4196-b9d1-ac11d6804ea0 1073741824
Apr 15 15:54:58 devstack sudo[86334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:58 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb17967e-4ca7-4ef0-bca9-187a8133187c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:58 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] Volume volume-97729677-f88b-43bc-ab27-9c7a40d6f97b (97729677-f88b-43bc-ab27-9c7a40d6f97b): created successfully
Apr 15 15:54:58 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb17967e-4ca7-4ef0-bca9-187a8133187c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:58 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] Flow 'volume_create_manager' (6f672d43-d8e7-45f2-956a-cf38cd50834d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:54:58 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-49a05e93-8d3f-4353-a289-44297d56c21f tempest-VolumesCloneTest-1231922057 None] Created volume successfully.
Apr 15 15:54:58 devstack sudo[86334]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-70a209cd-0b95-450f-8712-d13ae29db00b tempest-VolumesTransfersV357Test-2107673843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3d7679c6-fc71-4196-b9d1-ac11d6804ea0 1073741824" returned: 0 in 0.510s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-70a209cd-0b95-450f-8712-d13ae29db00b tempest-VolumesTransfersV357Test-2107673843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3d7679c6-fc71-4196-b9d1-ac11d6804ea0 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:58 devstack sudo[86339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3d7679c6-fc71-4196-b9d1-ac11d6804ea0
Apr 15 15:54:58 devstack sudo[86339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:59 devstack sudo[86339]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:59 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-70a209cd-0b95-450f-8712-d13ae29db00b tempest-VolumesTransfersV357Test-2107673843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3d7679c6-fc71-4196-b9d1-ac11d6804ea0" returned: 0 in 0.418s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:59 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-70a209cd-0b95-450f-8712-d13ae29db00b tempest-VolumesTransfersV357Test-2107673843 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:54:59 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-70a209cd-0b95-450f-8712-d13ae29db00b tempest-VolumesTransfersV357Test-2107673843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:54:59 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-cd3c7455-f690-461e-a4c6-f90450219aae tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.428s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:54:59 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-70a209cd-0b95-450f-8712-d13ae29db00b tempest-VolumesTransfersV357Test-2107673843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf8fbd4c-396a-4890-8e50-9ec36da7a0fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d7679c6-fc71-4196-b9d1-ac11d6804ea0', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:59 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-70a209cd-0b95-450f-8712-d13ae29db00b tempest-VolumesTransfersV357Test-2107673843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d7e10e3-0d9a-495b-ae62-df7804796200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:54:59 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-70a209cd-0b95-450f-8712-d13ae29db00b tempest-VolumesTransfersV357Test-2107673843 None] Volume volume-3d7679c6-fc71-4196-b9d1-ac11d6804ea0 (3d7679c6-fc71-4196-b9d1-ac11d6804ea0): created successfully
Apr 15 15:54:59 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-70a209cd-0b95-450f-8712-d13ae29db00b tempest-VolumesTransfersV357Test-2107673843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d7e10e3-0d9a-495b-ae62-df7804796200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:54:59 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-70a209cd-0b95-450f-8712-d13ae29db00b tempest-VolumesTransfersV357Test-2107673843 None] Flow 'volume_create_manager' (a823b0f5-aee7-493c-b5ed-b6329cd358cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:54:59 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b374ed-fec5-4598-9e84-44b5d509c992]: (4, 'raw') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:54:59 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-cd3c7455-f690-461e-a4c6-f90450219aae tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b957df94-c7a9-4bbe-9ebc-d676656906f6 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:59 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-70a209cd-0b95-450f-8712-d13ae29db00b tempest-VolumesTransfersV357Test-2107673843 None] Created volume successfully.
Apr 15 15:54:59 devstack sudo[86342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b957df94-c7a9-4bbe-9ebc-d676656906f6
Apr 15 15:54:59 devstack sudo[86342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:59 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-b84aa9be-2093-41c5-8f18-65abc86d2368 tempest-VolumesCloneTest-1231922057 None] Acquiring lock "cinder-97729677-f88b-43bc-ab27-9c7a40d6f97b-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:54:59 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-b84aa9be-2093-41c5-8f18-65abc86d2368 tempest-VolumesCloneTest-1231922057 None] Lock "cinder-97729677-f88b-43bc-ab27-9c7a40d6f97b-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:54:59 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-b84aa9be-2093-41c5-8f18-65abc86d2368 tempest-VolumesCloneTest-1231922057 None] Acquiring lock "cinder-quobyte-97729677-f88b-43bc-ab27-9c7a40d6f97b" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:54:59 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-b84aa9be-2093-41c5-8f18-65abc86d2368 tempest-VolumesCloneTest-1231922057 None] Lock "cinder-quobyte-97729677-f88b-43bc-ab27-9c7a40d6f97b" acquired by "delete_volume" :: waited 0.009s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:54:59 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5813c9-7299-471c-a56a-6ad8bed65f34]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:54:59 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b84aa9be-2093-41c5-8f18-65abc86d2368 tempest-VolumesCloneTest-1231922057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-97729677-f88b-43bc-ab27-9c7a40d6f97b {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:59 devstack sudo[86344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-97729677-f88b-43bc-ab27-9c7a40d6f97b
Apr 15 15:54:59 devstack sudo[86344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:59 devstack sudo[86342]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:59 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-cd3c7455-f690-461e-a4c6-f90450219aae tempest-ServerBootFromVolumeStableRescueTest-854633972 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b957df94-c7a9-4bbe-9ebc-d676656906f6" returned: 0 in 0.508s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:54:59 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-cd3c7455-f690-461e-a4c6-f90450219aae tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b957df94-c7a9-4bbe-9ebc-d676656906f6 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:54:59 devstack sudo[86348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b957df94-c7a9-4bbe-9ebc-d676656906f6
Apr 15 15:54:59 devstack sudo[86348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:54:59 devstack sudo[86344]: pam_unix(sudo:session): session closed for user root
Apr 15 15:54:59 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-4341961d-2456-4daa-ab0b-a831b3eb1686 tempest-VolumesTransfersV357Test-720384036 None] Transfer volume completed successfully.
Apr 15 15:55:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b84aa9be-2093-41c5-8f18-65abc86d2368 tempest-VolumesCloneTest-1231922057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-97729677-f88b-43bc-ab27-9c7a40d6f97b" returned: 0 in 0.625s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b84aa9be-2093-41c5-8f18-65abc86d2368 tempest-VolumesCloneTest-1231922057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-97729677-f88b-43bc-ab27-9c7a40d6f97b {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:00 devstack sudo[86353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-97729677-f88b-43bc-ab27-9c7a40d6f97b
Apr 15 15:55:00 devstack sudo[86353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:00 devstack sudo[86348]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-cd3c7455-f690-461e-a4c6-f90450219aae tempest-ServerBootFromVolumeStableRescueTest-854633972 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b957df94-c7a9-4bbe-9ebc-d676656906f6" returned: 1 in 0.635s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-cd3c7455-f690-461e-a4c6-f90450219aae tempest-ServerBootFromVolumeStableRescueTest-854633972 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b957df94-c7a9-4bbe-9ebc-d676656906f6' failed. Not Retrying. {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 15:55:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-cd3c7455-f690-461e-a4c6-f90450219aae tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.185s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:55:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-a37c6acd-ef3e-4390-952c-56a57ee752d4 tempest-GroupSnapshotsTest-1023701834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.173s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:55:00 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-a37c6acd-ef3e-4390-952c-56a57ee752d4 tempest-GroupSnapshotsTest-1023701834 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=02e3daa9-7c81-4354-b8c1-c00c063e8019,created_at=2026-04-15T13:54:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1603774301',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=02e3daa9-7c81-4354-b8c1-c00c063e8019,host='devstack@QuobyteHD#QuobyteHD',id=331ec049-e057-45e5-a7fc-535bc0fe64ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fce0dc69f99342178f01ef06e0beb61c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:54:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:54:55Z,use_quota=True,user_id='065979835d994434a62276753eaa5fcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c42710cc-3555-47ed-a8af-b9b675c36f15),volume_type_id=c42710cc-3555-47ed-a8af-b9b675c36f15)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:55:00 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-a37c6acd-ef3e-4390-952c-56a57ee752d4 tempest-GroupSnapshotsTest-1023701834 None] Creating volume 331ec049-e057-45e5-a7fc-535bc0fe64ad {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:55:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-a37c6acd-ef3e-4390-952c-56a57ee752d4 tempest-GroupSnapshotsTest-1023701834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:55:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-a37c6acd-ef3e-4390-952c-56a57ee752d4 tempest-GroupSnapshotsTest-1023701834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:55:00 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-a37c6acd-ef3e-4390-952c-56a57ee752d4 tempest-GroupSnapshotsTest-1023701834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:55:00 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-a37c6acd-ef3e-4390-952c-56a57ee752d4 tempest-GroupSnapshotsTest-1023701834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:55:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-a37c6acd-ef3e-4390-952c-56a57ee752d4 tempest-GroupSnapshotsTest-1023701834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:55:00 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-a37c6acd-ef3e-4390-952c-56a57ee752d4 tempest-GroupSnapshotsTest-1023701834 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:55:00 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-a37c6acd-ef3e-4390-952c-56a57ee752d4 tempest-GroupSnapshotsTest-1023701834 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:55:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-a37c6acd-ef3e-4390-952c-56a57ee752d4 tempest-GroupSnapshotsTest-1023701834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-331ec049-e057-45e5-a7fc-535bc0fe64ad 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:00 devstack sudo[86358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-331ec049-e057-45e5-a7fc-535bc0fe64ad 1073741824
Apr 15 15:55:00 devstack sudo[86358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:00 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-cd3c7455-f690-461e-a4c6-f90450219aae tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c', 'name': 'volume-b957df94-c7a9-4bbe-9ebc-d676656906f6', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '876d16b9-b34b-4262-8194-b7a3a471d865', 'enforce_multipath': True} {{(pid=82485) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 15 15:55:00 devstack cinder-volume[82485]: INFO cinder.volume.manager [req-1acb3fd2-803a-4d47-8906-a565f9ac6b6c req-cd3c7455-f690-461e-a4c6-f90450219aae tempest-ServerBootFromVolumeStableRescueTest-854633972 None] attachment_update completed successfully.
Apr 15 15:55:00 devstack sudo[86353]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b84aa9be-2093-41c5-8f18-65abc86d2368 tempest-VolumesCloneTest-1231922057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-97729677-f88b-43bc-ab27-9c7a40d6f97b" returned: 0 in 0.475s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:00 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-b84aa9be-2093-41c5-8f18-65abc86d2368 tempest-VolumesCloneTest-1231922057 None] Lock "cinder-quobyte-97729677-f88b-43bc-ab27-9c7a40d6f97b" released by "delete_volume" :: held 1.126s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:55:00 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-b84aa9be-2093-41c5-8f18-65abc86d2368 tempest-VolumesCloneTest-1231922057 None] Created reservations ['be03401e-2820-4bca-a012-6fe69b613232', '9c858231-a103-4d17-b13b-0b58221fc681', '77f3d24c-175d-4bed-940e-d0b27d8142c2', '645d9439-a24c-4669-9edb-da6f6addfe09'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:55:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-b84aa9be-2093-41c5-8f18-65abc86d2368 tempest-VolumesCloneTest-1231922057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:55:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-b84aa9be-2093-41c5-8f18-65abc86d2368 tempest-VolumesCloneTest-1231922057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:55:00 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-b84aa9be-2093-41c5-8f18-65abc86d2368 tempest-VolumesCloneTest-1231922057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:55:00 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-b84aa9be-2093-41c5-8f18-65abc86d2368 tempest-VolumesCloneTest-1231922057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:55:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-b84aa9be-2093-41c5-8f18-65abc86d2368 tempest-VolumesCloneTest-1231922057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:55:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b84aa9be-2093-41c5-8f18-65abc86d2368 tempest-VolumesCloneTest-1231922057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:00 devstack sudo[86361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:55:00 devstack sudo[86361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:00 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-d17f4797-a338-49f4-98a5-0c5e9b0d32c6 tempest-VolumesCloneTest-1231922057 None] Acquiring lock "cinder-5d199e20-bb53-4541-b56f-03aeb0bf2f09-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:55:00 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-d17f4797-a338-49f4-98a5-0c5e9b0d32c6 tempest-VolumesCloneTest-1231922057 None] Lock "cinder-5d199e20-bb53-4541-b56f-03aeb0bf2f09-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:55:00 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-d17f4797-a338-49f4-98a5-0c5e9b0d32c6 tempest-VolumesCloneTest-1231922057 None] Acquiring lock "cinder-quobyte-5d199e20-bb53-4541-b56f-03aeb0bf2f09" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:55:00 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-d17f4797-a338-49f4-98a5-0c5e9b0d32c6 tempest-VolumesCloneTest-1231922057 None] Lock "cinder-quobyte-5d199e20-bb53-4541-b56f-03aeb0bf2f09" acquired by "delete_volume" :: waited 0.012s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:55:00 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[2786d87e-7e4e-4d28-9b83-9d520c49102f]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:55:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-d17f4797-a338-49f4-98a5-0c5e9b0d32c6 tempest-VolumesCloneTest-1231922057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:01 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-4a691347-5ca3-4af0-86a4-134e8b4545da tempest-VolumesTransfersV357Test-1299969734 None] Acquiring lock "cinder-3d7679c6-fc71-4196-b9d1-ac11d6804ea0-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:55:01 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-4a691347-5ca3-4af0-86a4-134e8b4545da tempest-VolumesTransfersV357Test-1299969734 None] Lock "cinder-3d7679c6-fc71-4196-b9d1-ac11d6804ea0-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:55:01 devstack sudo[86358]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:01 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-4a691347-5ca3-4af0-86a4-134e8b4545da tempest-VolumesTransfersV357Test-1299969734 None] Acquiring lock "cinder-quobyte-3d7679c6-fc71-4196-b9d1-ac11d6804ea0" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:55:01 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-a37c6acd-ef3e-4390-952c-56a57ee752d4 tempest-GroupSnapshotsTest-1023701834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-331ec049-e057-45e5-a7fc-535bc0fe64ad 1073741824" returned: 0 in 0.715s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:01 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-a37c6acd-ef3e-4390-952c-56a57ee752d4 tempest-GroupSnapshotsTest-1023701834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-331ec049-e057-45e5-a7fc-535bc0fe64ad {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:01 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-4a691347-5ca3-4af0-86a4-134e8b4545da tempest-VolumesTransfersV357Test-1299969734 None] Lock "cinder-quobyte-3d7679c6-fc71-4196-b9d1-ac11d6804ea0" acquired by "delete_volume" :: waited 0.063s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:55:01 devstack sudo[86366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09
Apr 15 15:55:01 devstack sudo[86366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:01 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3e7d8d-6b69-4d11-9535-7b01fa284e54]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:55:01 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4a691347-5ca3-4af0-86a4-134e8b4545da tempest-VolumesTransfersV357Test-1299969734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3d7679c6-fc71-4196-b9d1-ac11d6804ea0 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:01 devstack sudo[86368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-331ec049-e057-45e5-a7fc-535bc0fe64ad
Apr 15 15:55:01 devstack sudo[86368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:01 devstack sudo[86361]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:01 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b84aa9be-2093-41c5-8f18-65abc86d2368 tempest-VolumesCloneTest-1231922057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.637s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:01 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-b84aa9be-2093-41c5-8f18-65abc86d2368 tempest-VolumesCloneTest-1231922057 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:55:01 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-b84aa9be-2093-41c5-8f18-65abc86d2368 tempest-VolumesCloneTest-1231922057 None] Deleted volume successfully.
Apr 15 15:55:01 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-b84aa9be-2093-41c5-8f18-65abc86d2368 tempest-VolumesCloneTest-1231922057 None] Lock "cinder-97729677-f88b-43bc-ab27-9c7a40d6f97b-delete_volume" released by "delete_volume" :: held 1.919s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:55:01 devstack sudo[86370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3d7679c6-fc71-4196-b9d1-ac11d6804ea0
Apr 15 15:55:01 devstack sudo[86370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:01 devstack sudo[86366]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:01 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-d17f4797-a338-49f4-98a5-0c5e9b0d32c6 tempest-VolumesCloneTest-1231922057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09" returned: 0 in 0.630s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:01 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-d17f4797-a338-49f4-98a5-0c5e9b0d32c6 tempest-VolumesCloneTest-1231922057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:01 devstack sudo[86377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09
Apr 15 15:55:01 devstack sudo[86377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:01 devstack sudo[86368]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:01 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-a37c6acd-ef3e-4390-952c-56a57ee752d4 tempest-GroupSnapshotsTest-1023701834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-331ec049-e057-45e5-a7fc-535bc0fe64ad" returned: 0 in 0.588s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:01 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-a37c6acd-ef3e-4390-952c-56a57ee752d4 tempest-GroupSnapshotsTest-1023701834 None] <== create_volume: return (1344ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:55:01 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-a37c6acd-ef3e-4390-952c-56a57ee752d4 tempest-GroupSnapshotsTest-1023701834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.348s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:55:01 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-a37c6acd-ef3e-4390-952c-56a57ee752d4 tempest-GroupSnapshotsTest-1023701834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91d477d9-6e48-48c6-9481-ea77e2a167d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-331ec049-e057-45e5-a7fc-535bc0fe64ad', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:01 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-a37c6acd-ef3e-4390-952c-56a57ee752d4 tempest-GroupSnapshotsTest-1023701834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0840aec-9cc7-4a7f-a664-03019f1d61c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:01 devstack sudo[86370]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:01 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-a37c6acd-ef3e-4390-952c-56a57ee752d4 tempest-GroupSnapshotsTest-1023701834 None] Volume volume-331ec049-e057-45e5-a7fc-535bc0fe64ad (331ec049-e057-45e5-a7fc-535bc0fe64ad): created successfully
Apr 15 15:55:01 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-a37c6acd-ef3e-4390-952c-56a57ee752d4 tempest-GroupSnapshotsTest-1023701834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0840aec-9cc7-4a7f-a664-03019f1d61c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:01 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-a37c6acd-ef3e-4390-952c-56a57ee752d4 tempest-GroupSnapshotsTest-1023701834 None] Flow 'volume_create_manager' (ea840a74-13d3-44a4-a56d-b60d0a11aa57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:55:01 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4a691347-5ca3-4af0-86a4-134e8b4545da tempest-VolumesTransfersV357Test-1299969734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3d7679c6-fc71-4196-b9d1-ac11d6804ea0" returned: 0 in 0.566s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:01 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4a691347-5ca3-4af0-86a4-134e8b4545da tempest-VolumesTransfersV357Test-1299969734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3d7679c6-fc71-4196-b9d1-ac11d6804ea0 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:01 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-a37c6acd-ef3e-4390-952c-56a57ee752d4 tempest-GroupSnapshotsTest-1023701834 None] Created volume successfully.
Apr 15 15:55:01 devstack sudo[86382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3d7679c6-fc71-4196-b9d1-ac11d6804ea0
Apr 15 15:55:01 devstack sudo[86382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:02 devstack sudo[86377]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:02 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-d17f4797-a338-49f4-98a5-0c5e9b0d32c6 tempest-VolumesCloneTest-1231922057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5d199e20-bb53-4541-b56f-03aeb0bf2f09" returned: 0 in 0.451s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:02 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-d17f4797-a338-49f4-98a5-0c5e9b0d32c6 tempest-VolumesCloneTest-1231922057 None] Lock "cinder-quobyte-5d199e20-bb53-4541-b56f-03aeb0bf2f09" released by "delete_volume" :: held 1.117s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:55:02 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-d17f4797-a338-49f4-98a5-0c5e9b0d32c6 tempest-VolumesCloneTest-1231922057 None] Created reservations ['611e4e3f-3cb0-4b8c-a6b8-99fcec6ecaed', '4987d89c-fd21-41a3-909f-38e55210a0be', '9117a21c-9474-41f9-9367-aa57c37cbcae', '1c6a80d7-2929-4b6a-9320-d2557b65362e'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:55:02 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-d17f4797-a338-49f4-98a5-0c5e9b0d32c6 tempest-VolumesCloneTest-1231922057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:55:02 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-d17f4797-a338-49f4-98a5-0c5e9b0d32c6 tempest-VolumesCloneTest-1231922057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:55:02 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-d17f4797-a338-49f4-98a5-0c5e9b0d32c6 tempest-VolumesCloneTest-1231922057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:55:02 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-d17f4797-a338-49f4-98a5-0c5e9b0d32c6 tempest-VolumesCloneTest-1231922057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:55:02 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-d17f4797-a338-49f4-98a5-0c5e9b0d32c6 tempest-VolumesCloneTest-1231922057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:55:02 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-d17f4797-a338-49f4-98a5-0c5e9b0d32c6 tempest-VolumesCloneTest-1231922057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:02 devstack sudo[86386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:55:02 devstack sudo[86386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:02 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4a691347-5ca3-4af0-86a4-134e8b4545da tempest-VolumesTransfersV357Test-1299969734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3d7679c6-fc71-4196-b9d1-ac11d6804ea0" returned: 0 in 0.439s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:02 devstack sudo[86382]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:02 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-4a691347-5ca3-4af0-86a4-134e8b4545da tempest-VolumesTransfersV357Test-1299969734 None] Lock "cinder-quobyte-3d7679c6-fc71-4196-b9d1-ac11d6804ea0" released by "delete_volume" :: held 1.042s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:55:02 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-4a691347-5ca3-4af0-86a4-134e8b4545da tempest-VolumesTransfersV357Test-1299969734 None] Created reservations ['d634814a-5c08-415f-b1d0-e6f8a7ee0409', 'beb66e3a-b8c7-4ad4-9464-d7dab46d499a', '5eaf4f76-e572-48bd-87ea-eb21cfa6edc4', '8ca493c3-09ff-4283-bec7-09e52c2f5760'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:55:02 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-4a691347-5ca3-4af0-86a4-134e8b4545da tempest-VolumesTransfersV357Test-1299969734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:55:02 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-4a691347-5ca3-4af0-86a4-134e8b4545da tempest-VolumesTransfersV357Test-1299969734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:55:02 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-4a691347-5ca3-4af0-86a4-134e8b4545da tempest-VolumesTransfersV357Test-1299969734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:55:02 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-4a691347-5ca3-4af0-86a4-134e8b4545da tempest-VolumesTransfersV357Test-1299969734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:55:02 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-4a691347-5ca3-4af0-86a4-134e8b4545da tempest-VolumesTransfersV357Test-1299969734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:55:02 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4a691347-5ca3-4af0-86a4-134e8b4545da tempest-VolumesTransfersV357Test-1299969734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:02 devstack sudo[86388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:55:02 devstack sudo[86388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:02 devstack sudo[86386]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:02 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-d17f4797-a338-49f4-98a5-0c5e9b0d32c6 tempest-VolumesCloneTest-1231922057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.458s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:02 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-d17f4797-a338-49f4-98a5-0c5e9b0d32c6 tempest-VolumesCloneTest-1231922057 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:55:02 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-d17f4797-a338-49f4-98a5-0c5e9b0d32c6 tempest-VolumesCloneTest-1231922057 None] Deleted volume successfully.
Apr 15 15:55:02 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-d17f4797-a338-49f4-98a5-0c5e9b0d32c6 tempest-VolumesCloneTest-1231922057 None] Lock "cinder-5d199e20-bb53-4541-b56f-03aeb0bf2f09-delete_volume" released by "delete_volume" :: held 1.726s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:55:02 devstack sudo[86388]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:02 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4a691347-5ca3-4af0-86a4-134e8b4545da tempest-VolumesTransfersV357Test-1299969734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.430s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:02 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-4a691347-5ca3-4af0-86a4-134e8b4545da tempest-VolumesTransfersV357Test-1299969734 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:55:02 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-4a691347-5ca3-4af0-86a4-134e8b4545da tempest-VolumesTransfersV357Test-1299969734 None] Deleted volume successfully.
Apr 15 15:55:02 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-4a691347-5ca3-4af0-86a4-134e8b4545da tempest-VolumesTransfersV357Test-1299969734 None] Lock "cinder-3d7679c6-fc71-4196-b9d1-ac11d6804ea0-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:55:02 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-00a320fc-8e24-4720-9a68-384b2bbda641 tempest-GroupSnapshotsTest-1023701834 None] GroupSnapshot b8b55cce-bd65-48d5-bfda-85f465600405: creating.
Apr 15 15:55:02 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-00a320fc-8e24-4720-9a68-384b2bbda641 tempest-GroupSnapshotsTest-1023701834 None] Group snapshot b8b55cce-bd65-48d5-bfda-85f465600405: creating. {{(pid=82485) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 15 15:55:02 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-00a320fc-8e24-4720-9a68-384b2bbda641 tempest-GroupSnapshotsTest-1023701834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:55:02 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-00a320fc-8e24-4720-9a68-384b2bbda641 tempest-GroupSnapshotsTest-1023701834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:55:02 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-00a320fc-8e24-4720-9a68-384b2bbda641 tempest-GroupSnapshotsTest-1023701834 None] Creating offline snapshot 1b2216ae-f3dd-4e26-869e-9453b9740579 of volume 331ec049-e057-45e5-a7fc-535bc0fe64ad {{(pid=82485) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 15:55:03 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[38828570-bc40-4457-a4b9-0586937ec576]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:55:03 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-00a320fc-8e24-4720-9a68-384b2bbda641 tempest-GroupSnapshotsTest-1023701834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-331ec049-e057-45e5-a7fc-535bc0fe64ad {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:03 devstack sudo[86392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-331ec049-e057-45e5-a7fc-535bc0fe64ad
Apr 15 15:55:03 devstack sudo[86392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:03 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-24d44827-0928-43e0-90c3-b87ce16c8774 tempest-VolumesTransfersV357Test-2107673843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:55:03 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-24d44827-0928-43e0-90c3-b87ce16c8774 tempest-VolumesTransfersV357Test-2107673843 None] Flow 'volume_create_manager' (2a5f1305-1886-4943-abc3-0c2485a9f4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:55:03 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-24d44827-0928-43e0-90c3-b87ce16c8774 tempest-VolumesTransfersV357Test-2107673843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (171b58d3-0cfe-4727-9713-f82baf94615f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:03 devstack sudo[86392]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:03 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-00a320fc-8e24-4720-9a68-384b2bbda641 tempest-GroupSnapshotsTest-1023701834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-331ec049-e057-45e5-a7fc-535bc0fe64ad" returned: 0 in 0.595s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:03 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-24d44827-0928-43e0-90c3-b87ce16c8774 tempest-VolumesTransfersV357Test-2107673843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (171b58d3-0cfe-4727-9713-f82baf94615f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:55:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1264600335',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de5a4cde-8aac-442d-a012-4ade21158de7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12f562e437904c28ad6718126f40d7ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:55:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:55:04Z,use_quota=True,user_id='e915b5c66b5a40b4b1c282bb75003d17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:03 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-24d44827-0928-43e0-90c3-b87ce16c8774 tempest-VolumesTransfersV357Test-2107673843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b68ed94-a900-4265-94bb-a95fd46761d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:03 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-24d44827-0928-43e0-90c3-b87ce16c8774 tempest-VolumesTransfersV357Test-2107673843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b68ed94-a900-4265-94bb-a95fd46761d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:03 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-24d44827-0928-43e0-90c3-b87ce16c8774 tempest-VolumesTransfersV357Test-2107673843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e282c5fb-9800-4cb6-961a-6a56c6f6fc1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:03 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-24d44827-0928-43e0-90c3-b87ce16c8774 tempest-VolumesTransfersV357Test-2107673843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e282c5fb-9800-4cb6-961a-6a56c6f6fc1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de5a4cde-8aac-442d-a012-4ade21158de7', 'volume_name': 'volume-de5a4cde-8aac-442d-a012-4ade21158de7', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:03 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-24d44827-0928-43e0-90c3-b87ce16c8774 tempest-VolumesTransfersV357Test-2107673843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0c98442-17de-4354-bbb9-60eeee100efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:03 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-24d44827-0928-43e0-90c3-b87ce16c8774 tempest-VolumesTransfersV357Test-2107673843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0c98442-17de-4354-bbb9-60eeee100efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:03 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-24d44827-0928-43e0-90c3-b87ce16c8774 tempest-VolumesTransfersV357Test-2107673843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (761af97b-de04-4cc7-8649-dbb13bca164f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:03 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-24d44827-0928-43e0-90c3-b87ce16c8774 tempest-VolumesTransfersV357Test-2107673843 None] Volume de5a4cde-8aac-442d-a012-4ade21158de7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de5a4cde-8aac-442d-a012-4ade21158de7', 'volume_size': 1}
Apr 15 15:55:03 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-24d44827-0928-43e0-90c3-b87ce16c8774 tempest-VolumesTransfersV357Test-2107673843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:55:03 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-00a320fc-8e24-4720-9a68-384b2bbda641 tempest-GroupSnapshotsTest-1023701834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-331ec049-e057-45e5-a7fc-535bc0fe64ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-331ec049-e057-45e5-a7fc-535bc0fe64ad.1b2216ae-f3dd-4e26-869e-9453b9740579 1G {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:03 devstack sudo[86400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-331ec049-e057-45e5-a7fc-535bc0fe64ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-331ec049-e057-45e5-a7fc-535bc0fe64ad.1b2216ae-f3dd-4e26-869e-9453b9740579 1G
Apr 15 15:55:03 devstack sudo[86400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:04 devstack sudo[86400]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:04 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-00a320fc-8e24-4720-9a68-384b2bbda641 tempest-GroupSnapshotsTest-1023701834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-331ec049-e057-45e5-a7fc-535bc0fe64ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-331ec049-e057-45e5-a7fc-535bc0fe64ad.1b2216ae-f3dd-4e26-869e-9453b9740579 1G" returned: 0 in 0.587s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:04 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-00a320fc-8e24-4720-9a68-384b2bbda641 tempest-GroupSnapshotsTest-1023701834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-331ec049-e057-45e5-a7fc-535bc0fe64ad -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-331ec049-e057-45e5-a7fc-535bc0fe64ad.1b2216ae-f3dd-4e26-869e-9453b9740579 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:04 devstack sudo[86405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-331ec049-e057-45e5-a7fc-535bc0fe64ad -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-331ec049-e057-45e5-a7fc-535bc0fe64ad.1b2216ae-f3dd-4e26-869e-9453b9740579
Apr 15 15:55:04 devstack sudo[86405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:04 devstack sudo[86405]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:04 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-00a320fc-8e24-4720-9a68-384b2bbda641 tempest-GroupSnapshotsTest-1023701834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-331ec049-e057-45e5-a7fc-535bc0fe64ad -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-331ec049-e057-45e5-a7fc-535bc0fe64ad.1b2216ae-f3dd-4e26-869e-9453b9740579" returned: 0 in 0.522s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:04 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-00a320fc-8e24-4720-9a68-384b2bbda641 tempest-GroupSnapshotsTest-1023701834 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-331ec049-e057-45e5-a7fc-535bc0fe64ad.1b2216ae-f3dd-4e26-869e-9453b9740579 is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 15:55:04 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-00a320fc-8e24-4720-9a68-384b2bbda641 tempest-GroupSnapshotsTest-1023701834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-331ec049-e057-45e5-a7fc-535bc0fe64ad.1b2216ae-f3dd-4e26-869e-9453b9740579 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:04 devstack sudo[86411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-331ec049-e057-45e5-a7fc-535bc0fe64ad.1b2216ae-f3dd-4e26-869e-9453b9740579
Apr 15 15:55:04 devstack sudo[86411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:04 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-09b02ba1-f234-4e36-9ff1-555b8e085ee7 tempest-CreateVolumesFromImageTest-1162996396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:55:04 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-09b02ba1-f234-4e36-9ff1-555b8e085ee7 tempest-CreateVolumesFromImageTest-1162996396 None] Flow 'volume_create_manager' (c23983e2-ef92-4c23-a7e9-2e8bcb62c578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:55:04 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-09b02ba1-f234-4e36-9ff1-555b8e085ee7 tempest-CreateVolumesFromImageTest-1162996396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (430104fb-d18d-4396-b960-99d32c663a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:05 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-09b02ba1-f234-4e36-9ff1-555b8e085ee7 tempest-CreateVolumesFromImageTest-1162996396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (430104fb-d18d-4396-b960-99d32c663a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-723306866',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3874e5f6-4295-466c-9fb3-5f60c56a2da5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00454744f0f24fc6962c2af3eae31aae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:55:05Z,use_quota=True,user_id='e2455213fd7342f3b50a5f588569bec9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:05 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-09b02ba1-f234-4e36-9ff1-555b8e085ee7 tempest-CreateVolumesFromImageTest-1162996396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (118d7a4d-7840-4e26-a7d8-732a2c446e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:05 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-09b02ba1-f234-4e36-9ff1-555b8e085ee7 tempest-CreateVolumesFromImageTest-1162996396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (118d7a4d-7840-4e26-a7d8-732a2c446e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:05 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-09b02ba1-f234-4e36-9ff1-555b8e085ee7 tempest-CreateVolumesFromImageTest-1162996396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fefc4b2-086d-49c7-a827-6727938b03e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:05 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-09b02ba1-f234-4e36-9ff1-555b8e085ee7 tempest-CreateVolumesFromImageTest-1162996396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fefc4b2-086d-49c7-a827-6727938b03e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3874e5f6-4295-466c-9fb3-5f60c56a2da5', 'volume_name': 'volume-3874e5f6-4295-466c-9fb3-5f60c56a2da5', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:05 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-09b02ba1-f234-4e36-9ff1-555b8e085ee7 tempest-CreateVolumesFromImageTest-1162996396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac65eb16-8ca3-4ec6-80b6-c1a42910a63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:05 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-09b02ba1-f234-4e36-9ff1-555b8e085ee7 tempest-CreateVolumesFromImageTest-1162996396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac65eb16-8ca3-4ec6-80b6-c1a42910a63c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:05 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-09b02ba1-f234-4e36-9ff1-555b8e085ee7 tempest-CreateVolumesFromImageTest-1162996396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad868430-a7ad-4701-a70a-ed30ddb3575a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:05 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-09b02ba1-f234-4e36-9ff1-555b8e085ee7 tempest-CreateVolumesFromImageTest-1162996396 None] Volume 3874e5f6-4295-466c-9fb3-5f60c56a2da5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3874e5f6-4295-466c-9fb3-5f60c56a2da5', 'volume_size': 1}
Apr 15 15:55:05 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-09b02ba1-f234-4e36-9ff1-555b8e085ee7 tempest-CreateVolumesFromImageTest-1162996396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:55:05 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-20c260da-4fd6-4b18-811f-a39c764199c2 tempest-CreateVolumesFromImageTest-1162996396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:55:05 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-20c260da-4fd6-4b18-811f-a39c764199c2 tempest-CreateVolumesFromImageTest-1162996396 None] Flow 'volume_create_manager' (7ac1bc59-9a9f-4347-a02a-78fdd33d1a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:55:05 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-20c260da-4fd6-4b18-811f-a39c764199c2 tempest-CreateVolumesFromImageTest-1162996396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e49f6525-6eb9-44b0-b132-752afa4dfdaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:05 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-20c260da-4fd6-4b18-811f-a39c764199c2 tempest-CreateVolumesFromImageTest-1162996396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e49f6525-6eb9-44b0-b132-752afa4dfdaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-881018851',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a98ac5b-1a78-4505-9cdb-bd61c0175f20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00454744f0f24fc6962c2af3eae31aae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:55:05Z,use_quota=True,user_id='e2455213fd7342f3b50a5f588569bec9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:05 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-20c260da-4fd6-4b18-811f-a39c764199c2 tempest-CreateVolumesFromImageTest-1162996396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bac3a1f3-4049-4398-a17f-894999d65d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:05 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-20c260da-4fd6-4b18-811f-a39c764199c2 tempest-CreateVolumesFromImageTest-1162996396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bac3a1f3-4049-4398-a17f-894999d65d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:05 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-20c260da-4fd6-4b18-811f-a39c764199c2 tempest-CreateVolumesFromImageTest-1162996396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4bee6dc-b008-4ed5-a5c5-814cfdb65498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:05 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-20c260da-4fd6-4b18-811f-a39c764199c2 tempest-CreateVolumesFromImageTest-1162996396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4bee6dc-b008-4ed5-a5c5-814cfdb65498) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a98ac5b-1a78-4505-9cdb-bd61c0175f20', 'volume_name': 'volume-7a98ac5b-1a78-4505-9cdb-bd61c0175f20', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:05 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-20c260da-4fd6-4b18-811f-a39c764199c2 tempest-CreateVolumesFromImageTest-1162996396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae7c26e9-cd8f-42db-9bd9-ed0271e73641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:05 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-20c260da-4fd6-4b18-811f-a39c764199c2 tempest-CreateVolumesFromImageTest-1162996396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae7c26e9-cd8f-42db-9bd9-ed0271e73641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:05 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-20c260da-4fd6-4b18-811f-a39c764199c2 tempest-CreateVolumesFromImageTest-1162996396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8454bf41-71b2-40fa-8edf-9390ce1e8f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:05 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-20c260da-4fd6-4b18-811f-a39c764199c2 tempest-CreateVolumesFromImageTest-1162996396 None] Volume 7a98ac5b-1a78-4505-9cdb-bd61c0175f20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a98ac5b-1a78-4505-9cdb-bd61c0175f20', 'volume_size': 1}
Apr 15 15:55:05 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-20c260da-4fd6-4b18-811f-a39c764199c2 tempest-CreateVolumesFromImageTest-1162996396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:55:05 devstack sudo[86411]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:05 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-00a320fc-8e24-4720-9a68-384b2bbda641 tempest-GroupSnapshotsTest-1023701834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-331ec049-e057-45e5-a7fc-535bc0fe64ad.1b2216ae-f3dd-4e26-869e-9453b9740579" returned: 0 in 0.924s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:05 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-d92b0784-4821-41c4-81f0-1a0a43ceeceb tempest-CreateVolumesFromImageTest-1162996396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:55:05 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d92b0784-4821-41c4-81f0-1a0a43ceeceb tempest-CreateVolumesFromImageTest-1162996396 None] Flow 'volume_create_manager' (b3a2f8e6-aae3-4dd9-9c5f-16dfc6a6d8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:55:05 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d92b0784-4821-41c4-81f0-1a0a43ceeceb tempest-CreateVolumesFromImageTest-1162996396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f844bc3f-ccf1-4fa2-9dc6-8fa76a84cff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:05 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-00a320fc-8e24-4720-9a68-384b2bbda641 tempest-GroupSnapshotsTest-1023701834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-331ec049-e057-45e5-a7fc-535bc0fe64ad.info {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:05 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d92b0784-4821-41c4-81f0-1a0a43ceeceb tempest-CreateVolumesFromImageTest-1162996396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f844bc3f-ccf1-4fa2-9dc6-8fa76a84cff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1526032301',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41369eb3-644d-4319-a377-780794ff0d3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00454744f0f24fc6962c2af3eae31aae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:55:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:55:06Z,use_quota=True,user_id='e2455213fd7342f3b50a5f588569bec9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:05 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d92b0784-4821-41c4-81f0-1a0a43ceeceb tempest-CreateVolumesFromImageTest-1162996396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (931981c6-2540-4423-b338-3499acf210a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:05 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d92b0784-4821-41c4-81f0-1a0a43ceeceb tempest-CreateVolumesFromImageTest-1162996396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (931981c6-2540-4423-b338-3499acf210a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:05 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d92b0784-4821-41c4-81f0-1a0a43ceeceb tempest-CreateVolumesFromImageTest-1162996396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bd818b3-44ca-475e-92da-47f31c8cf5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:05 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d92b0784-4821-41c4-81f0-1a0a43ceeceb tempest-CreateVolumesFromImageTest-1162996396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bd818b3-44ca-475e-92da-47f31c8cf5fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41369eb3-644d-4319-a377-780794ff0d3d', 'volume_name': 'volume-41369eb3-644d-4319-a377-780794ff0d3d', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:05 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d92b0784-4821-41c4-81f0-1a0a43ceeceb tempest-CreateVolumesFromImageTest-1162996396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69535fda-7b36-47f6-868d-594bb8456b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:05 devstack sudo[86583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-331ec049-e057-45e5-a7fc-535bc0fe64ad.info
Apr 15 15:55:05 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d92b0784-4821-41c4-81f0-1a0a43ceeceb tempest-CreateVolumesFromImageTest-1162996396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69535fda-7b36-47f6-868d-594bb8456b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:05 devstack sudo[86583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:05 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d92b0784-4821-41c4-81f0-1a0a43ceeceb tempest-CreateVolumesFromImageTest-1162996396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a54c9b7-59ab-474d-9eaf-28eb0dc27e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:05 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-d92b0784-4821-41c4-81f0-1a0a43ceeceb tempest-CreateVolumesFromImageTest-1162996396 None] Volume 41369eb3-644d-4319-a377-780794ff0d3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41369eb3-644d-4319-a377-780794ff0d3d', 'volume_size': 1}
Apr 15 15:55:05 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-d92b0784-4821-41c4-81f0-1a0a43ceeceb tempest-CreateVolumesFromImageTest-1162996396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:55:05 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5bac5fc-5c00-445c-a24f-4fa56e732565 tempest-CreateVolumesFromImageTest-1162996396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:55:06 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b5bac5fc-5c00-445c-a24f-4fa56e732565 tempest-CreateVolumesFromImageTest-1162996396 None] Flow 'volume_create_manager' (4e14629a-0f6c-4ac2-aa04-7960dacdc5c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:55:06 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b5bac5fc-5c00-445c-a24f-4fa56e732565 tempest-CreateVolumesFromImageTest-1162996396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b5ebbdc-6a36-4237-a72f-375315666599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:06 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b5bac5fc-5c00-445c-a24f-4fa56e732565 tempest-CreateVolumesFromImageTest-1162996396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b5ebbdc-6a36-4237-a72f-375315666599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:55:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-490043666',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee784243-9a35-4778-aa83-b53806c5dc7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00454744f0f24fc6962c2af3eae31aae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:55:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:55:06Z,use_quota=True,user_id='e2455213fd7342f3b50a5f588569bec9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:06 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b5bac5fc-5c00-445c-a24f-4fa56e732565 tempest-CreateVolumesFromImageTest-1162996396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e27dceba-fa1e-48fe-aad6-953ae7b78191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:06 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b5bac5fc-5c00-445c-a24f-4fa56e732565 tempest-CreateVolumesFromImageTest-1162996396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e27dceba-fa1e-48fe-aad6-953ae7b78191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:06 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b5bac5fc-5c00-445c-a24f-4fa56e732565 tempest-CreateVolumesFromImageTest-1162996396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47ae4283-4114-4636-8b0a-f8377209f77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:06 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b5bac5fc-5c00-445c-a24f-4fa56e732565 tempest-CreateVolumesFromImageTest-1162996396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47ae4283-4114-4636-8b0a-f8377209f77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee784243-9a35-4778-aa83-b53806c5dc7e', 'volume_name': 'volume-ee784243-9a35-4778-aa83-b53806c5dc7e', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:06 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b5bac5fc-5c00-445c-a24f-4fa56e732565 tempest-CreateVolumesFromImageTest-1162996396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6687f2da-f500-415c-890d-6715371e6ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:06 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b5bac5fc-5c00-445c-a24f-4fa56e732565 tempest-CreateVolumesFromImageTest-1162996396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6687f2da-f500-415c-890d-6715371e6ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:06 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b5bac5fc-5c00-445c-a24f-4fa56e732565 tempest-CreateVolumesFromImageTest-1162996396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2629841f-3b60-48db-87fd-02ede277f735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:06 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-b5bac5fc-5c00-445c-a24f-4fa56e732565 tempest-CreateVolumesFromImageTest-1162996396 None] Volume ee784243-9a35-4778-aa83-b53806c5dc7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee784243-9a35-4778-aa83-b53806c5dc7e', 'volume_size': 1}
Apr 15 15:55:06 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-b5bac5fc-5c00-445c-a24f-4fa56e732565 tempest-CreateVolumesFromImageTest-1162996396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:55:06 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-641be73f-86f0-450b-8c56-478b34dbcc8a tempest-CreateVolumesFromImageTest-1162996396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:55:06 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-641be73f-86f0-450b-8c56-478b34dbcc8a tempest-CreateVolumesFromImageTest-1162996396 None] Flow 'volume_create_manager' (420cad35-4cf9-4e09-9cf0-afed38f15b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:55:06 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-641be73f-86f0-450b-8c56-478b34dbcc8a tempest-CreateVolumesFromImageTest-1162996396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecc7149d-ffcf-4483-8b5a-463faa43df43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:06 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-641be73f-86f0-450b-8c56-478b34dbcc8a tempest-CreateVolumesFromImageTest-1162996396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecc7149d-ffcf-4483-8b5a-463faa43df43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:55:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-191103904',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbf19974-f834-4ea9-8b68-1690702df426,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00454744f0f24fc6962c2af3eae31aae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:55:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:55:06Z,use_quota=True,user_id='e2455213fd7342f3b50a5f588569bec9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:06 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-641be73f-86f0-450b-8c56-478b34dbcc8a tempest-CreateVolumesFromImageTest-1162996396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ff38013-dba1-4d13-a635-9827ff3e65cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:06 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-641be73f-86f0-450b-8c56-478b34dbcc8a tempest-CreateVolumesFromImageTest-1162996396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ff38013-dba1-4d13-a635-9827ff3e65cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:06 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-641be73f-86f0-450b-8c56-478b34dbcc8a tempest-CreateVolumesFromImageTest-1162996396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9ce9b9e-d954-49bd-bd01-472726e70195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:06 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-641be73f-86f0-450b-8c56-478b34dbcc8a tempest-CreateVolumesFromImageTest-1162996396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9ce9b9e-d954-49bd-bd01-472726e70195) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbf19974-f834-4ea9-8b68-1690702df426', 'volume_name': 'volume-fbf19974-f834-4ea9-8b68-1690702df426', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:06 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-641be73f-86f0-450b-8c56-478b34dbcc8a tempest-CreateVolumesFromImageTest-1162996396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18f9d7a5-1c17-4c84-be0f-5482c531b0a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:06 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-641be73f-86f0-450b-8c56-478b34dbcc8a tempest-CreateVolumesFromImageTest-1162996396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18f9d7a5-1c17-4c84-be0f-5482c531b0a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:06 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-641be73f-86f0-450b-8c56-478b34dbcc8a tempest-CreateVolumesFromImageTest-1162996396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a06b2585-bf26-4c7e-b825-d4763672c6bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:06 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-641be73f-86f0-450b-8c56-478b34dbcc8a tempest-CreateVolumesFromImageTest-1162996396 None] Volume fbf19974-f834-4ea9-8b68-1690702df426: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbf19974-f834-4ea9-8b68-1690702df426', 'volume_size': 1}
Apr 15 15:55:06 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-641be73f-86f0-450b-8c56-478b34dbcc8a tempest-CreateVolumesFromImageTest-1162996396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:55:06 devstack sudo[86583]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:06 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-00a320fc-8e24-4720-9a68-384b2bbda641 tempest-GroupSnapshotsTest-1023701834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-331ec049-e057-45e5-a7fc-535bc0fe64ad.info" returned: 0 in 0.711s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:06 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-00a320fc-8e24-4720-9a68-384b2bbda641 tempest-GroupSnapshotsTest-1023701834 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-331ec049-e057-45e5-a7fc-535bc0fe64ad.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 15:55:06 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-00a320fc-8e24-4720-9a68-384b2bbda641 tempest-GroupSnapshotsTest-1023701834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-331ec049-e057-45e5-a7fc-535bc0fe64ad.info {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:06 devstack sudo[86587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-331ec049-e057-45e5-a7fc-535bc0fe64ad.info
Apr 15 15:55:06 devstack sudo[86587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:06 devstack sudo[86587]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:06 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-00a320fc-8e24-4720-9a68-384b2bbda641 tempest-GroupSnapshotsTest-1023701834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-331ec049-e057-45e5-a7fc-535bc0fe64ad.info" returned: 0 in 0.442s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:06 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-00a320fc-8e24-4720-9a68-384b2bbda641 tempest-GroupSnapshotsTest-1023701834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.914s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:55:06 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-24d44827-0928-43e0-90c3-b87ce16c8774 tempest-VolumesTransfersV357Test-2107673843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.274s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:55:06 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-24d44827-0928-43e0-90c3-b87ce16c8774 tempest-VolumesTransfersV357Test-2107673843 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:55:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1264600335',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de5a4cde-8aac-442d-a012-4ade21158de7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12f562e437904c28ad6718126f40d7ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:55:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:55:04Z,use_quota=True,user_id='e915b5c66b5a40b4b1c282bb75003d17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:55:06 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-24d44827-0928-43e0-90c3-b87ce16c8774 tempest-VolumesTransfersV357Test-2107673843 None] Creating volume de5a4cde-8aac-442d-a012-4ade21158de7 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:55:06 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-24d44827-0928-43e0-90c3-b87ce16c8774 tempest-VolumesTransfersV357Test-2107673843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:55:06 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-24d44827-0928-43e0-90c3-b87ce16c8774 tempest-VolumesTransfersV357Test-2107673843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:55:06 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-24d44827-0928-43e0-90c3-b87ce16c8774 tempest-VolumesTransfersV357Test-2107673843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:55:06 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-24d44827-0928-43e0-90c3-b87ce16c8774 tempest-VolumesTransfersV357Test-2107673843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:55:06 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-24d44827-0928-43e0-90c3-b87ce16c8774 tempest-VolumesTransfersV357Test-2107673843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:55:06 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-24d44827-0928-43e0-90c3-b87ce16c8774 tempest-VolumesTransfersV357Test-2107673843 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:55:06 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-24d44827-0928-43e0-90c3-b87ce16c8774 tempest-VolumesTransfersV357Test-2107673843 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:55:06 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-24d44827-0928-43e0-90c3-b87ce16c8774 tempest-VolumesTransfersV357Test-2107673843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-de5a4cde-8aac-442d-a012-4ade21158de7 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:06 devstack sudo[86590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-de5a4cde-8aac-442d-a012-4ade21158de7 1073741824
Apr 15 15:55:06 devstack sudo[86590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:06 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-00a320fc-8e24-4720-9a68-384b2bbda641 tempest-GroupSnapshotsTest-1023701834 None] group_snapshot b8b55cce-bd65-48d5-bfda-85f465600405: created successfully
Apr 15 15:55:07 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-52eade4c-062b-426d-bfd2-d4744313dd8c tempest-GroupSnapshotsTest-1023701834 None] group_snapshot b8b55cce-bd65-48d5-bfda-85f465600405: deleting
Apr 15 15:55:07 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-52eade4c-062b-426d-bfd2-d4744313dd8c tempest-GroupSnapshotsTest-1023701834 None] group_snapshot b8b55cce-bd65-48d5-bfda-85f465600405: deleting {{(pid=82485) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 15 15:55:07 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-52eade4c-062b-426d-bfd2-d4744313dd8c tempest-GroupSnapshotsTest-1023701834 None] Acquiring lock "cinder-quobyte-331ec049-e057-45e5-a7fc-535bc0fe64ad" by "delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:55:07 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-52eade4c-062b-426d-bfd2-d4744313dd8c tempest-GroupSnapshotsTest-1023701834 None] Lock "cinder-quobyte-331ec049-e057-45e5-a7fc-535bc0fe64ad" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:55:07 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-52eade4c-062b-426d-bfd2-d4744313dd8c tempest-GroupSnapshotsTest-1023701834 None] Acquiring lock "cinder-quobyte-1b2216ae-f3dd-4e26-869e-9453b9740579" by "_delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:55:07 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-52eade4c-062b-426d-bfd2-d4744313dd8c tempest-GroupSnapshotsTest-1023701834 None] Lock "cinder-quobyte-1b2216ae-f3dd-4e26-869e-9453b9740579" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:55:07 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-52eade4c-062b-426d-bfd2-d4744313dd8c tempest-GroupSnapshotsTest-1023701834 None] Deleting offline snapshot 1b2216ae-f3dd-4e26-869e-9453b9740579 of volume 331ec049-e057-45e5-a7fc-535bc0fe64ad {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 15:55:07 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-52eade4c-062b-426d-bfd2-d4744313dd8c tempest-GroupSnapshotsTest-1023701834 None] snapshot_file for this snap is: volume-331ec049-e057-45e5-a7fc-535bc0fe64ad.1b2216ae-f3dd-4e26-869e-9453b9740579 {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 15:55:07 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1c7d18-cf39-45d5-aa6e-4a769b172094]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:55:07 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-52eade4c-062b-426d-bfd2-d4744313dd8c tempest-GroupSnapshotsTest-1023701834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-331ec049-e057-45e5-a7fc-535bc0fe64ad.1b2216ae-f3dd-4e26-869e-9453b9740579 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:07 devstack sudo[86590]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:07 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-24d44827-0928-43e0-90c3-b87ce16c8774 tempest-VolumesTransfersV357Test-2107673843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-de5a4cde-8aac-442d-a012-4ade21158de7 1073741824" returned: 0 in 0.593s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:07 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-24d44827-0928-43e0-90c3-b87ce16c8774 tempest-VolumesTransfersV357Test-2107673843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-de5a4cde-8aac-442d-a012-4ade21158de7 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:07 devstack sudo[86595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-331ec049-e057-45e5-a7fc-535bc0fe64ad.1b2216ae-f3dd-4e26-869e-9453b9740579
Apr 15 15:55:07 devstack sudo[86595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:07 devstack sudo[86596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-de5a4cde-8aac-442d-a012-4ade21158de7
Apr 15 15:55:07 devstack sudo[86596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:08 devstack sudo[86596]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:08 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-24d44827-0928-43e0-90c3-b87ce16c8774 tempest-VolumesTransfersV357Test-2107673843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-de5a4cde-8aac-442d-a012-4ade21158de7" returned: 0 in 0.546s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:08 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-24d44827-0928-43e0-90c3-b87ce16c8774 tempest-VolumesTransfersV357Test-2107673843 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:55:08 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-24d44827-0928-43e0-90c3-b87ce16c8774 tempest-VolumesTransfersV357Test-2107673843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.177s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:55:08 devstack sudo[86595]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:08 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-09b02ba1-f234-4e36-9ff1-555b8e085ee7 tempest-CreateVolumesFromImageTest-1162996396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.885s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:55:08 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-09b02ba1-f234-4e36-9ff1-555b8e085ee7 tempest-CreateVolumesFromImageTest-1162996396 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-723306866',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3874e5f6-4295-466c-9fb3-5f60c56a2da5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00454744f0f24fc6962c2af3eae31aae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:55:05Z,use_quota=True,user_id='e2455213fd7342f3b50a5f588569bec9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:55:08 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-09b02ba1-f234-4e36-9ff1-555b8e085ee7 tempest-CreateVolumesFromImageTest-1162996396 None] Creating volume 3874e5f6-4295-466c-9fb3-5f60c56a2da5 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:55:08 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-09b02ba1-f234-4e36-9ff1-555b8e085ee7 tempest-CreateVolumesFromImageTest-1162996396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:55:08 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-09b02ba1-f234-4e36-9ff1-555b8e085ee7 tempest-CreateVolumesFromImageTest-1162996396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:55:08 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-09b02ba1-f234-4e36-9ff1-555b8e085ee7 tempest-CreateVolumesFromImageTest-1162996396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:55:08 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-09b02ba1-f234-4e36-9ff1-555b8e085ee7 tempest-CreateVolumesFromImageTest-1162996396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:55:08 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-09b02ba1-f234-4e36-9ff1-555b8e085ee7 tempest-CreateVolumesFromImageTest-1162996396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:55:08 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-09b02ba1-f234-4e36-9ff1-555b8e085ee7 tempest-CreateVolumesFromImageTest-1162996396 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:55:08 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-09b02ba1-f234-4e36-9ff1-555b8e085ee7 tempest-CreateVolumesFromImageTest-1162996396 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:55:08 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-09b02ba1-f234-4e36-9ff1-555b8e085ee7 tempest-CreateVolumesFromImageTest-1162996396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3874e5f6-4295-466c-9fb3-5f60c56a2da5 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:08 devstack sudo[86604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3874e5f6-4295-466c-9fb3-5f60c56a2da5 1073741824
Apr 15 15:55:08 devstack sudo[86604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:08 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-52eade4c-062b-426d-bfd2-d4744313dd8c tempest-GroupSnapshotsTest-1023701834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-331ec049-e057-45e5-a7fc-535bc0fe64ad.1b2216ae-f3dd-4e26-869e-9453b9740579" returned: 0 in 0.669s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:08 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-52eade4c-062b-426d-bfd2-d4744313dd8c tempest-GroupSnapshotsTest-1023701834 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-331ec049-e057-45e5-a7fc-535bc0fe64ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82485) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 15:55:08 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-24d44827-0928-43e0-90c3-b87ce16c8774 tempest-VolumesTransfersV357Test-2107673843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (761af97b-de04-4cc7-8649-dbb13bca164f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de5a4cde-8aac-442d-a012-4ade21158de7', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:08 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-24d44827-0928-43e0-90c3-b87ce16c8774 tempest-VolumesTransfersV357Test-2107673843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecc05de0-2fc0-4bba-b38f-40bd7090c634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:08 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[7133e421-a66a-4102-bb89-382c29eedb1f]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:55:08 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-52eade4c-062b-426d-bfd2-d4744313dd8c tempest-GroupSnapshotsTest-1023701834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-331ec049-e057-45e5-a7fc-535bc0fe64ad {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:08 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-24d44827-0928-43e0-90c3-b87ce16c8774 tempest-VolumesTransfersV357Test-2107673843 None] Volume volume-de5a4cde-8aac-442d-a012-4ade21158de7 (de5a4cde-8aac-442d-a012-4ade21158de7): created successfully
Apr 15 15:55:08 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-24d44827-0928-43e0-90c3-b87ce16c8774 tempest-VolumesTransfersV357Test-2107673843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecc05de0-2fc0-4bba-b38f-40bd7090c634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:08 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-24d44827-0928-43e0-90c3-b87ce16c8774 tempest-VolumesTransfersV357Test-2107673843 None] Flow 'volume_create_manager' (2a5f1305-1886-4943-abc3-0c2485a9f4ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:55:08 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-24d44827-0928-43e0-90c3-b87ce16c8774 tempest-VolumesTransfersV357Test-2107673843 None] Created volume successfully.
Apr 15 15:55:08 devstack sudo[86606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-331ec049-e057-45e5-a7fc-535bc0fe64ad
Apr 15 15:55:08 devstack sudo[86606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:08 devstack sudo[86606]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:08 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-52eade4c-062b-426d-bfd2-d4744313dd8c tempest-GroupSnapshotsTest-1023701834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-331ec049-e057-45e5-a7fc-535bc0fe64ad" returned: 0 in 0.559s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:08 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-52eade4c-062b-426d-bfd2-d4744313dd8c tempest-GroupSnapshotsTest-1023701834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-331ec049-e057-45e5-a7fc-535bc0fe64ad.1b2216ae-f3dd-4e26-869e-9453b9740579 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:08 devstack sudo[86615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-331ec049-e057-45e5-a7fc-535bc0fe64ad.1b2216ae-f3dd-4e26-869e-9453b9740579
Apr 15 15:55:08 devstack sudo[86615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:08 devstack sudo[86604]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:08 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-09b02ba1-f234-4e36-9ff1-555b8e085ee7 tempest-CreateVolumesFromImageTest-1162996396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3874e5f6-4295-466c-9fb3-5f60c56a2da5 1073741824" returned: 0 in 0.670s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:08 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-09b02ba1-f234-4e36-9ff1-555b8e085ee7 tempest-CreateVolumesFromImageTest-1162996396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3874e5f6-4295-466c-9fb3-5f60c56a2da5 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:08 devstack sudo[86617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3874e5f6-4295-466c-9fb3-5f60c56a2da5
Apr 15 15:55:08 devstack sudo[86617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:09 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-9894cb66-4a03-4263-a69f-2800fbf8a0be tempest-VolumesTransfersV357Test-1299969734 None] Acquiring lock "cinder-de5a4cde-8aac-442d-a012-4ade21158de7-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:55:09 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-9894cb66-4a03-4263-a69f-2800fbf8a0be tempest-VolumesTransfersV357Test-1299969734 None] Lock "cinder-de5a4cde-8aac-442d-a012-4ade21158de7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:55:09 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-9894cb66-4a03-4263-a69f-2800fbf8a0be tempest-VolumesTransfersV357Test-1299969734 None] Acquiring lock "cinder-quobyte-de5a4cde-8aac-442d-a012-4ade21158de7" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:55:09 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-9894cb66-4a03-4263-a69f-2800fbf8a0be tempest-VolumesTransfersV357Test-1299969734 None] Lock "cinder-quobyte-de5a4cde-8aac-442d-a012-4ade21158de7" acquired by "delete_volume" :: waited 0.021s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:55:09 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3f5f7a-0840-480a-9078-3e48238e1d87]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:55:09 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9894cb66-4a03-4263-a69f-2800fbf8a0be tempest-VolumesTransfersV357Test-1299969734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-de5a4cde-8aac-442d-a012-4ade21158de7 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:09 devstack sudo[86617]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:09 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-09b02ba1-f234-4e36-9ff1-555b8e085ee7 tempest-CreateVolumesFromImageTest-1162996396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3874e5f6-4295-466c-9fb3-5f60c56a2da5" returned: 0 in 0.534s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:09 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-09b02ba1-f234-4e36-9ff1-555b8e085ee7 tempest-CreateVolumesFromImageTest-1162996396 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:55:09 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-09b02ba1-f234-4e36-9ff1-555b8e085ee7 tempest-CreateVolumesFromImageTest-1162996396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.237s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:55:09 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-20c260da-4fd6-4b18-811f-a39c764199c2 tempest-CreateVolumesFromImageTest-1162996396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.876s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:55:09 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-20c260da-4fd6-4b18-811f-a39c764199c2 tempest-CreateVolumesFromImageTest-1162996396 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-881018851',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a98ac5b-1a78-4505-9cdb-bd61c0175f20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00454744f0f24fc6962c2af3eae31aae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:55:05Z,use_quota=True,user_id='e2455213fd7342f3b50a5f588569bec9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:55:09 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-20c260da-4fd6-4b18-811f-a39c764199c2 tempest-CreateVolumesFromImageTest-1162996396 None] Creating volume 7a98ac5b-1a78-4505-9cdb-bd61c0175f20 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:55:09 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-20c260da-4fd6-4b18-811f-a39c764199c2 tempest-CreateVolumesFromImageTest-1162996396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:55:09 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-20c260da-4fd6-4b18-811f-a39c764199c2 tempest-CreateVolumesFromImageTest-1162996396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:55:09 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-20c260da-4fd6-4b18-811f-a39c764199c2 tempest-CreateVolumesFromImageTest-1162996396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:55:09 devstack sudo[86615]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:09 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-20c260da-4fd6-4b18-811f-a39c764199c2 tempest-CreateVolumesFromImageTest-1162996396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:55:09 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-20c260da-4fd6-4b18-811f-a39c764199c2 tempest-CreateVolumesFromImageTest-1162996396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:55:09 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-20c260da-4fd6-4b18-811f-a39c764199c2 tempest-CreateVolumesFromImageTest-1162996396 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:55:09 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-20c260da-4fd6-4b18-811f-a39c764199c2 tempest-CreateVolumesFromImageTest-1162996396 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:55:09 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-20c260da-4fd6-4b18-811f-a39c764199c2 tempest-CreateVolumesFromImageTest-1162996396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-7a98ac5b-1a78-4505-9cdb-bd61c0175f20 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:09 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-52eade4c-062b-426d-bfd2-d4744313dd8c tempest-GroupSnapshotsTest-1023701834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-331ec049-e057-45e5-a7fc-535bc0fe64ad.1b2216ae-f3dd-4e26-869e-9453b9740579" returned: 0 in 0.639s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:09 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-52eade4c-062b-426d-bfd2-d4744313dd8c tempest-GroupSnapshotsTest-1023701834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-331ec049-e057-45e5-a7fc-535bc0fe64ad.1b2216ae-f3dd-4e26-869e-9453b9740579 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:09 devstack sudo[86623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-de5a4cde-8aac-442d-a012-4ade21158de7
Apr 15 15:55:09 devstack sudo[86623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:09 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-09b02ba1-f234-4e36-9ff1-555b8e085ee7 tempest-CreateVolumesFromImageTest-1162996396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad868430-a7ad-4701-a70a-ed30ddb3575a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3874e5f6-4295-466c-9fb3-5f60c56a2da5', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:09 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-09b02ba1-f234-4e36-9ff1-555b8e085ee7 tempest-CreateVolumesFromImageTest-1162996396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06c5b9fc-1e91-4222-b1c9-23be16113807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:09 devstack sudo[86625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-331ec049-e057-45e5-a7fc-535bc0fe64ad.1b2216ae-f3dd-4e26-869e-9453b9740579
Apr 15 15:55:09 devstack sudo[86625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:09 devstack sudo[86624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-7a98ac5b-1a78-4505-9cdb-bd61c0175f20 1073741824
Apr 15 15:55:09 devstack sudo[86624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:09 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-09b02ba1-f234-4e36-9ff1-555b8e085ee7 tempest-CreateVolumesFromImageTest-1162996396 None] Volume volume-3874e5f6-4295-466c-9fb3-5f60c56a2da5 (3874e5f6-4295-466c-9fb3-5f60c56a2da5): created successfully
Apr 15 15:55:09 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-09b02ba1-f234-4e36-9ff1-555b8e085ee7 tempest-CreateVolumesFromImageTest-1162996396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06c5b9fc-1e91-4222-b1c9-23be16113807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:09 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-09b02ba1-f234-4e36-9ff1-555b8e085ee7 tempest-CreateVolumesFromImageTest-1162996396 None] Flow 'volume_create_manager' (c23983e2-ef92-4c23-a7e9-2e8bcb62c578) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:55:09 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-09b02ba1-f234-4e36-9ff1-555b8e085ee7 tempest-CreateVolumesFromImageTest-1162996396 None] Created volume successfully.
Apr 15 15:55:09 devstack sudo[86625]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:09 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-52eade4c-062b-426d-bfd2-d4744313dd8c tempest-GroupSnapshotsTest-1023701834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-331ec049-e057-45e5-a7fc-535bc0fe64ad.1b2216ae-f3dd-4e26-869e-9453b9740579" returned: 0 in 0.520s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:09 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-52eade4c-062b-426d-bfd2-d4744313dd8c tempest-GroupSnapshotsTest-1023701834 None] Lock "cinder-quobyte-1b2216ae-f3dd-4e26-869e-9453b9740579" released by "_delete_snapshot" :: held 2.468s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:55:09 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-52eade4c-062b-426d-bfd2-d4744313dd8c tempest-GroupSnapshotsTest-1023701834 None] Lock "cinder-quobyte-331ec049-e057-45e5-a7fc-535bc0fe64ad" released by "delete_snapshot" :: held 2.480s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:55:09 devstack cinder-volume[82485]: WARNING cinder.quota [None req-52eade4c-062b-426d-bfd2-d4744313dd8c tempest-GroupSnapshotsTest-1023701834 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-94481832 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-94481832, it is now deprecated. Please use the default quota class for default quota.
Apr 15 15:55:09 devstack cinder-volume[82485]: WARNING cinder.quota [None req-52eade4c-062b-426d-bfd2-d4744313dd8c tempest-GroupSnapshotsTest-1023701834 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-94481832 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-94481832, it is now deprecated. Please use the default quota class for default quota.
Apr 15 15:55:09 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-52eade4c-062b-426d-bfd2-d4744313dd8c tempest-GroupSnapshotsTest-1023701834 None] Created reservations ['538a9a0c-fd05-4ce3-8eb1-58cf3238e49d', 'a7679761-f789-44af-9264-650d01959330', '9b48536b-a724-4b0a-9c5f-208bb5afc6c3', '1106a562-d3af-4a17-a62f-88861348ab92'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:55:10 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-52eade4c-062b-426d-bfd2-d4744313dd8c tempest-GroupSnapshotsTest-1023701834 None] group_snapshot b8b55cce-bd65-48d5-bfda-85f465600405: deleted successfully
Apr 15 15:55:10 devstack sudo[86623]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9894cb66-4a03-4263-a69f-2800fbf8a0be tempest-VolumesTransfersV357Test-1299969734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-de5a4cde-8aac-442d-a012-4ade21158de7" returned: 0 in 0.928s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9894cb66-4a03-4263-a69f-2800fbf8a0be tempest-VolumesTransfersV357Test-1299969734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-de5a4cde-8aac-442d-a012-4ade21158de7 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:10 devstack sudo[86716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-de5a4cde-8aac-442d-a012-4ade21158de7
Apr 15 15:55:10 devstack sudo[86716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:10 devstack sudo[86624]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-20c260da-4fd6-4b18-811f-a39c764199c2 tempest-CreateVolumesFromImageTest-1162996396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-7a98ac5b-1a78-4505-9cdb-bd61c0175f20 1073741824" returned: 0 in 1.004s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-20c260da-4fd6-4b18-811f-a39c764199c2 tempest-CreateVolumesFromImageTest-1162996396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-7a98ac5b-1a78-4505-9cdb-bd61c0175f20 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:10 devstack sudo[86724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-7a98ac5b-1a78-4505-9cdb-bd61c0175f20
Apr 15 15:55:10 devstack sudo[86724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:10 devstack sudo[86716]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9894cb66-4a03-4263-a69f-2800fbf8a0be tempest-VolumesTransfersV357Test-1299969734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-de5a4cde-8aac-442d-a012-4ade21158de7" returned: 0 in 0.461s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:10 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-9894cb66-4a03-4263-a69f-2800fbf8a0be tempest-VolumesTransfersV357Test-1299969734 None] Lock "cinder-quobyte-de5a4cde-8aac-442d-a012-4ade21158de7" released by "delete_volume" :: held 1.419s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:55:10 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-9894cb66-4a03-4263-a69f-2800fbf8a0be tempest-VolumesTransfersV357Test-1299969734 None] Created reservations ['42d579c7-cbc1-45ee-8716-847ed6b47fb8', '0c43e6e8-0279-47c8-8f9f-fae8ab266378', 'fad2e860-7d4c-4837-94c6-26b385da14a0', 'daa8e275-7886-4e30-86f3-46bbe8e72b67'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:55:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-9894cb66-4a03-4263-a69f-2800fbf8a0be tempest-VolumesTransfersV357Test-1299969734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:55:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-9894cb66-4a03-4263-a69f-2800fbf8a0be tempest-VolumesTransfersV357Test-1299969734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:55:10 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-9894cb66-4a03-4263-a69f-2800fbf8a0be tempest-VolumesTransfersV357Test-1299969734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:55:10 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-9894cb66-4a03-4263-a69f-2800fbf8a0be tempest-VolumesTransfersV357Test-1299969734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:55:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-9894cb66-4a03-4263-a69f-2800fbf8a0be tempest-VolumesTransfersV357Test-1299969734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:55:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9894cb66-4a03-4263-a69f-2800fbf8a0be tempest-VolumesTransfersV357Test-1299969734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:10 devstack sudo[86727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:55:10 devstack sudo[86727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:10 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-435b9106-072e-4ceb-b954-9b0809bcb92f tempest-GroupSnapshotsTest-1023701834 None] Acquiring lock "cinder-quobyte-331ec049-e057-45e5-a7fc-535bc0fe64ad" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:55:10 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-435b9106-072e-4ceb-b954-9b0809bcb92f tempest-GroupSnapshotsTest-1023701834 None] Lock "cinder-quobyte-331ec049-e057-45e5-a7fc-535bc0fe64ad" acquired by "delete_volume" :: waited 0.011s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:55:10 devstack sudo[86724]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-20c260da-4fd6-4b18-811f-a39c764199c2 tempest-CreateVolumesFromImageTest-1162996396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-7a98ac5b-1a78-4505-9cdb-bd61c0175f20" returned: 0 in 0.500s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:10 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-20c260da-4fd6-4b18-811f-a39c764199c2 tempest-CreateVolumesFromImageTest-1162996396 None] <== create_volume: return (1558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:55:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-20c260da-4fd6-4b18-811f-a39c764199c2 tempest-CreateVolumesFromImageTest-1162996396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.562s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:55:10 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[6697b7a6-f194-4bac-bb9d-9814bcdeeb8d]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:55:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-d92b0784-4821-41c4-81f0-1a0a43ceeceb tempest-CreateVolumesFromImageTest-1162996396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.105s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:55:10 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-d92b0784-4821-41c4-81f0-1a0a43ceeceb tempest-CreateVolumesFromImageTest-1162996396 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1526032301',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41369eb3-644d-4319-a377-780794ff0d3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00454744f0f24fc6962c2af3eae31aae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:55:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:55:06Z,use_quota=True,user_id='e2455213fd7342f3b50a5f588569bec9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:55:10 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-d92b0784-4821-41c4-81f0-1a0a43ceeceb tempest-CreateVolumesFromImageTest-1162996396 None] Creating volume 41369eb3-644d-4319-a377-780794ff0d3d {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:55:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-d92b0784-4821-41c4-81f0-1a0a43ceeceb tempest-CreateVolumesFromImageTest-1162996396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:55:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-d92b0784-4821-41c4-81f0-1a0a43ceeceb tempest-CreateVolumesFromImageTest-1162996396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:55:10 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-d92b0784-4821-41c4-81f0-1a0a43ceeceb tempest-CreateVolumesFromImageTest-1162996396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:55:10 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-d92b0784-4821-41c4-81f0-1a0a43ceeceb tempest-CreateVolumesFromImageTest-1162996396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:55:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-d92b0784-4821-41c4-81f0-1a0a43ceeceb tempest-CreateVolumesFromImageTest-1162996396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:55:10 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-d92b0784-4821-41c4-81f0-1a0a43ceeceb tempest-CreateVolumesFromImageTest-1162996396 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:55:10 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-d92b0784-4821-41c4-81f0-1a0a43ceeceb tempest-CreateVolumesFromImageTest-1162996396 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:55:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-d92b0784-4821-41c4-81f0-1a0a43ceeceb tempest-CreateVolumesFromImageTest-1162996396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-41369eb3-644d-4319-a377-780794ff0d3d 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-435b9106-072e-4ceb-b954-9b0809bcb92f tempest-GroupSnapshotsTest-1023701834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-331ec049-e057-45e5-a7fc-535bc0fe64ad {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:10 devstack sudo[86730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-41369eb3-644d-4319-a377-780794ff0d3d 1073741824
Apr 15 15:55:10 devstack sudo[86730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:10 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-20c260da-4fd6-4b18-811f-a39c764199c2 tempest-CreateVolumesFromImageTest-1162996396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8454bf41-71b2-40fa-8edf-9390ce1e8f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a98ac5b-1a78-4505-9cdb-bd61c0175f20', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:10 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-20c260da-4fd6-4b18-811f-a39c764199c2 tempest-CreateVolumesFromImageTest-1162996396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54f97977-ab50-455b-b119-5849aad11a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:10 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-20c260da-4fd6-4b18-811f-a39c764199c2 tempest-CreateVolumesFromImageTest-1162996396 None] Volume volume-7a98ac5b-1a78-4505-9cdb-bd61c0175f20 (7a98ac5b-1a78-4505-9cdb-bd61c0175f20): created successfully
Apr 15 15:55:10 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-20c260da-4fd6-4b18-811f-a39c764199c2 tempest-CreateVolumesFromImageTest-1162996396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54f97977-ab50-455b-b119-5849aad11a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:10 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-20c260da-4fd6-4b18-811f-a39c764199c2 tempest-CreateVolumesFromImageTest-1162996396 None] Flow 'volume_create_manager' (7ac1bc59-9a9f-4347-a02a-78fdd33d1a7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:55:11 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-20c260da-4fd6-4b18-811f-a39c764199c2 tempest-CreateVolumesFromImageTest-1162996396 None] Created volume successfully.
Apr 15 15:55:11 devstack sudo[86731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-331ec049-e057-45e5-a7fc-535bc0fe64ad
Apr 15 15:55:11 devstack sudo[86731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:11 devstack sudo[86727]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:11 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9894cb66-4a03-4263-a69f-2800fbf8a0be tempest-VolumesTransfersV357Test-1299969734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.605s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:11 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-9894cb66-4a03-4263-a69f-2800fbf8a0be tempest-VolumesTransfersV357Test-1299969734 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:55:11 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-9894cb66-4a03-4263-a69f-2800fbf8a0be tempest-VolumesTransfersV357Test-1299969734 None] Deleted volume successfully.
Apr 15 15:55:11 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-9894cb66-4a03-4263-a69f-2800fbf8a0be tempest-VolumesTransfersV357Test-1299969734 None] Lock "cinder-de5a4cde-8aac-442d-a012-4ade21158de7-delete_volume" released by "delete_volume" :: held 2.227s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:55:11 devstack sudo[86731]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:11 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-435b9106-072e-4ceb-b954-9b0809bcb92f tempest-GroupSnapshotsTest-1023701834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-331ec049-e057-45e5-a7fc-535bc0fe64ad" returned: 0 in 0.742s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:11 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-435b9106-072e-4ceb-b954-9b0809bcb92f tempest-GroupSnapshotsTest-1023701834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-331ec049-e057-45e5-a7fc-535bc0fe64ad {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:11 devstack sudo[86730]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:11 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-d92b0784-4821-41c4-81f0-1a0a43ceeceb tempest-CreateVolumesFromImageTest-1162996396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-41369eb3-644d-4319-a377-780794ff0d3d 1073741824" returned: 0 in 0.774s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:11 devstack sudo[86741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-331ec049-e057-45e5-a7fc-535bc0fe64ad
Apr 15 15:55:11 devstack sudo[86741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:11 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-d92b0784-4821-41c4-81f0-1a0a43ceeceb tempest-CreateVolumesFromImageTest-1162996396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-41369eb3-644d-4319-a377-780794ff0d3d {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:11 devstack sudo[86743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-41369eb3-644d-4319-a377-780794ff0d3d
Apr 15 15:55:11 devstack sudo[86743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:12 devstack sudo[86743]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-d92b0784-4821-41c4-81f0-1a0a43ceeceb tempest-CreateVolumesFromImageTest-1162996396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-41369eb3-644d-4319-a377-780794ff0d3d" returned: 0 in 0.623s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:12 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-d92b0784-4821-41c4-81f0-1a0a43ceeceb tempest-CreateVolumesFromImageTest-1162996396 None] <== create_volume: return (1440ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:55:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-d92b0784-4821-41c4-81f0-1a0a43ceeceb tempest-CreateVolumesFromImageTest-1162996396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.443s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:55:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-b5bac5fc-5c00-445c-a24f-4fa56e732565 tempest-CreateVolumesFromImageTest-1162996396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.288s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:55:12 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-b5bac5fc-5c00-445c-a24f-4fa56e732565 tempest-CreateVolumesFromImageTest-1162996396 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:55:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-490043666',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee784243-9a35-4778-aa83-b53806c5dc7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00454744f0f24fc6962c2af3eae31aae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:55:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:55:06Z,use_quota=True,user_id='e2455213fd7342f3b50a5f588569bec9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:55:12 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-b5bac5fc-5c00-445c-a24f-4fa56e732565 tempest-CreateVolumesFromImageTest-1162996396 None] Creating volume ee784243-9a35-4778-aa83-b53806c5dc7e {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:55:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-b5bac5fc-5c00-445c-a24f-4fa56e732565 tempest-CreateVolumesFromImageTest-1162996396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:55:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-b5bac5fc-5c00-445c-a24f-4fa56e732565 tempest-CreateVolumesFromImageTest-1162996396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:55:12 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-b5bac5fc-5c00-445c-a24f-4fa56e732565 tempest-CreateVolumesFromImageTest-1162996396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:55:12 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-b5bac5fc-5c00-445c-a24f-4fa56e732565 tempest-CreateVolumesFromImageTest-1162996396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:55:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-b5bac5fc-5c00-445c-a24f-4fa56e732565 tempest-CreateVolumesFromImageTest-1162996396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:55:12 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-b5bac5fc-5c00-445c-a24f-4fa56e732565 tempest-CreateVolumesFromImageTest-1162996396 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:55:12 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-b5bac5fc-5c00-445c-a24f-4fa56e732565 tempest-CreateVolumesFromImageTest-1162996396 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:55:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b5bac5fc-5c00-445c-a24f-4fa56e732565 tempest-CreateVolumesFromImageTest-1162996396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ee784243-9a35-4778-aa83-b53806c5dc7e 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:12 devstack sudo[86741]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:12 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d92b0784-4821-41c4-81f0-1a0a43ceeceb tempest-CreateVolumesFromImageTest-1162996396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a54c9b7-59ab-474d-9eaf-28eb0dc27e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41369eb3-644d-4319-a377-780794ff0d3d', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:12 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d92b0784-4821-41c4-81f0-1a0a43ceeceb tempest-CreateVolumesFromImageTest-1162996396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05e64639-85c9-46d2-8a9c-8d031fb2478e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:12 devstack sudo[86770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ee784243-9a35-4778-aa83-b53806c5dc7e 1073741824
Apr 15 15:55:12 devstack sudo[86770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-435b9106-072e-4ceb-b954-9b0809bcb92f tempest-GroupSnapshotsTest-1023701834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-331ec049-e057-45e5-a7fc-535bc0fe64ad" returned: 0 in 0.730s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:12 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-435b9106-072e-4ceb-b954-9b0809bcb92f tempest-GroupSnapshotsTest-1023701834 None] Lock "cinder-quobyte-331ec049-e057-45e5-a7fc-535bc0fe64ad" released by "delete_volume" :: held 1.534s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:55:12 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-d92b0784-4821-41c4-81f0-1a0a43ceeceb tempest-CreateVolumesFromImageTest-1162996396 None] Volume volume-41369eb3-644d-4319-a377-780794ff0d3d (41369eb3-644d-4319-a377-780794ff0d3d): created successfully
Apr 15 15:55:12 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d92b0784-4821-41c4-81f0-1a0a43ceeceb tempest-CreateVolumesFromImageTest-1162996396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05e64639-85c9-46d2-8a9c-8d031fb2478e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:12 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d92b0784-4821-41c4-81f0-1a0a43ceeceb tempest-CreateVolumesFromImageTest-1162996396 None] Flow 'volume_create_manager' (b3a2f8e6-aae3-4dd9-9c5f-16dfc6a6d8a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:55:12 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-d92b0784-4821-41c4-81f0-1a0a43ceeceb tempest-CreateVolumesFromImageTest-1162996396 None] Created volume successfully.
Apr 15 15:55:12 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-435b9106-072e-4ceb-b954-9b0809bcb92f tempest-GroupSnapshotsTest-1023701834 None] Created reservations ['9476a057-8fd2-4e4a-a918-534b55f9e745'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:55:12 devstack cinder-volume[82485]: WARNING cinder.quota [None req-435b9106-072e-4ceb-b954-9b0809bcb92f tempest-GroupSnapshotsTest-1023701834 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-94481832 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-94481832, it is now deprecated. Please use the default quota class for default quota.
Apr 15 15:55:12 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-435b9106-072e-4ceb-b954-9b0809bcb92f tempest-GroupSnapshotsTest-1023701834 None] Created reservations ['d6ee3c8a-ccfe-4608-a091-29f20ee58fbd', '7d26756e-4132-42cb-ba78-d71cd9198ac0', '5396a4f0-cf2b-49d6-9c9c-b85bfe23db01', '500d2700-5148-40af-8a1e-c06b301b9db6'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:55:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-435b9106-072e-4ceb-b954-9b0809bcb92f tempest-GroupSnapshotsTest-1023701834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:55:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-435b9106-072e-4ceb-b954-9b0809bcb92f tempest-GroupSnapshotsTest-1023701834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:55:12 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-435b9106-072e-4ceb-b954-9b0809bcb92f tempest-GroupSnapshotsTest-1023701834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:55:12 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-435b9106-072e-4ceb-b954-9b0809bcb92f tempest-GroupSnapshotsTest-1023701834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:55:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-435b9106-072e-4ceb-b954-9b0809bcb92f tempest-GroupSnapshotsTest-1023701834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:55:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-435b9106-072e-4ceb-b954-9b0809bcb92f tempest-GroupSnapshotsTest-1023701834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:12 devstack sudo[86772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:55:12 devstack sudo[86772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:13 devstack sudo[86770]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:13 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b5bac5fc-5c00-445c-a24f-4fa56e732565 tempest-CreateVolumesFromImageTest-1162996396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ee784243-9a35-4778-aa83-b53806c5dc7e 1073741824" returned: 0 in 0.734s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:13 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b5bac5fc-5c00-445c-a24f-4fa56e732565 tempest-CreateVolumesFromImageTest-1162996396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ee784243-9a35-4778-aa83-b53806c5dc7e {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:13 devstack sudo[86779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ee784243-9a35-4778-aa83-b53806c5dc7e
Apr 15 15:55:13 devstack sudo[86779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:13 devstack sudo[86772]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:13 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-435b9106-072e-4ceb-b954-9b0809bcb92f tempest-GroupSnapshotsTest-1023701834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.578s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:13 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-435b9106-072e-4ceb-b954-9b0809bcb92f tempest-GroupSnapshotsTest-1023701834 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:55:13 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-435b9106-072e-4ceb-b954-9b0809bcb92f tempest-GroupSnapshotsTest-1023701834 None] Delete group completed successfully.
Apr 15 15:55:13 devstack sudo[86779]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:13 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b5bac5fc-5c00-445c-a24f-4fa56e732565 tempest-CreateVolumesFromImageTest-1162996396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ee784243-9a35-4778-aa83-b53806c5dc7e" returned: 0 in 0.616s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:13 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-b5bac5fc-5c00-445c-a24f-4fa56e732565 tempest-CreateVolumesFromImageTest-1162996396 None] <== create_volume: return (1390ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:55:13 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-b5bac5fc-5c00-445c-a24f-4fa56e732565 tempest-CreateVolumesFromImageTest-1162996396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.393s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:55:13 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-641be73f-86f0-450b-8c56-478b34dbcc8a tempest-CreateVolumesFromImageTest-1162996396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.481s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:55:13 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-641be73f-86f0-450b-8c56-478b34dbcc8a tempest-CreateVolumesFromImageTest-1162996396 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:55:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-191103904',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbf19974-f834-4ea9-8b68-1690702df426,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00454744f0f24fc6962c2af3eae31aae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:55:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:55:06Z,use_quota=True,user_id='e2455213fd7342f3b50a5f588569bec9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:55:13 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-641be73f-86f0-450b-8c56-478b34dbcc8a tempest-CreateVolumesFromImageTest-1162996396 None] Creating volume fbf19974-f834-4ea9-8b68-1690702df426 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:55:13 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-641be73f-86f0-450b-8c56-478b34dbcc8a tempest-CreateVolumesFromImageTest-1162996396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:55:13 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-641be73f-86f0-450b-8c56-478b34dbcc8a tempest-CreateVolumesFromImageTest-1162996396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:55:13 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-641be73f-86f0-450b-8c56-478b34dbcc8a tempest-CreateVolumesFromImageTest-1162996396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:55:13 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-641be73f-86f0-450b-8c56-478b34dbcc8a tempest-CreateVolumesFromImageTest-1162996396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:55:13 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-641be73f-86f0-450b-8c56-478b34dbcc8a tempest-CreateVolumesFromImageTest-1162996396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:55:13 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-641be73f-86f0-450b-8c56-478b34dbcc8a tempest-CreateVolumesFromImageTest-1162996396 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:55:13 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-641be73f-86f0-450b-8c56-478b34dbcc8a tempest-CreateVolumesFromImageTest-1162996396 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:55:13 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-641be73f-86f0-450b-8c56-478b34dbcc8a tempest-CreateVolumesFromImageTest-1162996396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fbf19974-f834-4ea9-8b68-1690702df426 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:13 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b5bac5fc-5c00-445c-a24f-4fa56e732565 tempest-CreateVolumesFromImageTest-1162996396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2629841f-3b60-48db-87fd-02ede277f735) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee784243-9a35-4778-aa83-b53806c5dc7e', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:13 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b5bac5fc-5c00-445c-a24f-4fa56e732565 tempest-CreateVolumesFromImageTest-1162996396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34ce4799-d10f-490a-b10f-76f25c2c61b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:13 devstack sudo[86792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fbf19974-f834-4ea9-8b68-1690702df426 1073741824
Apr 15 15:55:13 devstack sudo[86792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:13 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-b5bac5fc-5c00-445c-a24f-4fa56e732565 tempest-CreateVolumesFromImageTest-1162996396 None] Volume volume-ee784243-9a35-4778-aa83-b53806c5dc7e (ee784243-9a35-4778-aa83-b53806c5dc7e): created successfully
Apr 15 15:55:13 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b5bac5fc-5c00-445c-a24f-4fa56e732565 tempest-CreateVolumesFromImageTest-1162996396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34ce4799-d10f-490a-b10f-76f25c2c61b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:13 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b5bac5fc-5c00-445c-a24f-4fa56e732565 tempest-CreateVolumesFromImageTest-1162996396 None] Flow 'volume_create_manager' (4e14629a-0f6c-4ac2-aa04-7960dacdc5c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:55:13 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-b5bac5fc-5c00-445c-a24f-4fa56e732565 tempest-CreateVolumesFromImageTest-1162996396 None] Created volume successfully.
Apr 15 15:55:14 devstack sudo[86792]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:14 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-641be73f-86f0-450b-8c56-478b34dbcc8a tempest-CreateVolumesFromImageTest-1162996396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fbf19974-f834-4ea9-8b68-1690702df426 1073741824" returned: 0 in 0.783s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:14 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-641be73f-86f0-450b-8c56-478b34dbcc8a tempest-CreateVolumesFromImageTest-1162996396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fbf19974-f834-4ea9-8b68-1690702df426 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:14 devstack sudo[86819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fbf19974-f834-4ea9-8b68-1690702df426
Apr 15 15:55:14 devstack sudo[86819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:15 devstack sudo[86819]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:15 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-641be73f-86f0-450b-8c56-478b34dbcc8a tempest-CreateVolumesFromImageTest-1162996396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fbf19974-f834-4ea9-8b68-1690702df426" returned: 0 in 0.523s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:15 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-641be73f-86f0-450b-8c56-478b34dbcc8a tempest-CreateVolumesFromImageTest-1162996396 None] <== create_volume: return (1349ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:55:15 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-641be73f-86f0-450b-8c56-478b34dbcc8a tempest-CreateVolumesFromImageTest-1162996396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.353s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:55:15 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-641be73f-86f0-450b-8c56-478b34dbcc8a tempest-CreateVolumesFromImageTest-1162996396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a06b2585-bf26-4c7e-b825-d4763672c6bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbf19974-f834-4ea9-8b68-1690702df426', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:15 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-641be73f-86f0-450b-8c56-478b34dbcc8a tempest-CreateVolumesFromImageTest-1162996396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b401370-539c-44aa-8791-2bd42645cf62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:15 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-641be73f-86f0-450b-8c56-478b34dbcc8a tempest-CreateVolumesFromImageTest-1162996396 None] Volume volume-fbf19974-f834-4ea9-8b68-1690702df426 (fbf19974-f834-4ea9-8b68-1690702df426): created successfully
Apr 15 15:55:15 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-641be73f-86f0-450b-8c56-478b34dbcc8a tempest-CreateVolumesFromImageTest-1162996396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b401370-539c-44aa-8791-2bd42645cf62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:15 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-641be73f-86f0-450b-8c56-478b34dbcc8a tempest-CreateVolumesFromImageTest-1162996396 None] Flow 'volume_create_manager' (420cad35-4cf9-4e09-9cf0-afed38f15b2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:55:15 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-641be73f-86f0-450b-8c56-478b34dbcc8a tempest-CreateVolumesFromImageTest-1162996396 None] Created volume successfully.
Apr 15 15:55:16 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-4d703b87-f6e2-4e02-9af8-2c7b02265fdc tempest-CreateVolumesFromImageTest-1162996396 None] Acquiring lock "cinder-fbf19974-f834-4ea9-8b68-1690702df426-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:55:16 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-4d703b87-f6e2-4e02-9af8-2c7b02265fdc tempest-CreateVolumesFromImageTest-1162996396 None] Lock "cinder-fbf19974-f834-4ea9-8b68-1690702df426-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:55:16 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-4d703b87-f6e2-4e02-9af8-2c7b02265fdc tempest-CreateVolumesFromImageTest-1162996396 None] Acquiring lock "cinder-quobyte-fbf19974-f834-4ea9-8b68-1690702df426" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:55:16 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-4d703b87-f6e2-4e02-9af8-2c7b02265fdc tempest-CreateVolumesFromImageTest-1162996396 None] Lock "cinder-quobyte-fbf19974-f834-4ea9-8b68-1690702df426" acquired by "delete_volume" :: waited 0.009s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:55:16 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08e2a2a-fad4-4be6-a87c-95ae0a328d6c]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:55:16 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4d703b87-f6e2-4e02-9af8-2c7b02265fdc tempest-CreateVolumesFromImageTest-1162996396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fbf19974-f834-4ea9-8b68-1690702df426 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:16 devstack sudo[86823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fbf19974-f834-4ea9-8b68-1690702df426
Apr 15 15:55:16 devstack sudo[86823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:16 devstack sudo[86823]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:16 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4d703b87-f6e2-4e02-9af8-2c7b02265fdc tempest-CreateVolumesFromImageTest-1162996396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fbf19974-f834-4ea9-8b68-1690702df426" returned: 0 in 0.677s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:16 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4d703b87-f6e2-4e02-9af8-2c7b02265fdc tempest-CreateVolumesFromImageTest-1162996396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fbf19974-f834-4ea9-8b68-1690702df426 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:16 devstack sudo[86828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fbf19974-f834-4ea9-8b68-1690702df426
Apr 15 15:55:16 devstack sudo[86828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:17 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:55:17 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] Flow 'volume_create_manager' (3f2ab0e7-1670-4d54-b6b4-f1d599faeacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:55:17 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99f755ae-6693-4be1-9b28-871539534c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:17 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99f755ae-6693-4be1-9b28-871539534c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:55:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1570272222',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25a7be81-59be-4dc5-b6aa-9eb9c26359f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15816a167c8a41c085c5da3afc98cafa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:55:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:55:17Z,use_quota=True,user_id='faeaa084b4114dcaa9d16606edca79c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:17 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4278be93-b6b8-4953-bae4-cd6fa507026e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:17 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4278be93-b6b8-4953-bae4-cd6fa507026e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:17 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc4fc4e8-8ad0-4f2f-bb99-b2098771aac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:17 devstack cinder-volume[82485]: DEBUG cinder.image.glance [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] Creating Keystone auth plugin from conf {{(pid=82485) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 15 15:55:17 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc4fc4e8-8ad0-4f2f-bb99-b2098771aac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '25a7be81-59be-4dc5-b6aa-9eb9c26359f5', 'volume_name': 'volume-25a7be81-59be-4dc5-b6aa-9eb9c26359f5', 'volume_size': 1, 'image_id': '0fe37db8-916e-4521-8f72-73003c13994a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0fe37db8-916e-4521-8f72-73003c13994a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '57491fc0e71d4fad9011d017ccefe515', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0fe37db8-916e-4521-8f72-73003c13994a', 'created_at': datetime.datetime(2026, 4, 15, 13, 47, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 13, 47, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0fe37db8-916e-4521-8f72-73003c13994a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f154967faf0>}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:17 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec09e3f9-b0b0-4706-aff6-96de60372873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:17 devstack sudo[86828]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:17 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec09e3f9-b0b0-4706-aff6-96de60372873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:17 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20c2714a-4105-435e-ab3b-9dd7e46a459a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:17 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] Volume 25a7be81-59be-4dc5-b6aa-9eb9c26359f5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-25a7be81-59be-4dc5-b6aa-9eb9c26359f5', 'volume_size': 1, 'image_id': '0fe37db8-916e-4521-8f72-73003c13994a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0fe37db8-916e-4521-8f72-73003c13994a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '57491fc0e71d4fad9011d017ccefe515', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0fe37db8-916e-4521-8f72-73003c13994a', 'created_at': datetime.datetime(2026, 4, 15, 13, 47, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 13, 47, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0fe37db8-916e-4521-8f72-73003c13994a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f154967faf0>}
Apr 15 15:55:17 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] Trying to clone 25a7be81-59be-4dc5-b6aa-9eb9c26359f5 from image 0fe37db8-916e-4521-8f72-73003c13994a at location (None, [{'url': 'file:///opt/stack/data/glance/images/0fe37db8-916e-4521-8f72-73003c13994a', 'metadata': {}}]). {{(pid=82485) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 15 15:55:17 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4d703b87-f6e2-4e02-9af8-2c7b02265fdc tempest-CreateVolumesFromImageTest-1162996396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fbf19974-f834-4ea9-8b68-1690702df426" returned: 0 in 0.595s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:17 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-b38a4513-ed5c-4443-8be5-8f47f88de49e tempest-GroupsTest-320222849 None] Group tempest-Group1-949185263: creating
Apr 15 15:55:17 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-4d703b87-f6e2-4e02-9af8-2c7b02265fdc tempest-CreateVolumesFromImageTest-1162996396 None] Lock "cinder-quobyte-fbf19974-f834-4ea9-8b68-1690702df426" released by "delete_volume" :: held 1.326s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:55:17 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-4d703b87-f6e2-4e02-9af8-2c7b02265fdc tempest-CreateVolumesFromImageTest-1162996396 None] Created reservations ['6c51a27c-04f9-48c4-97c2-2e47f96bab7e', '99ef0627-f3d3-4796-a712-54eabc4d19ad', '5a0dec02-d75a-43b7-a859-5c9dcc69e803', '5d2694dd-0304-445f-89f6-1ef0fa327945'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:55:17 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-b38a4513-ed5c-4443-8be5-8f47f88de49e tempest-GroupsTest-320222849 None] Group tempest-Group1-949185263: created successfully
Apr 15 15:55:17 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-b38a4513-ed5c-4443-8be5-8f47f88de49e tempest-GroupsTest-320222849 None] Create group completed successfully.
Apr 15 15:55:17 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-4d703b87-f6e2-4e02-9af8-2c7b02265fdc tempest-CreateVolumesFromImageTest-1162996396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:55:17 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-4d703b87-f6e2-4e02-9af8-2c7b02265fdc tempest-CreateVolumesFromImageTest-1162996396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:55:17 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-4d703b87-f6e2-4e02-9af8-2c7b02265fdc tempest-CreateVolumesFromImageTest-1162996396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:55:17 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-4d703b87-f6e2-4e02-9af8-2c7b02265fdc tempest-CreateVolumesFromImageTest-1162996396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:55:17 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-4d703b87-f6e2-4e02-9af8-2c7b02265fdc tempest-CreateVolumesFromImageTest-1162996396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:55:17 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4d703b87-f6e2-4e02-9af8-2c7b02265fdc tempest-CreateVolumesFromImageTest-1162996396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:17 devstack sudo[86833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:55:17 devstack sudo[86833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:17 devstack cinder-volume[82485]: DEBUG cinder.image.image_utils [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0fe37db8-916e-4521-8f72-73003c13994a_ubr100xydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82485) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 15 15:55:17 devstack cinder-volume[82485]: INFO cinder.image.image_utils [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] Image download 20.69 MB at 20.69 MB/s
Apr 15 15:55:17 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9497c5-87e7-487a-b9f9-ec95d03e7c0f]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:55:17 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fe37db8-916e-4521-8f72-73003c13994a_ubr100xydevstack@QuobyteHD {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:17 devstack sudo[86835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fe37db8-916e-4521-8f72-73003c13994a_ubr100xydevstack@QuobyteHD
Apr 15 15:55:17 devstack sudo[86835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:17 devstack sudo[86833]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:17 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4d703b87-f6e2-4e02-9af8-2c7b02265fdc tempest-CreateVolumesFromImageTest-1162996396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.431s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:17 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-4d703b87-f6e2-4e02-9af8-2c7b02265fdc tempest-CreateVolumesFromImageTest-1162996396 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:55:17 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-4d703b87-f6e2-4e02-9af8-2c7b02265fdc tempest-CreateVolumesFromImageTest-1162996396 None] Deleted volume successfully.
Apr 15 15:55:17 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-4d703b87-f6e2-4e02-9af8-2c7b02265fdc tempest-CreateVolumesFromImageTest-1162996396 None] Lock "cinder-fbf19974-f834-4ea9-8b68-1690702df426-delete_volume" released by "delete_volume" :: held 1.942s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:55:18 devstack sudo[86835]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fe37db8-916e-4521-8f72-73003c13994a_ubr100xydevstack@QuobyteHD" returned: 0 in 0.508s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:18 devstack cinder-volume[82485]: DEBUG cinder.image.image_utils [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] Temporary image 0fe37db8-916e-4521-8f72-73003c13994a is fetched for user faeaa084b4114dcaa9d16606edca79c0. {{(pid=82485) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 15 15:55:18 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f68061e-4558-486c-bbac-7d364fd82808]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:55:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fe37db8-916e-4521-8f72-73003c13994a_ubr100xydevstack@QuobyteHD {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:18 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-a9b98f2d-14e1-414e-bb09-a2096741aeed tempest-CreateVolumesFromImageTest-1162996396 None] Acquiring lock "cinder-ee784243-9a35-4778-aa83-b53806c5dc7e-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:55:18 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-a9b98f2d-14e1-414e-bb09-a2096741aeed tempest-CreateVolumesFromImageTest-1162996396 None] Lock "cinder-ee784243-9a35-4778-aa83-b53806c5dc7e-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:55:18 devstack sudo[86841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fe37db8-916e-4521-8f72-73003c13994a_ubr100xydevstack@QuobyteHD
Apr 15 15:55:18 devstack sudo[86841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:18 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-a9b98f2d-14e1-414e-bb09-a2096741aeed tempest-CreateVolumesFromImageTest-1162996396 None] Acquiring lock "cinder-quobyte-ee784243-9a35-4778-aa83-b53806c5dc7e" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:55:18 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-a9b98f2d-14e1-414e-bb09-a2096741aeed tempest-CreateVolumesFromImageTest-1162996396 None] Lock "cinder-quobyte-ee784243-9a35-4778-aa83-b53806c5dc7e" acquired by "delete_volume" :: waited 0.008s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:55:18 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39ef13f-21b9-4a25-9404-15cdd731b58f]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:55:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-a9b98f2d-14e1-414e-bb09-a2096741aeed tempest-CreateVolumesFromImageTest-1162996396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ee784243-9a35-4778-aa83-b53806c5dc7e {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:18 devstack sudo[86843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ee784243-9a35-4778-aa83-b53806c5dc7e
Apr 15 15:55:18 devstack sudo[86843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:18 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-1f7cbe23-0e24-498d-a084-8bbcc30d5897 tempest-GroupsTest-320222849 None] Group tempest-Group2-1748859211: creating
Apr 15 15:55:18 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-1f7cbe23-0e24-498d-a084-8bbcc30d5897 tempest-GroupsTest-320222849 None] Group tempest-Group2-1748859211: created successfully
Apr 15 15:55:18 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-1f7cbe23-0e24-498d-a084-8bbcc30d5897 tempest-GroupsTest-320222849 None] Create group completed successfully.
Apr 15 15:55:18 devstack sudo[86841]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fe37db8-916e-4521-8f72-73003c13994a_ubr100xydevstack@QuobyteHD" returned: 0 in 0.534s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:55:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:55:18 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:55:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1570272222',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25a7be81-59be-4dc5-b6aa-9eb9c26359f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15816a167c8a41c085c5da3afc98cafa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:55:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:55:17Z,use_quota=True,user_id='faeaa084b4114dcaa9d16606edca79c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:55:18 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] Creating volume 25a7be81-59be-4dc5-b6aa-9eb9c26359f5 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:55:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:55:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:55:18 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:55:18 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:55:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:55:18 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:55:18 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:55:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-25a7be81-59be-4dc5-b6aa-9eb9c26359f5 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:18 devstack sudo[86869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-25a7be81-59be-4dc5-b6aa-9eb9c26359f5 1073741824
Apr 15 15:55:18 devstack sudo[86869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:19 devstack sudo[86843]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-a9b98f2d-14e1-414e-bb09-a2096741aeed tempest-CreateVolumesFromImageTest-1162996396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ee784243-9a35-4778-aa83-b53806c5dc7e" returned: 0 in 0.699s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-a9b98f2d-14e1-414e-bb09-a2096741aeed tempest-CreateVolumesFromImageTest-1162996396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ee784243-9a35-4778-aa83-b53806c5dc7e {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:19 devstack sudo[86880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ee784243-9a35-4778-aa83-b53806c5dc7e
Apr 15 15:55:19 devstack sudo[86880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:19 devstack sudo[86869]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-25a7be81-59be-4dc5-b6aa-9eb9c26359f5 1073741824" returned: 0 in 0.758s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-25a7be81-59be-4dc5-b6aa-9eb9c26359f5 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:19 devstack sudo[86887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-25a7be81-59be-4dc5-b6aa-9eb9c26359f5
Apr 15 15:55:19 devstack sudo[86887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:19 devstack sudo[86880]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-a9b98f2d-14e1-414e-bb09-a2096741aeed tempest-CreateVolumesFromImageTest-1162996396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ee784243-9a35-4778-aa83-b53806c5dc7e" returned: 0 in 0.579s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:19 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-a9b98f2d-14e1-414e-bb09-a2096741aeed tempest-CreateVolumesFromImageTest-1162996396 None] Lock "cinder-quobyte-ee784243-9a35-4778-aa83-b53806c5dc7e" released by "delete_volume" :: held 1.304s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:55:19 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-a9b98f2d-14e1-414e-bb09-a2096741aeed tempest-CreateVolumesFromImageTest-1162996396 None] Created reservations ['40c51a02-0500-4678-876d-6c08a91eebbe', 'b0de64aa-2f8c-489a-8005-ab2b29190d44', '4229bcb5-0803-4817-8822-ca291ea9b54d', 'e06801b5-7438-440c-ad20-93fed2a60efe'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:55:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-a9b98f2d-14e1-414e-bb09-a2096741aeed tempest-CreateVolumesFromImageTest-1162996396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:55:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-a9b98f2d-14e1-414e-bb09-a2096741aeed tempest-CreateVolumesFromImageTest-1162996396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:55:19 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-a9b98f2d-14e1-414e-bb09-a2096741aeed tempest-CreateVolumesFromImageTest-1162996396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:55:19 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-a9b98f2d-14e1-414e-bb09-a2096741aeed tempest-CreateVolumesFromImageTest-1162996396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:55:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-a9b98f2d-14e1-414e-bb09-a2096741aeed tempest-CreateVolumesFromImageTest-1162996396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:55:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-a9b98f2d-14e1-414e-bb09-a2096741aeed tempest-CreateVolumesFromImageTest-1162996396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:19 devstack sudo[86889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:55:19 devstack sudo[86889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:19 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4af8eca-0a27-42f2-8ed8-5b5d0dc4e6dc tempest-GroupsTest-320222849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:55:19 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-c4af8eca-0a27-42f2-8ed8-5b5d0dc4e6dc tempest-GroupsTest-320222849 None] Flow 'volume_create_manager' (68c6184c-0439-467b-ba31-c7e01bd30d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:55:20 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-c4af8eca-0a27-42f2-8ed8-5b5d0dc4e6dc tempest-GroupsTest-320222849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (687d110d-7592-46bf-9ea3-7f979114e895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:20 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-c4af8eca-0a27-42f2-8ed8-5b5d0dc4e6dc tempest-GroupsTest-320222849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (687d110d-7592-46bf-9ea3-7f979114e895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:55:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1967160693',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8fdb2586-3b56-4697-b539-b4dc6df6e851,host='devstack@QuobyteHD#QuobyteHD',id=9c740995-0870-4825-b9ea-811e6e9e52cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53207a6d9ae64ea980a45c9bd54c9a87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:55:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:55:20Z,use_quota=True,user_id='c8753fb68c6842f6ac0e6f639ded812c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edea869a-770e-4e5a-b063-3a47a3231e27),volume_type_id=edea869a-770e-4e5a-b063-3a47a3231e27)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:20 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-c4af8eca-0a27-42f2-8ed8-5b5d0dc4e6dc tempest-GroupsTest-320222849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a52e4d9-432d-468f-a227-0f13cde7677e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:20 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-c4af8eca-0a27-42f2-8ed8-5b5d0dc4e6dc tempest-GroupsTest-320222849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a52e4d9-432d-468f-a227-0f13cde7677e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:20 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-c4af8eca-0a27-42f2-8ed8-5b5d0dc4e6dc tempest-GroupsTest-320222849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3876b68a-aa4b-4f71-b50c-51ff113de9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:20 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-c4af8eca-0a27-42f2-8ed8-5b5d0dc4e6dc tempest-GroupsTest-320222849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3876b68a-aa4b-4f71-b50c-51ff113de9ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c740995-0870-4825-b9ea-811e6e9e52cd', 'volume_name': 'volume-9c740995-0870-4825-b9ea-811e6e9e52cd', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:20 devstack sudo[86887]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:20 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-c4af8eca-0a27-42f2-8ed8-5b5d0dc4e6dc tempest-GroupsTest-320222849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45bbb71f-3053-4218-9b7d-b92cd25b5c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:20 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-c4af8eca-0a27-42f2-8ed8-5b5d0dc4e6dc tempest-GroupsTest-320222849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45bbb71f-3053-4218-9b7d-b92cd25b5c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:20 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-c4af8eca-0a27-42f2-8ed8-5b5d0dc4e6dc tempest-GroupsTest-320222849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8676f75-6fe1-42f4-9e0f-97c67436d84d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:20 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-c4af8eca-0a27-42f2-8ed8-5b5d0dc4e6dc tempest-GroupsTest-320222849 None] Volume 9c740995-0870-4825-b9ea-811e6e9e52cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c740995-0870-4825-b9ea-811e6e9e52cd', 'volume_size': 1}
Apr 15 15:55:20 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-c4af8eca-0a27-42f2-8ed8-5b5d0dc4e6dc tempest-GroupsTest-320222849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:55:20 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-25a7be81-59be-4dc5-b6aa-9eb9c26359f5" returned: 0 in 0.476s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:20 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] <== create_volume: return (1274ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:55:20 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.276s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:55:20 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-c4af8eca-0a27-42f2-8ed8-5b5d0dc4e6dc tempest-GroupsTest-320222849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:55:20 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-c4af8eca-0a27-42f2-8ed8-5b5d0dc4e6dc tempest-GroupsTest-320222849 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=8fdb2586-3b56-4697-b539-b4dc6df6e851,created_at=2026-04-15T13:55:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1967160693',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8fdb2586-3b56-4697-b539-b4dc6df6e851,host='devstack@QuobyteHD#QuobyteHD',id=9c740995-0870-4825-b9ea-811e6e9e52cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53207a6d9ae64ea980a45c9bd54c9a87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:55:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:55:20Z,use_quota=True,user_id='c8753fb68c6842f6ac0e6f639ded812c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edea869a-770e-4e5a-b063-3a47a3231e27),volume_type_id=edea869a-770e-4e5a-b063-3a47a3231e27)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:55:20 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-c4af8eca-0a27-42f2-8ed8-5b5d0dc4e6dc tempest-GroupsTest-320222849 None] Creating volume 9c740995-0870-4825-b9ea-811e6e9e52cd {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:55:20 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-c4af8eca-0a27-42f2-8ed8-5b5d0dc4e6dc tempest-GroupsTest-320222849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:55:20 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-c4af8eca-0a27-42f2-8ed8-5b5d0dc4e6dc tempest-GroupsTest-320222849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:55:20 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-c4af8eca-0a27-42f2-8ed8-5b5d0dc4e6dc tempest-GroupsTest-320222849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:55:20 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-c4af8eca-0a27-42f2-8ed8-5b5d0dc4e6dc tempest-GroupsTest-320222849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:55:20 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-c4af8eca-0a27-42f2-8ed8-5b5d0dc4e6dc tempest-GroupsTest-320222849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:55:20 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-c4af8eca-0a27-42f2-8ed8-5b5d0dc4e6dc tempest-GroupsTest-320222849 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:55:20 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-c4af8eca-0a27-42f2-8ed8-5b5d0dc4e6dc tempest-GroupsTest-320222849 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:55:20 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-c4af8eca-0a27-42f2-8ed8-5b5d0dc4e6dc tempest-GroupsTest-320222849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-9c740995-0870-4825-b9ea-811e6e9e52cd 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:20 devstack sudo[86892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-9c740995-0870-4825-b9ea-811e6e9e52cd 1073741824
Apr 15 15:55:20 devstack sudo[86892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:20 devstack cinder-volume[82485]: DEBUG cinder.volume.volume_utils [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] Attempting download of 0fe37db8-916e-4521-8f72-73003c13994a ((None, [{'url': 'file:///opt/stack/data/glance/images/0fe37db8-916e-4521-8f72-73003c13994a', 'metadata': {}}])) to volume 25a7be81-59be-4dc5-b6aa-9eb9c26359f5. {{(pid=82485) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 15 15:55:20 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e9b361-6d68-4705-945a-bc7d84282046]: (4, 'raw') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:55:20 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0fe37db8-916e-4521-8f72-73003c13994a_0f0_7fvl {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:20 devstack sudo[86894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0fe37db8-916e-4521-8f72-73003c13994a_0f0_7fvl
Apr 15 15:55:20 devstack sudo[86894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:20 devstack sudo[86889]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:20 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-a9b98f2d-14e1-414e-bb09-a2096741aeed tempest-CreateVolumesFromImageTest-1162996396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.664s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:20 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-a9b98f2d-14e1-414e-bb09-a2096741aeed tempest-CreateVolumesFromImageTest-1162996396 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:55:20 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-a9b98f2d-14e1-414e-bb09-a2096741aeed tempest-CreateVolumesFromImageTest-1162996396 None] Deleted volume successfully.
Apr 15 15:55:20 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-a9b98f2d-14e1-414e-bb09-a2096741aeed tempest-CreateVolumesFromImageTest-1162996396 None] Lock "cinder-ee784243-9a35-4778-aa83-b53806c5dc7e-delete_volume" released by "delete_volume" :: held 2.158s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:55:20 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-8c9d568c-8222-466e-bbc4-fea2bebaed06 tempest-CreateVolumesFromImageTest-1162996396 None] Acquiring lock "cinder-41369eb3-644d-4319-a377-780794ff0d3d-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:55:20 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-8c9d568c-8222-466e-bbc4-fea2bebaed06 tempest-CreateVolumesFromImageTest-1162996396 None] Lock "cinder-41369eb3-644d-4319-a377-780794ff0d3d-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:55:20 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-8c9d568c-8222-466e-bbc4-fea2bebaed06 tempest-CreateVolumesFromImageTest-1162996396 None] Acquiring lock "cinder-quobyte-41369eb3-644d-4319-a377-780794ff0d3d" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:55:20 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-8c9d568c-8222-466e-bbc4-fea2bebaed06 tempest-CreateVolumesFromImageTest-1162996396 None] Lock "cinder-quobyte-41369eb3-644d-4319-a377-780794ff0d3d" acquired by "delete_volume" :: waited 0.025s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:55:20 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[70bc1cfb-bcf2-4a1d-ad35-dc8d84ced67d]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:55:20 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-8c9d568c-8222-466e-bbc4-fea2bebaed06 tempest-CreateVolumesFromImageTest-1162996396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-41369eb3-644d-4319-a377-780794ff0d3d {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:20 devstack sudo[86897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-41369eb3-644d-4319-a377-780794ff0d3d
Apr 15 15:55:20 devstack sudo[86897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:20 devstack sudo[86892]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:20 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-c4af8eca-0a27-42f2-8ed8-5b5d0dc4e6dc tempest-GroupsTest-320222849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-9c740995-0870-4825-b9ea-811e6e9e52cd 1073741824" returned: 0 in 0.831s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:20 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-c4af8eca-0a27-42f2-8ed8-5b5d0dc4e6dc tempest-GroupsTest-320222849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-9c740995-0870-4825-b9ea-811e6e9e52cd {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:20 devstack sudo[86905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-9c740995-0870-4825-b9ea-811e6e9e52cd
Apr 15 15:55:20 devstack sudo[86905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:21 devstack sudo[86894]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0fe37db8-916e-4521-8f72-73003c13994a_0f0_7fvl" returned: 0 in 0.905s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0fe37db8-916e-4521-8f72-73003c13994a_0f0_7fvl {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:21 devstack sudo[86910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0fe37db8-916e-4521-8f72-73003c13994a_0f0_7fvl
Apr 15 15:55:21 devstack sudo[86910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:21 devstack sudo[86897]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-8c9d568c-8222-466e-bbc4-fea2bebaed06 tempest-CreateVolumesFromImageTest-1162996396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-41369eb3-644d-4319-a377-780794ff0d3d" returned: 0 in 0.600s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-8c9d568c-8222-466e-bbc4-fea2bebaed06 tempest-CreateVolumesFromImageTest-1162996396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-41369eb3-644d-4319-a377-780794ff0d3d {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:21 devstack sudo[86913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-41369eb3-644d-4319-a377-780794ff0d3d
Apr 15 15:55:21 devstack sudo[86913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:21 devstack sudo[86905]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-c4af8eca-0a27-42f2-8ed8-5b5d0dc4e6dc tempest-GroupsTest-320222849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-9c740995-0870-4825-b9ea-811e6e9e52cd" returned: 0 in 0.569s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:21 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-c4af8eca-0a27-42f2-8ed8-5b5d0dc4e6dc tempest-GroupsTest-320222849 None] <== create_volume: return (1431ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:55:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-c4af8eca-0a27-42f2-8ed8-5b5d0dc4e6dc tempest-GroupsTest-320222849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.434s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:55:21 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-c4af8eca-0a27-42f2-8ed8-5b5d0dc4e6dc tempest-GroupsTest-320222849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8676f75-6fe1-42f4-9e0f-97c67436d84d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c740995-0870-4825-b9ea-811e6e9e52cd', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:21 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-c4af8eca-0a27-42f2-8ed8-5b5d0dc4e6dc tempest-GroupsTest-320222849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fd1e168-f5a2-4f9f-8bd1-9d9c8860ae89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:21 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-c4af8eca-0a27-42f2-8ed8-5b5d0dc4e6dc tempest-GroupsTest-320222849 None] Volume volume-9c740995-0870-4825-b9ea-811e6e9e52cd (9c740995-0870-4825-b9ea-811e6e9e52cd): created successfully
Apr 15 15:55:21 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-c4af8eca-0a27-42f2-8ed8-5b5d0dc4e6dc tempest-GroupsTest-320222849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fd1e168-f5a2-4f9f-8bd1-9d9c8860ae89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:21 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-c4af8eca-0a27-42f2-8ed8-5b5d0dc4e6dc tempest-GroupsTest-320222849 None] Flow 'volume_create_manager' (68c6184c-0439-467b-ba31-c7e01bd30d71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:55:21 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-c4af8eca-0a27-42f2-8ed8-5b5d0dc4e6dc tempest-GroupsTest-320222849 None] Created volume successfully.
Apr 15 15:55:21 devstack sudo[86910]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0fe37db8-916e-4521-8f72-73003c13994a_0f0_7fvl" returned: 1 in 0.571s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0fe37db8-916e-4521-8f72-73003c13994a_0f0_7fvl' failed. Not Retrying. {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 15:55:21 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4baf01-046e-4467-b5dc-597dc4ab46ab]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:55:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fe37db8-916e-4521-8f72-73003c13994a_ubr100xydevstack@QuobyteHD {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:21 devstack sudo[86913]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-8c9d568c-8222-466e-bbc4-fea2bebaed06 tempest-CreateVolumesFromImageTest-1162996396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-41369eb3-644d-4319-a377-780794ff0d3d" returned: 0 in 0.500s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:21 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-8c9d568c-8222-466e-bbc4-fea2bebaed06 tempest-CreateVolumesFromImageTest-1162996396 None] Lock "cinder-quobyte-41369eb3-644d-4319-a377-780794ff0d3d" released by "delete_volume" :: held 1.130s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:55:21 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-8c9d568c-8222-466e-bbc4-fea2bebaed06 tempest-CreateVolumesFromImageTest-1162996396 None] Created reservations ['f3a5d53c-4666-4bf6-a5ed-2dc44f0e9f88', 'bf087ee9-4cb2-480d-a319-c6518cd9cabe', '5ecdd070-6d04-477c-8172-8c748c54f245', '14f8a491-c56a-4953-8768-f4c9394f5d4d'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:55:21 devstack sudo[86919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fe37db8-916e-4521-8f72-73003c13994a_ubr100xydevstack@QuobyteHD
Apr 15 15:55:21 devstack sudo[86919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-8c9d568c-8222-466e-bbc4-fea2bebaed06 tempest-CreateVolumesFromImageTest-1162996396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:55:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-8c9d568c-8222-466e-bbc4-fea2bebaed06 tempest-CreateVolumesFromImageTest-1162996396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:55:21 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-8c9d568c-8222-466e-bbc4-fea2bebaed06 tempest-CreateVolumesFromImageTest-1162996396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:55:21 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-8c9d568c-8222-466e-bbc4-fea2bebaed06 tempest-CreateVolumesFromImageTest-1162996396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:55:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-8c9d568c-8222-466e-bbc4-fea2bebaed06 tempest-CreateVolumesFromImageTest-1162996396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:55:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-8c9d568c-8222-466e-bbc4-fea2bebaed06 tempest-CreateVolumesFromImageTest-1162996396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:21 devstack sudo[86921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:55:21 devstack sudo[86921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:22 devstack sudo[86921]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:22 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-8c9d568c-8222-466e-bbc4-fea2bebaed06 tempest-CreateVolumesFromImageTest-1162996396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.580s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:22 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-8c9d568c-8222-466e-bbc4-fea2bebaed06 tempest-CreateVolumesFromImageTest-1162996396 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:55:22 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-8c9d568c-8222-466e-bbc4-fea2bebaed06 tempest-CreateVolumesFromImageTest-1162996396 None] Deleted volume successfully.
Apr 15 15:55:22 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-8c9d568c-8222-466e-bbc4-fea2bebaed06 tempest-CreateVolumesFromImageTest-1162996396 None] Lock "cinder-41369eb3-644d-4319-a377-780794ff0d3d-delete_volume" released by "delete_volume" :: held 1.869s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:55:22 devstack sudo[86919]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:22 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fe37db8-916e-4521-8f72-73003c13994a_ubr100xydevstack@QuobyteHD" returned: 0 in 0.761s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:22 devstack cinder-volume[82485]: DEBUG cinder.image.image_utils [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] 0fe37db8-916e-4521-8f72-73003c13994a was qcow2, converting to raw {{(pid=82485) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 15 15:55:22 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0fe37db8-916e-4521-8f72-73003c13994a_ubr100xydevstack@QuobyteHD /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-25a7be81-59be-4dc5-b6aa-9eb9c26359f5 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:22 devstack sudo[86927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0fe37db8-916e-4521-8f72-73003c13994a_ubr100xydevstack@QuobyteHD /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-25a7be81-59be-4dc5-b6aa-9eb9c26359f5
Apr 15 15:55:22 devstack sudo[86927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:22 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-44554bc6-030b-4835-b8bc-3145333c65f0 tempest-GroupsTest-320222849 None] Acquiring lock "cinder-quobyte-9c740995-0870-4825-b9ea-811e6e9e52cd" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:55:22 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-44554bc6-030b-4835-b8bc-3145333c65f0 tempest-GroupsTest-320222849 None] Lock "cinder-quobyte-9c740995-0870-4825-b9ea-811e6e9e52cd" acquired by "delete_volume" :: waited 0.009s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:55:22 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[7927fa83-7fbb-4d60-b53a-03fb7a3ae304]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:55:22 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-44554bc6-030b-4835-b8bc-3145333c65f0 tempest-GroupsTest-320222849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-9c740995-0870-4825-b9ea-811e6e9e52cd {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:22 devstack sudo[86929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-9c740995-0870-4825-b9ea-811e6e9e52cd
Apr 15 15:55:22 devstack sudo[86929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:22 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-8e041650-7c3d-44fc-b55a-1477e55c934f tempest-CreateVolumesFromImageTest-1162996396 None] Acquiring lock "cinder-7a98ac5b-1a78-4505-9cdb-bd61c0175f20-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:55:22 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-8e041650-7c3d-44fc-b55a-1477e55c934f tempest-CreateVolumesFromImageTest-1162996396 None] Lock "cinder-7a98ac5b-1a78-4505-9cdb-bd61c0175f20-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:55:22 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-8e041650-7c3d-44fc-b55a-1477e55c934f tempest-CreateVolumesFromImageTest-1162996396 None] Acquiring lock "cinder-quobyte-7a98ac5b-1a78-4505-9cdb-bd61c0175f20" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:55:22 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-8e041650-7c3d-44fc-b55a-1477e55c934f tempest-CreateVolumesFromImageTest-1162996396 None] Lock "cinder-quobyte-7a98ac5b-1a78-4505-9cdb-bd61c0175f20" acquired by "delete_volume" :: waited 0.015s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:55:22 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd49a82-3d59-46d3-b17c-32bc6aa84595]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:55:22 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-8e041650-7c3d-44fc-b55a-1477e55c934f tempest-CreateVolumesFromImageTest-1162996396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-7a98ac5b-1a78-4505-9cdb-bd61c0175f20 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:22 devstack sudo[86931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-7a98ac5b-1a78-4505-9cdb-bd61c0175f20
Apr 15 15:55:22 devstack sudo[86931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:23 devstack sudo[86929]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:23 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-44554bc6-030b-4835-b8bc-3145333c65f0 tempest-GroupsTest-320222849 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-9c740995-0870-4825-b9ea-811e6e9e52cd" returned: 0 in 0.601s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:23 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-44554bc6-030b-4835-b8bc-3145333c65f0 tempest-GroupsTest-320222849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-9c740995-0870-4825-b9ea-811e6e9e52cd {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:23 devstack sudo[86946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-9c740995-0870-4825-b9ea-811e6e9e52cd
Apr 15 15:55:23 devstack sudo[86946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:23 devstack sudo[86931]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:23 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-8e041650-7c3d-44fc-b55a-1477e55c934f tempest-CreateVolumesFromImageTest-1162996396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-7a98ac5b-1a78-4505-9cdb-bd61c0175f20" returned: 0 in 0.931s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:23 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-8e041650-7c3d-44fc-b55a-1477e55c934f tempest-CreateVolumesFromImageTest-1162996396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-7a98ac5b-1a78-4505-9cdb-bd61c0175f20 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:23 devstack sudo[86927]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:23 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0fe37db8-916e-4521-8f72-73003c13994a_ubr100xydevstack@QuobyteHD /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-25a7be81-59be-4dc5-b6aa-9eb9c26359f5" returned: 0 in 1.296s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:23 devstack cinder-volume[82485]: DEBUG cinder.image.image_utils [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0fe37db8-916e-4521-8f72-73003c13994a_ubr100xydevstack@QuobyteHD, size 112.00 MB, duration 1.30 sec, destination /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-25a7be81-59be-4dc5-b6aa-9eb9c26359f5 {{(pid=82485) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 15:55:23 devstack cinder-volume[82485]: INFO cinder.image.image_utils [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] Converted 112.00 MB image at 86.27 MB/s
Apr 15 15:55:23 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-25a7be81-59be-4dc5-b6aa-9eb9c26359f5 1G {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:23 devstack sudo[86969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-7a98ac5b-1a78-4505-9cdb-bd61c0175f20
Apr 15 15:55:23 devstack sudo[86969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:23 devstack sudo[86970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-25a7be81-59be-4dc5-b6aa-9eb9c26359f5 1G
Apr 15 15:55:23 devstack sudo[86970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:23 devstack sudo[86946]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:23 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-44554bc6-030b-4835-b8bc-3145333c65f0 tempest-GroupsTest-320222849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-9c740995-0870-4825-b9ea-811e6e9e52cd" returned: 0 in 0.812s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:23 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-44554bc6-030b-4835-b8bc-3145333c65f0 tempest-GroupsTest-320222849 None] Lock "cinder-quobyte-9c740995-0870-4825-b9ea-811e6e9e52cd" released by "delete_volume" :: held 1.445s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:55:24 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-44554bc6-030b-4835-b8bc-3145333c65f0 tempest-GroupsTest-320222849 None] Created reservations ['0653c0e5-81cf-4d27-8b35-33873f04aa1a'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:55:24 devstack cinder-volume[82485]: WARNING cinder.quota [None req-44554bc6-030b-4835-b8bc-3145333c65f0 tempest-GroupsTest-320222849 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1040346944 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1040346944, it is now deprecated. Please use the default quota class for default quota.
Apr 15 15:55:24 devstack cinder-volume[82485]: WARNING cinder.quota [None req-44554bc6-030b-4835-b8bc-3145333c65f0 tempest-GroupsTest-320222849 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1040346944 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1040346944, it is now deprecated. Please use the default quota class for default quota.
Apr 15 15:55:24 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-44554bc6-030b-4835-b8bc-3145333c65f0 tempest-GroupsTest-320222849 None] Created reservations ['e7b501ab-1990-4406-966d-b7bc08eb159c', 'afa8103d-3562-4625-b881-5a28d40fab00', 'bc996e43-7c0b-4bb6-964b-cd6e305d4be6', '323b3bec-3502-43af-b15c-c85d7e345267'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:55:24 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-44554bc6-030b-4835-b8bc-3145333c65f0 tempest-GroupsTest-320222849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:55:24 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-44554bc6-030b-4835-b8bc-3145333c65f0 tempest-GroupsTest-320222849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:55:24 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-44554bc6-030b-4835-b8bc-3145333c65f0 tempest-GroupsTest-320222849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:55:24 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-44554bc6-030b-4835-b8bc-3145333c65f0 tempest-GroupsTest-320222849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:55:24 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-44554bc6-030b-4835-b8bc-3145333c65f0 tempest-GroupsTest-320222849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:55:24 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-44554bc6-030b-4835-b8bc-3145333c65f0 tempest-GroupsTest-320222849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:24 devstack sudo[86997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:55:24 devstack sudo[86997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:24 devstack sudo[86969]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:24 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-8e041650-7c3d-44fc-b55a-1477e55c934f tempest-CreateVolumesFromImageTest-1162996396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-7a98ac5b-1a78-4505-9cdb-bd61c0175f20" returned: 0 in 0.575s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:24 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-8e041650-7c3d-44fc-b55a-1477e55c934f tempest-CreateVolumesFromImageTest-1162996396 None] Lock "cinder-quobyte-7a98ac5b-1a78-4505-9cdb-bd61c0175f20" released by "delete_volume" :: held 1.544s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:55:24 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-8e041650-7c3d-44fc-b55a-1477e55c934f tempest-CreateVolumesFromImageTest-1162996396 None] Created reservations ['2f8f28ee-de71-4d08-af14-1475a26f6dcf', '8df2c1a5-1ac3-4f75-b310-e9a76376e7e3', 'a327ea73-44dd-4387-bceb-bb995603732d', '4d2fe782-9682-42c8-a0cf-22d722c99d74'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:55:24 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-8e041650-7c3d-44fc-b55a-1477e55c934f tempest-CreateVolumesFromImageTest-1162996396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:55:24 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-8e041650-7c3d-44fc-b55a-1477e55c934f tempest-CreateVolumesFromImageTest-1162996396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:55:24 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-8e041650-7c3d-44fc-b55a-1477e55c934f tempest-CreateVolumesFromImageTest-1162996396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:55:24 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-8e041650-7c3d-44fc-b55a-1477e55c934f tempest-CreateVolumesFromImageTest-1162996396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:55:24 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-8e041650-7c3d-44fc-b55a-1477e55c934f tempest-CreateVolumesFromImageTest-1162996396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:55:24 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-8e041650-7c3d-44fc-b55a-1477e55c934f tempest-CreateVolumesFromImageTest-1162996396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:24 devstack sudo[87004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:55:24 devstack sudo[87004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:24 devstack sudo[86970]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:24 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-25a7be81-59be-4dc5-b6aa-9eb9c26359f5 1G" returned: 0 in 0.957s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:24 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ea75ef-8975-48cf-b432-2cb82872b1b5]: (4, 'raw') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:55:24 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-25a7be81-59be-4dc5-b6aa-9eb9c26359f5 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:24 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-ed1b60ed-29af-4bb1-ad20-854e4841e6d7 tempest-CreateVolumesFromImageTest-1162996396 None] Acquiring lock "cinder-3874e5f6-4295-466c-9fb3-5f60c56a2da5-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:55:24 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-ed1b60ed-29af-4bb1-ad20-854e4841e6d7 tempest-CreateVolumesFromImageTest-1162996396 None] Lock "cinder-3874e5f6-4295-466c-9fb3-5f60c56a2da5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:55:24 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-ed1b60ed-29af-4bb1-ad20-854e4841e6d7 tempest-CreateVolumesFromImageTest-1162996396 None] Acquiring lock "cinder-quobyte-3874e5f6-4295-466c-9fb3-5f60c56a2da5" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:55:25 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-ed1b60ed-29af-4bb1-ad20-854e4841e6d7 tempest-CreateVolumesFromImageTest-1162996396 None] Lock "cinder-quobyte-3874e5f6-4295-466c-9fb3-5f60c56a2da5" acquired by "delete_volume" :: waited 0.036s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:55:25 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd0fa5e-9fb9-4e3c-bcdb-1a28e9a03128]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:55:25 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ed1b60ed-29af-4bb1-ad20-854e4841e6d7 tempest-CreateVolumesFromImageTest-1162996396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3874e5f6-4295-466c-9fb3-5f60c56a2da5 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:25 devstack sudo[87008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-25a7be81-59be-4dc5-b6aa-9eb9c26359f5
Apr 15 15:55:25 devstack sudo[87008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:25 devstack sudo[86997]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:25 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-44554bc6-030b-4835-b8bc-3145333c65f0 tempest-GroupsTest-320222849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.976s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:25 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-44554bc6-030b-4835-b8bc-3145333c65f0 tempest-GroupsTest-320222849 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:55:25 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-7e1f21d5-847f-43cd-8592-8d3c3f847327 tempest-GroupsTest-320222849 None] Created reservations ['cdf1da3a-97b2-4b1b-9857-6a0a823de644'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:55:25 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-44554bc6-030b-4835-b8bc-3145333c65f0 tempest-GroupsTest-320222849 None] Delete group completed successfully.
Apr 15 15:55:25 devstack sudo[87012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3874e5f6-4295-466c-9fb3-5f60c56a2da5
Apr 15 15:55:25 devstack sudo[87012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:25 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7e1f21d5-847f-43cd-8592-8d3c3f847327 tempest-GroupsTest-320222849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:55:25 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7e1f21d5-847f-43cd-8592-8d3c3f847327 tempest-GroupsTest-320222849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:55:25 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-7e1f21d5-847f-43cd-8592-8d3c3f847327 tempest-GroupsTest-320222849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:55:25 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-7e1f21d5-847f-43cd-8592-8d3c3f847327 tempest-GroupsTest-320222849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:55:25 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7e1f21d5-847f-43cd-8592-8d3c3f847327 tempest-GroupsTest-320222849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:55:25 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7e1f21d5-847f-43cd-8592-8d3c3f847327 tempest-GroupsTest-320222849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:25 devstack sudo[87015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:55:25 devstack sudo[87015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:25 devstack sudo[87004]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:25 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-8e041650-7c3d-44fc-b55a-1477e55c934f tempest-CreateVolumesFromImageTest-1162996396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 1.398s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:25 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-8e041650-7c3d-44fc-b55a-1477e55c934f tempest-CreateVolumesFromImageTest-1162996396 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:55:25 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-8e041650-7c3d-44fc-b55a-1477e55c934f tempest-CreateVolumesFromImageTest-1162996396 None] Deleted volume successfully.
Apr 15 15:55:25 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-8e041650-7c3d-44fc-b55a-1477e55c934f tempest-CreateVolumesFromImageTest-1162996396 None] Lock "cinder-7a98ac5b-1a78-4505-9cdb-bd61c0175f20-delete_volume" released by "delete_volume" :: held 3.174s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:55:26 devstack sudo[87015]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7e1f21d5-847f-43cd-8592-8d3c3f847327 tempest-GroupsTest-320222849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.803s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:26 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-7e1f21d5-847f-43cd-8592-8d3c3f847327 tempest-GroupsTest-320222849 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:55:26 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-7e1f21d5-847f-43cd-8592-8d3c3f847327 tempest-GroupsTest-320222849 None] Delete group completed successfully.
Apr 15 15:55:26 devstack sudo[87008]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-25a7be81-59be-4dc5-b6aa-9eb9c26359f5" returned: 0 in 1.369s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-25a7be81-59be-4dc5-b6aa-9eb9c26359f5 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:26 devstack sudo[87012]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ed1b60ed-29af-4bb1-ad20-854e4841e6d7 tempest-CreateVolumesFromImageTest-1162996396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3874e5f6-4295-466c-9fb3-5f60c56a2da5" returned: 0 in 1.066s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ed1b60ed-29af-4bb1-ad20-854e4841e6d7 tempest-CreateVolumesFromImageTest-1162996396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3874e5f6-4295-466c-9fb3-5f60c56a2da5 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:26 devstack sudo[87027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3874e5f6-4295-466c-9fb3-5f60c56a2da5
Apr 15 15:55:26 devstack sudo[87027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:26 devstack sudo[87026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-25a7be81-59be-4dc5-b6aa-9eb9c26359f5
Apr 15 15:55:26 devstack sudo[87026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:26 devstack sudo[87027]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ed1b60ed-29af-4bb1-ad20-854e4841e6d7 tempest-CreateVolumesFromImageTest-1162996396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3874e5f6-4295-466c-9fb3-5f60c56a2da5" returned: 0 in 0.569s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:26 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-f0299ea1-1dcb-484e-8cfb-93b39282c43e tempest-GroupsTest-320222849 None] Group tempest-GroupsTest-Group-958441894: creating
Apr 15 15:55:26 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-ed1b60ed-29af-4bb1-ad20-854e4841e6d7 tempest-CreateVolumesFromImageTest-1162996396 None] Lock "cinder-quobyte-3874e5f6-4295-466c-9fb3-5f60c56a2da5" released by "delete_volume" :: held 1.735s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:55:26 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-f0299ea1-1dcb-484e-8cfb-93b39282c43e tempest-GroupsTest-320222849 None] Group tempest-GroupsTest-Group-958441894: created successfully
Apr 15 15:55:26 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-f0299ea1-1dcb-484e-8cfb-93b39282c43e tempest-GroupsTest-320222849 None] Create group completed successfully.
Apr 15 15:55:26 devstack sudo[87026]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-25a7be81-59be-4dc5-b6aa-9eb9c26359f5" returned: 1 in 0.662s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-25a7be81-59be-4dc5-b6aa-9eb9c26359f5' failed. Not Retrying. {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 15:55:26 devstack cinder-volume[82485]: DEBUG cinder.volume.volume_utils [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] Downloaded image 0fe37db8-916e-4521-8f72-73003c13994a ((None, [{'url': 'file:///opt/stack/data/glance/images/0fe37db8-916e-4521-8f72-73003c13994a', 'metadata': {}}])) to volume 25a7be81-59be-4dc5-b6aa-9eb9c26359f5 successfully. {{(pid=82485) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 15 15:55:26 devstack cinder-volume[82485]: DEBUG cinder.image.image_utils [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] Temporary image 0fe37db8-916e-4521-8f72-73003c13994a for user faeaa084b4114dcaa9d16606edca79c0 is deleted. {{(pid=82485) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 15 15:55:26 devstack cinder-volume[82485]: DEBUG cinder.volume.volume_utils [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] Marking volume 25a7be81-59be-4dc5-b6aa-9eb9c26359f5 as bootable. {{(pid=82485) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 15 15:55:26 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-ed1b60ed-29af-4bb1-ad20-854e4841e6d7 tempest-CreateVolumesFromImageTest-1162996396 None] Created reservations ['cb516bc8-b38c-45f4-bde6-fa4726a0d4c3', 'a7358834-4260-4d56-a844-19a9c1835474', '9a4103a7-759f-409d-93f7-4a00162e9ebb', '33859144-5e14-4545-b49b-a36f27c576bb'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:55:26 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] Copying metadata from image 0fe37db8-916e-4521-8f72-73003c13994a to 25a7be81-59be-4dc5-b6aa-9eb9c26359f5. {{(pid=82485) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 15 15:55:26 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] Creating volume glance metadata for volume 25a7be81-59be-4dc5-b6aa-9eb9c26359f5 backed by image 0fe37db8-916e-4521-8f72-73003c13994a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0fe37db8-916e-4521-8f72-73003c13994a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82485) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 15 15:55:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-ed1b60ed-29af-4bb1-ad20-854e4841e6d7 tempest-CreateVolumesFromImageTest-1162996396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:55:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-ed1b60ed-29af-4bb1-ad20-854e4841e6d7 tempest-CreateVolumesFromImageTest-1162996396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:55:26 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-ed1b60ed-29af-4bb1-ad20-854e4841e6d7 tempest-CreateVolumesFromImageTest-1162996396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:55:26 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-ed1b60ed-29af-4bb1-ad20-854e4841e6d7 tempest-CreateVolumesFromImageTest-1162996396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:55:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-ed1b60ed-29af-4bb1-ad20-854e4841e6d7 tempest-CreateVolumesFromImageTest-1162996396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:55:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ed1b60ed-29af-4bb1-ad20-854e4841e6d7 tempest-CreateVolumesFromImageTest-1162996396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:26 devstack sudo[87056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:55:26 devstack sudo[87056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:26 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20c2714a-4105-435e-ab3b-9dd7e46a459a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25a7be81-59be-4dc5-b6aa-9eb9c26359f5', 'volume_size': 1, 'image_id': '0fe37db8-916e-4521-8f72-73003c13994a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0fe37db8-916e-4521-8f72-73003c13994a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '57491fc0e71d4fad9011d017ccefe515', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0fe37db8-916e-4521-8f72-73003c13994a', 'created_at': datetime.datetime(2026, 4, 15, 13, 47, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 13, 47, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0fe37db8-916e-4521-8f72-73003c13994a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f154967faf0>}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:26 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c87c8cd-e202-422e-b6aa-fdebf400d947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:26 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] Volume volume-25a7be81-59be-4dc5-b6aa-9eb9c26359f5 (25a7be81-59be-4dc5-b6aa-9eb9c26359f5): created successfully
Apr 15 15:55:26 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c87c8cd-e202-422e-b6aa-fdebf400d947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:26 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] Flow 'volume_create_manager' (3f2ab0e7-1670-4d54-b6b4-f1d599faeacc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:55:26 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-22f6127e-acf3-48f5-8a0c-fa7733d61a79 tempest-VolumesExtendTest-183948177 None] Created volume successfully.
Apr 15 15:55:27 devstack sudo[87056]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:27 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ed1b60ed-29af-4bb1-ad20-854e4841e6d7 tempest-CreateVolumesFromImageTest-1162996396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.466s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:27 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-ed1b60ed-29af-4bb1-ad20-854e4841e6d7 tempest-CreateVolumesFromImageTest-1162996396 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:55:27 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-ed1b60ed-29af-4bb1-ad20-854e4841e6d7 tempest-CreateVolumesFromImageTest-1162996396 None] Deleted volume successfully.
Apr 15 15:55:27 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-ed1b60ed-29af-4bb1-ad20-854e4841e6d7 tempest-CreateVolumesFromImageTest-1162996396 None] Lock "cinder-3874e5f6-4295-466c-9fb3-5f60c56a2da5-delete_volume" released by "delete_volume" :: held 2.418s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:55:27 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-6724a74e-7744-46c0-b653-449a3f1482a1 tempest-VolumesExtendTest-183948177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:55:27 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-6724a74e-7744-46c0-b653-449a3f1482a1 tempest-VolumesExtendTest-183948177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:55:27 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5da5f07-ab27-4fbc-bc05-fed0b7c8e89e]: (4, 'raw') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:55:27 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6724a74e-7744-46c0-b653-449a3f1482a1 tempest-VolumesExtendTest-183948177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-25a7be81-59be-4dc5-b6aa-9eb9c26359f5 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:28 devstack sudo[87062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-25a7be81-59be-4dc5-b6aa-9eb9c26359f5
Apr 15 15:55:28 devstack sudo[87062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:28 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f642195-eb20-46d3-bf5f-60abb63eb3da tempest-GroupsTest-320222849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:55:28 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-2f642195-eb20-46d3-bf5f-60abb63eb3da tempest-GroupsTest-320222849 None] Flow 'volume_create_manager' (96d2e8d9-5af6-44d9-905c-e7b07c145aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:55:28 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-2f642195-eb20-46d3-bf5f-60abb63eb3da tempest-GroupsTest-320222849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77eb4df6-a828-406b-8dd9-5c3e4d6ed4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:28 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-2f642195-eb20-46d3-bf5f-60abb63eb3da tempest-GroupsTest-320222849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77eb4df6-a828-406b-8dd9-5c3e4d6ed4d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:55:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1946580145',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=108c5f9c-4528-4c30-909f-6aa12af8d7de,host='devstack@QuobyteHD#QuobyteHD',id=da7a5d5a-d5ea-4f4d-97be-c7e2994b132a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53207a6d9ae64ea980a45c9bd54c9a87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:55:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:55:28Z,use_quota=True,user_id='c8753fb68c6842f6ac0e6f639ded812c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f6da522-34ea-4cd8-b657-a1bb9e6afebe),volume_type_id=7f6da522-34ea-4cd8-b657-a1bb9e6afebe)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:28 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-2f642195-eb20-46d3-bf5f-60abb63eb3da tempest-GroupsTest-320222849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9948870e-9518-4ad3-9e2e-d35f0f19a87d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:28 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-2f642195-eb20-46d3-bf5f-60abb63eb3da tempest-GroupsTest-320222849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9948870e-9518-4ad3-9e2e-d35f0f19a87d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:28 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-2f642195-eb20-46d3-bf5f-60abb63eb3da tempest-GroupsTest-320222849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c5f0c6d-ed20-4f93-be16-6cea890135d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:28 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-2f642195-eb20-46d3-bf5f-60abb63eb3da tempest-GroupsTest-320222849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c5f0c6d-ed20-4f93-be16-6cea890135d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da7a5d5a-d5ea-4f4d-97be-c7e2994b132a', 'volume_name': 'volume-da7a5d5a-d5ea-4f4d-97be-c7e2994b132a', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:28 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-2f642195-eb20-46d3-bf5f-60abb63eb3da tempest-GroupsTest-320222849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16ffb03c-f9a9-4084-9ffc-0ff8c0a8e22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:28 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-2f642195-eb20-46d3-bf5f-60abb63eb3da tempest-GroupsTest-320222849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16ffb03c-f9a9-4084-9ffc-0ff8c0a8e22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:28 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-2f642195-eb20-46d3-bf5f-60abb63eb3da tempest-GroupsTest-320222849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cb27a69-0f23-43ce-98a2-b49e0ecd7624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:28 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-2f642195-eb20-46d3-bf5f-60abb63eb3da tempest-GroupsTest-320222849 None] Volume da7a5d5a-d5ea-4f4d-97be-c7e2994b132a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da7a5d5a-d5ea-4f4d-97be-c7e2994b132a', 'volume_size': 1}
Apr 15 15:55:28 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-2f642195-eb20-46d3-bf5f-60abb63eb3da tempest-GroupsTest-320222849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:55:28 devstack sudo[87062]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:28 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6724a74e-7744-46c0-b653-449a3f1482a1 tempest-VolumesExtendTest-183948177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-25a7be81-59be-4dc5-b6aa-9eb9c26359f5" returned: 0 in 0.578s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:28 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6724a74e-7744-46c0-b653-449a3f1482a1 tempest-VolumesExtendTest-183948177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-25a7be81-59be-4dc5-b6aa-9eb9c26359f5 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:28 devstack sudo[87068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-25a7be81-59be-4dc5-b6aa-9eb9c26359f5
Apr 15 15:55:28 devstack sudo[87068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:29 devstack sudo[87068]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:29 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6724a74e-7744-46c0-b653-449a3f1482a1 tempest-VolumesExtendTest-183948177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-25a7be81-59be-4dc5-b6aa-9eb9c26359f5" returned: 1 in 0.461s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:29 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6724a74e-7744-46c0-b653-449a3f1482a1 tempest-VolumesExtendTest-183948177 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-25a7be81-59be-4dc5-b6aa-9eb9c26359f5' failed. Not Retrying. {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 15:55:29 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6724a74e-7744-46c0-b653-449a3f1482a1 tempest-VolumesExtendTest-183948177 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-25a7be81-59be-4dc5-b6aa-9eb9c26359f5 2G {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:29 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6724a74e-7744-46c0-b653-449a3f1482a1 tempest-VolumesExtendTest-183948177 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-25a7be81-59be-4dc5-b6aa-9eb9c26359f5 2G" returned: 0 in 0.042s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:29 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-6724a74e-7744-46c0-b653-449a3f1482a1 tempest-VolumesExtendTest-183948177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.135s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:55:29 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-2f642195-eb20-46d3-bf5f-60abb63eb3da tempest-GroupsTest-320222849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.775s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:55:29 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-2f642195-eb20-46d3-bf5f-60abb63eb3da tempest-GroupsTest-320222849 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=108c5f9c-4528-4c30-909f-6aa12af8d7de,created_at=2026-04-15T13:55:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1946580145',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=108c5f9c-4528-4c30-909f-6aa12af8d7de,host='devstack@QuobyteHD#QuobyteHD',id=da7a5d5a-d5ea-4f4d-97be-c7e2994b132a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53207a6d9ae64ea980a45c9bd54c9a87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:55:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:55:28Z,use_quota=True,user_id='c8753fb68c6842f6ac0e6f639ded812c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f6da522-34ea-4cd8-b657-a1bb9e6afebe),volume_type_id=7f6da522-34ea-4cd8-b657-a1bb9e6afebe)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:55:29 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-2f642195-eb20-46d3-bf5f-60abb63eb3da tempest-GroupsTest-320222849 None] Creating volume da7a5d5a-d5ea-4f4d-97be-c7e2994b132a {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:55:29 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-2f642195-eb20-46d3-bf5f-60abb63eb3da tempest-GroupsTest-320222849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:55:29 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-2f642195-eb20-46d3-bf5f-60abb63eb3da tempest-GroupsTest-320222849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:55:29 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-2f642195-eb20-46d3-bf5f-60abb63eb3da tempest-GroupsTest-320222849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:55:29 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-2f642195-eb20-46d3-bf5f-60abb63eb3da tempest-GroupsTest-320222849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:55:29 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-2f642195-eb20-46d3-bf5f-60abb63eb3da tempest-GroupsTest-320222849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:55:29 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-2f642195-eb20-46d3-bf5f-60abb63eb3da tempest-GroupsTest-320222849 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:55:29 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-2f642195-eb20-46d3-bf5f-60abb63eb3da tempest-GroupsTest-320222849 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:55:29 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-2f642195-eb20-46d3-bf5f-60abb63eb3da tempest-GroupsTest-320222849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-da7a5d5a-d5ea-4f4d-97be-c7e2994b132a 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:29 devstack sudo[87076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-da7a5d5a-d5ea-4f4d-97be-c7e2994b132a 1073741824
Apr 15 15:55:29 devstack sudo[87076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:29 devstack cinder-volume[82485]: INFO cinder.volume.manager [req-ac368407-425b-40ab-96ee-9ab9ea76ecc3 req-846fad9a-0ebc-4263-97d0-264ea99854cf tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Terminate volume connection completed successfully.
Apr 15 15:55:29 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [req-ac368407-425b-40ab-96ee-9ab9ea76ecc3 req-846fad9a-0ebc-4263-97d0-264ea99854cf tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Deleting attachment 876d16b9-b34b-4262-8194-b7a3a471d865. {{(pid=82485) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 15 15:55:29 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-6724a74e-7744-46c0-b653-449a3f1482a1 tempest-VolumesExtendTest-183948177 None] Extend volume completed successfully.
Apr 15 15:55:29 devstack sudo[87076]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:29 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-2f642195-eb20-46d3-bf5f-60abb63eb3da tempest-GroupsTest-320222849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-da7a5d5a-d5ea-4f4d-97be-c7e2994b132a 1073741824" returned: 0 in 0.495s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:29 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-2f642195-eb20-46d3-bf5f-60abb63eb3da tempest-GroupsTest-320222849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-da7a5d5a-d5ea-4f4d-97be-c7e2994b132a {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:29 devstack sudo[87081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-da7a5d5a-d5ea-4f4d-97be-c7e2994b132a
Apr 15 15:55:29 devstack sudo[87081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:29 devstack cinder-volume[82485]: DEBUG cinder.coordination [req-ac368407-425b-40ab-96ee-9ab9ea76ecc3 req-9cf0ff57-ea92-4597-970c-b3daf832729a tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Acquiring lock "cinder-b957df94-c7a9-4bbe-9ebc-d676656906f6-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:55:29 devstack cinder-volume[82485]: DEBUG cinder.coordination [req-ac368407-425b-40ab-96ee-9ab9ea76ecc3 req-9cf0ff57-ea92-4597-970c-b3daf832729a tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Lock "cinder-b957df94-c7a9-4bbe-9ebc-d676656906f6-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:55:29 devstack cinder-volume[82485]: DEBUG cinder.coordination [req-ac368407-425b-40ab-96ee-9ab9ea76ecc3 req-9cf0ff57-ea92-4597-970c-b3daf832729a tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Acquiring lock "cinder-quobyte-b957df94-c7a9-4bbe-9ebc-d676656906f6" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:55:29 devstack cinder-volume[82485]: DEBUG cinder.coordination [req-ac368407-425b-40ab-96ee-9ab9ea76ecc3 req-9cf0ff57-ea92-4597-970c-b3daf832729a tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Lock "cinder-quobyte-b957df94-c7a9-4bbe-9ebc-d676656906f6" acquired by "delete_volume" :: waited 0.010s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:55:29 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d3a588-8907-4d2e-86fa-1b1a3f596b92]: (4, 'raw') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:55:29 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-ac368407-425b-40ab-96ee-9ab9ea76ecc3 req-9cf0ff57-ea92-4597-970c-b3daf832729a tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b957df94-c7a9-4bbe-9ebc-d676656906f6 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:29 devstack sudo[87083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b957df94-c7a9-4bbe-9ebc-d676656906f6
Apr 15 15:55:29 devstack sudo[87083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:30 devstack sudo[87081]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:30 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-2f642195-eb20-46d3-bf5f-60abb63eb3da tempest-GroupsTest-320222849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-da7a5d5a-d5ea-4f4d-97be-c7e2994b132a" returned: 0 in 0.451s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:30 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-2f642195-eb20-46d3-bf5f-60abb63eb3da tempest-GroupsTest-320222849 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:55:30 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-2f642195-eb20-46d3-bf5f-60abb63eb3da tempest-GroupsTest-320222849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:55:30 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-2f642195-eb20-46d3-bf5f-60abb63eb3da tempest-GroupsTest-320222849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cb27a69-0f23-43ce-98a2-b49e0ecd7624) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da7a5d5a-d5ea-4f4d-97be-c7e2994b132a', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:30 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-2f642195-eb20-46d3-bf5f-60abb63eb3da tempest-GroupsTest-320222849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (172f48ed-5884-4462-b862-5b6856916139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:30 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-2f642195-eb20-46d3-bf5f-60abb63eb3da tempest-GroupsTest-320222849 None] Volume volume-da7a5d5a-d5ea-4f4d-97be-c7e2994b132a (da7a5d5a-d5ea-4f4d-97be-c7e2994b132a): created successfully
Apr 15 15:55:30 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-2f642195-eb20-46d3-bf5f-60abb63eb3da tempest-GroupsTest-320222849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (172f48ed-5884-4462-b862-5b6856916139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:30 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-2f642195-eb20-46d3-bf5f-60abb63eb3da tempest-GroupsTest-320222849 None] Flow 'volume_create_manager' (96d2e8d9-5af6-44d9-905c-e7b07c145aaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:55:30 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-2f642195-eb20-46d3-bf5f-60abb63eb3da tempest-GroupsTest-320222849 None] Created volume successfully.
Apr 15 15:55:30 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-3f3688af-9ce7-4c8e-a749-a111df077641 tempest-VolumesExtendTest-183948177 None] Acquiring lock "cinder-25a7be81-59be-4dc5-b6aa-9eb9c26359f5-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:55:30 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-3f3688af-9ce7-4c8e-a749-a111df077641 tempest-VolumesExtendTest-183948177 None] Lock "cinder-25a7be81-59be-4dc5-b6aa-9eb9c26359f5-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:55:30 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-3f3688af-9ce7-4c8e-a749-a111df077641 tempest-VolumesExtendTest-183948177 None] Acquiring lock "cinder-quobyte-25a7be81-59be-4dc5-b6aa-9eb9c26359f5" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:55:30 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-3f3688af-9ce7-4c8e-a749-a111df077641 tempest-VolumesExtendTest-183948177 None] Lock "cinder-quobyte-25a7be81-59be-4dc5-b6aa-9eb9c26359f5" acquired by "delete_volume" :: waited 0.009s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:55:30 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[827590c4-6f00-4ae1-b005-3681d5f507b2]: (4, 'raw') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:55:30 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3f3688af-9ce7-4c8e-a749-a111df077641 tempest-VolumesExtendTest-183948177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-25a7be81-59be-4dc5-b6aa-9eb9c26359f5 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:30 devstack sudo[87083]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:30 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-ac368407-425b-40ab-96ee-9ab9ea76ecc3 req-9cf0ff57-ea92-4597-970c-b3daf832729a tempest-ServerBootFromVolumeStableRescueTest-854633972 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b957df94-c7a9-4bbe-9ebc-d676656906f6" returned: 0 in 0.552s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:30 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-ac368407-425b-40ab-96ee-9ab9ea76ecc3 req-9cf0ff57-ea92-4597-970c-b3daf832729a tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b957df94-c7a9-4bbe-9ebc-d676656906f6 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:30 devstack sudo[87088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-25a7be81-59be-4dc5-b6aa-9eb9c26359f5
Apr 15 15:55:30 devstack sudo[87088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:30 devstack sudo[87089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b957df94-c7a9-4bbe-9ebc-d676656906f6
Apr 15 15:55:30 devstack sudo[87089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:30 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-cafe4d8b-edb3-4557-b6d0-ed2010a68f98 tempest-GroupsTest-320222849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:55:30 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-cafe4d8b-edb3-4557-b6d0-ed2010a68f98 tempest-GroupsTest-320222849 None] Flow 'volume_create_manager' (f1d236ba-3237-45af-8a9f-e90421035117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:55:30 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-cafe4d8b-edb3-4557-b6d0-ed2010a68f98 tempest-GroupsTest-320222849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7bf1bcc-99ec-432b-8216-629cf0f328ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:30 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-cafe4d8b-edb3-4557-b6d0-ed2010a68f98 tempest-GroupsTest-320222849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7bf1bcc-99ec-432b-8216-629cf0f328ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:55:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1583658024',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=108c5f9c-4528-4c30-909f-6aa12af8d7de,host='devstack@QuobyteHD#QuobyteHD',id=b0e7f271-c041-408c-bd26-15409bf147c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53207a6d9ae64ea980a45c9bd54c9a87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:55:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:55:31Z,use_quota=True,user_id='c8753fb68c6842f6ac0e6f639ded812c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f6da522-34ea-4cd8-b657-a1bb9e6afebe),volume_type_id=7f6da522-34ea-4cd8-b657-a1bb9e6afebe)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:30 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-cafe4d8b-edb3-4557-b6d0-ed2010a68f98 tempest-GroupsTest-320222849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79b80bae-a5a7-486b-a2ce-fd96636cf1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:30 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-cafe4d8b-edb3-4557-b6d0-ed2010a68f98 tempest-GroupsTest-320222849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79b80bae-a5a7-486b-a2ce-fd96636cf1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:30 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-cafe4d8b-edb3-4557-b6d0-ed2010a68f98 tempest-GroupsTest-320222849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd2ba409-f11e-4436-a7cb-79bc19b94530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:30 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-cafe4d8b-edb3-4557-b6d0-ed2010a68f98 tempest-GroupsTest-320222849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd2ba409-f11e-4436-a7cb-79bc19b94530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0e7f271-c041-408c-bd26-15409bf147c5', 'volume_name': 'volume-b0e7f271-c041-408c-bd26-15409bf147c5', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:30 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-cafe4d8b-edb3-4557-b6d0-ed2010a68f98 tempest-GroupsTest-320222849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dddcb89a-99ad-4e08-9085-5df63641ed12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:30 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-cafe4d8b-edb3-4557-b6d0-ed2010a68f98 tempest-GroupsTest-320222849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dddcb89a-99ad-4e08-9085-5df63641ed12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:30 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-cafe4d8b-edb3-4557-b6d0-ed2010a68f98 tempest-GroupsTest-320222849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a08958b3-a8dc-4988-9c37-3a4d1d101d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:30 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-cafe4d8b-edb3-4557-b6d0-ed2010a68f98 tempest-GroupsTest-320222849 None] Volume b0e7f271-c041-408c-bd26-15409bf147c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0e7f271-c041-408c-bd26-15409bf147c5', 'volume_size': 1}
Apr 15 15:55:30 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-cafe4d8b-edb3-4557-b6d0-ed2010a68f98 tempest-GroupsTest-320222849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:55:30 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-cafe4d8b-edb3-4557-b6d0-ed2010a68f98 tempest-GroupsTest-320222849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:55:30 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-cafe4d8b-edb3-4557-b6d0-ed2010a68f98 tempest-GroupsTest-320222849 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=108c5f9c-4528-4c30-909f-6aa12af8d7de,created_at=2026-04-15T13:55:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1583658024',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=108c5f9c-4528-4c30-909f-6aa12af8d7de,host='devstack@QuobyteHD#QuobyteHD',id=b0e7f271-c041-408c-bd26-15409bf147c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53207a6d9ae64ea980a45c9bd54c9a87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:55:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:55:31Z,use_quota=True,user_id='c8753fb68c6842f6ac0e6f639ded812c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f6da522-34ea-4cd8-b657-a1bb9e6afebe),volume_type_id=7f6da522-34ea-4cd8-b657-a1bb9e6afebe)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:55:30 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-cafe4d8b-edb3-4557-b6d0-ed2010a68f98 tempest-GroupsTest-320222849 None] Creating volume b0e7f271-c041-408c-bd26-15409bf147c5 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:55:30 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-cafe4d8b-edb3-4557-b6d0-ed2010a68f98 tempest-GroupsTest-320222849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:55:30 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-cafe4d8b-edb3-4557-b6d0-ed2010a68f98 tempest-GroupsTest-320222849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:55:30 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-cafe4d8b-edb3-4557-b6d0-ed2010a68f98 tempest-GroupsTest-320222849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:55:30 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-cafe4d8b-edb3-4557-b6d0-ed2010a68f98 tempest-GroupsTest-320222849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:55:30 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-cafe4d8b-edb3-4557-b6d0-ed2010a68f98 tempest-GroupsTest-320222849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:55:30 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-cafe4d8b-edb3-4557-b6d0-ed2010a68f98 tempest-GroupsTest-320222849 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:55:30 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-cafe4d8b-edb3-4557-b6d0-ed2010a68f98 tempest-GroupsTest-320222849 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:55:30 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-cafe4d8b-edb3-4557-b6d0-ed2010a68f98 tempest-GroupsTest-320222849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b0e7f271-c041-408c-bd26-15409bf147c5 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:30 devstack sudo[87097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b0e7f271-c041-408c-bd26-15409bf147c5 1073741824
Apr 15 15:55:30 devstack sudo[87097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:30 devstack sudo[87089]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:30 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-ac368407-425b-40ab-96ee-9ab9ea76ecc3 req-9cf0ff57-ea92-4597-970c-b3daf832729a tempest-ServerBootFromVolumeStableRescueTest-854633972 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b957df94-c7a9-4bbe-9ebc-d676656906f6" returned: 1 in 0.503s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:30 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-ac368407-425b-40ab-96ee-9ab9ea76ecc3 req-9cf0ff57-ea92-4597-970c-b3daf832729a tempest-ServerBootFromVolumeStableRescueTest-854633972 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b957df94-c7a9-4bbe-9ebc-d676656906f6' failed. Not Retrying. {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 15:55:30 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-ac368407-425b-40ab-96ee-9ab9ea76ecc3 req-9cf0ff57-ea92-4597-970c-b3daf832729a tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b957df94-c7a9-4bbe-9ebc-d676656906f6 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:30 devstack sudo[87099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b957df94-c7a9-4bbe-9ebc-d676656906f6
Apr 15 15:55:30 devstack sudo[87099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:30 devstack sudo[87088]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:30 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3f3688af-9ce7-4c8e-a749-a111df077641 tempest-VolumesExtendTest-183948177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-25a7be81-59be-4dc5-b6aa-9eb9c26359f5" returned: 0 in 0.556s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:30 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3f3688af-9ce7-4c8e-a749-a111df077641 tempest-VolumesExtendTest-183948177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-25a7be81-59be-4dc5-b6aa-9eb9c26359f5 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:30 devstack sudo[87101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-25a7be81-59be-4dc5-b6aa-9eb9c26359f5
Apr 15 15:55:30 devstack sudo[87101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:31 devstack sudo[87099]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:31 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-ac368407-425b-40ab-96ee-9ab9ea76ecc3 req-9cf0ff57-ea92-4597-970c-b3daf832729a tempest-ServerBootFromVolumeStableRescueTest-854633972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b957df94-c7a9-4bbe-9ebc-d676656906f6" returned: 0 in 0.488s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:31 devstack cinder-volume[82485]: DEBUG cinder.coordination [req-ac368407-425b-40ab-96ee-9ab9ea76ecc3 req-9cf0ff57-ea92-4597-970c-b3daf832729a tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Lock "cinder-quobyte-b957df94-c7a9-4bbe-9ebc-d676656906f6" released by "delete_volume" :: held 1.582s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:55:31 devstack sudo[87097]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:31 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-cafe4d8b-edb3-4557-b6d0-ed2010a68f98 tempest-GroupsTest-320222849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b0e7f271-c041-408c-bd26-15409bf147c5 1073741824" returned: 0 in 0.551s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:31 devstack cinder-volume[82485]: DEBUG cinder.quota [req-ac368407-425b-40ab-96ee-9ab9ea76ecc3 req-9cf0ff57-ea92-4597-970c-b3daf832729a tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Created reservations ['e9496a8b-a0e9-41eb-b095-025d07f36ded', '0f1a289d-2f04-4681-b186-71541c3c25ee', '5ef8f108-919e-43b5-83a2-9c6026f8339d', '768041c6-de20-45b0-9285-9b452aaf9718'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:55:31 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-cafe4d8b-edb3-4557-b6d0-ed2010a68f98 tempest-GroupsTest-320222849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b0e7f271-c041-408c-bd26-15409bf147c5 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:31 devstack sudo[87110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b0e7f271-c041-408c-bd26-15409bf147c5
Apr 15 15:55:31 devstack sudo[87110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:31 devstack sudo[87101]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:31 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3f3688af-9ce7-4c8e-a749-a111df077641 tempest-VolumesExtendTest-183948177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-25a7be81-59be-4dc5-b6aa-9eb9c26359f5" returned: 1 in 0.566s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:31 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3f3688af-9ce7-4c8e-a749-a111df077641 tempest-VolumesExtendTest-183948177 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-25a7be81-59be-4dc5-b6aa-9eb9c26359f5' failed. Not Retrying. {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 15:55:31 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3f3688af-9ce7-4c8e-a749-a111df077641 tempest-VolumesExtendTest-183948177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-25a7be81-59be-4dc5-b6aa-9eb9c26359f5 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:31 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [req-ac368407-425b-40ab-96ee-9ab9ea76ecc3 req-9cf0ff57-ea92-4597-970c-b3daf832729a tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:55:31 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [req-ac368407-425b-40ab-96ee-9ab9ea76ecc3 req-9cf0ff57-ea92-4597-970c-b3daf832729a tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:55:31 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [req-ac368407-425b-40ab-96ee-9ab9ea76ecc3 req-9cf0ff57-ea92-4597-970c-b3daf832729a tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:55:31 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [req-ac368407-425b-40ab-96ee-9ab9ea76ecc3 req-9cf0ff57-ea92-4597-970c-b3daf832729a tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:55:31 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [req-ac368407-425b-40ab-96ee-9ab9ea76ecc3 req-9cf0ff57-ea92-4597-970c-b3daf832729a tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:55:31 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-ac368407-425b-40ab-96ee-9ab9ea76ecc3 req-9cf0ff57-ea92-4597-970c-b3daf832729a tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:31 devstack sudo[87112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-25a7be81-59be-4dc5-b6aa-9eb9c26359f5
Apr 15 15:55:31 devstack sudo[87112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:31 devstack sudo[87114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:55:31 devstack sudo[87114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:31 devstack sudo[87110]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:31 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-cafe4d8b-edb3-4557-b6d0-ed2010a68f98 tempest-GroupsTest-320222849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b0e7f271-c041-408c-bd26-15409bf147c5" returned: 0 in 0.440s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:31 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-cafe4d8b-edb3-4557-b6d0-ed2010a68f98 tempest-GroupsTest-320222849 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:55:31 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-cafe4d8b-edb3-4557-b6d0-ed2010a68f98 tempest-GroupsTest-320222849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:55:31 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-cafe4d8b-edb3-4557-b6d0-ed2010a68f98 tempest-GroupsTest-320222849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a08958b3-a8dc-4988-9c37-3a4d1d101d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0e7f271-c041-408c-bd26-15409bf147c5', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:31 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-cafe4d8b-edb3-4557-b6d0-ed2010a68f98 tempest-GroupsTest-320222849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9958710-7530-4a45-89b9-72d0b5f18427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:31 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-cafe4d8b-edb3-4557-b6d0-ed2010a68f98 tempest-GroupsTest-320222849 None] Volume volume-b0e7f271-c041-408c-bd26-15409bf147c5 (b0e7f271-c041-408c-bd26-15409bf147c5): created successfully
Apr 15 15:55:31 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-cafe4d8b-edb3-4557-b6d0-ed2010a68f98 tempest-GroupsTest-320222849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9958710-7530-4a45-89b9-72d0b5f18427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:31 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-cafe4d8b-edb3-4557-b6d0-ed2010a68f98 tempest-GroupsTest-320222849 None] Flow 'volume_create_manager' (f1d236ba-3237-45af-8a9f-e90421035117) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:55:31 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-cafe4d8b-edb3-4557-b6d0-ed2010a68f98 tempest-GroupsTest-320222849 None] Created volume successfully.
Apr 15 15:55:31 devstack sudo[87112]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:31 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3f3688af-9ce7-4c8e-a749-a111df077641 tempest-VolumesExtendTest-183948177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-25a7be81-59be-4dc5-b6aa-9eb9c26359f5" returned: 0 in 0.476s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:31 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-3f3688af-9ce7-4c8e-a749-a111df077641 tempest-VolumesExtendTest-183948177 None] Lock "cinder-quobyte-25a7be81-59be-4dc5-b6aa-9eb9c26359f5" released by "delete_volume" :: held 1.651s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:55:31 devstack sudo[87114]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:31 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-ac368407-425b-40ab-96ee-9ab9ea76ecc3 req-9cf0ff57-ea92-4597-970c-b3daf832729a tempest-ServerBootFromVolumeStableRescueTest-854633972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.483s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:31 devstack cinder-volume[82485]: DEBUG cinder.manager [req-ac368407-425b-40ab-96ee-9ab9ea76ecc3 req-9cf0ff57-ea92-4597-970c-b3daf832729a tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:55:31 devstack cinder-volume[82485]: INFO cinder.volume.manager [req-ac368407-425b-40ab-96ee-9ab9ea76ecc3 req-9cf0ff57-ea92-4597-970c-b3daf832729a tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Deleted volume successfully.
Apr 15 15:55:31 devstack cinder-volume[82485]: DEBUG cinder.coordination [req-ac368407-425b-40ab-96ee-9ab9ea76ecc3 req-9cf0ff57-ea92-4597-970c-b3daf832729a tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Lock "cinder-b957df94-c7a9-4bbe-9ebc-d676656906f6-delete_volume" released by "delete_volume" :: held 2.253s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:55:31 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-3f3688af-9ce7-4c8e-a749-a111df077641 tempest-VolumesExtendTest-183948177 None] Created reservations ['062896c6-17cd-4253-aa7c-a16a3f99dad2', 'd0e87b2a-993f-45ad-a9dd-ab7066975a96', '40ad577b-8e37-442e-9e3b-f3baf0b03f94', '74b96c0a-8195-4742-9390-65475d9fbda8'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:55:32 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-3f3688af-9ce7-4c8e-a749-a111df077641 tempest-VolumesExtendTest-183948177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:55:32 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-3f3688af-9ce7-4c8e-a749-a111df077641 tempest-VolumesExtendTest-183948177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:55:32 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-3f3688af-9ce7-4c8e-a749-a111df077641 tempest-VolumesExtendTest-183948177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:55:32 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-3f3688af-9ce7-4c8e-a749-a111df077641 tempest-VolumesExtendTest-183948177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:55:32 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-3f3688af-9ce7-4c8e-a749-a111df077641 tempest-VolumesExtendTest-183948177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:55:32 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3f3688af-9ce7-4c8e-a749-a111df077641 tempest-VolumesExtendTest-183948177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:32 devstack sudo[87119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:55:32 devstack sudo[87119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:32 devstack sudo[87119]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:32 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3f3688af-9ce7-4c8e-a749-a111df077641 tempest-VolumesExtendTest-183948177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.395s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:32 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-3f3688af-9ce7-4c8e-a749-a111df077641 tempest-VolumesExtendTest-183948177 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:55:32 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-3f3688af-9ce7-4c8e-a749-a111df077641 tempest-VolumesExtendTest-183948177 None] Deleted volume successfully.
Apr 15 15:55:32 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-3f3688af-9ce7-4c8e-a749-a111df077641 tempest-VolumesExtendTest-183948177 None] Lock "cinder-25a7be81-59be-4dc5-b6aa-9eb9c26359f5-delete_volume" released by "delete_volume" :: held 2.223s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:55:32 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-f718f215-73f8-4037-99c8-6d7cd2eef2a2 tempest-VolumesExtendTest-183948177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:55:32 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-f718f215-73f8-4037-99c8-6d7cd2eef2a2 tempest-VolumesExtendTest-183948177 None] Flow 'volume_create_manager' (a8d99022-5239-43b6-a792-bb2059cd510b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:55:32 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-f718f215-73f8-4037-99c8-6d7cd2eef2a2 tempest-VolumesExtendTest-183948177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a5d70b9-2421-4f1f-9aa9-66cd5ddc00b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:32 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-f718f215-73f8-4037-99c8-6d7cd2eef2a2 tempest-VolumesExtendTest-183948177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a5d70b9-2421-4f1f-9aa9-66cd5ddc00b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1394661805',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e26352d3-2116-4f6e-a58e-9449018eb40c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15816a167c8a41c085c5da3afc98cafa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:55:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:55:33Z,use_quota=True,user_id='faeaa084b4114dcaa9d16606edca79c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:32 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-f718f215-73f8-4037-99c8-6d7cd2eef2a2 tempest-VolumesExtendTest-183948177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2089f1b-9ac5-4206-bf84-24e09e970084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:32 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-f718f215-73f8-4037-99c8-6d7cd2eef2a2 tempest-VolumesExtendTest-183948177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2089f1b-9ac5-4206-bf84-24e09e970084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:32 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-f718f215-73f8-4037-99c8-6d7cd2eef2a2 tempest-VolumesExtendTest-183948177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67cef8a8-5eb9-4ef0-a4cc-7a3182b93627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:32 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-f718f215-73f8-4037-99c8-6d7cd2eef2a2 tempest-VolumesExtendTest-183948177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67cef8a8-5eb9-4ef0-a4cc-7a3182b93627) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e26352d3-2116-4f6e-a58e-9449018eb40c', 'volume_name': 'volume-e26352d3-2116-4f6e-a58e-9449018eb40c', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:32 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-f718f215-73f8-4037-99c8-6d7cd2eef2a2 tempest-VolumesExtendTest-183948177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec3a97b3-7883-4618-a027-39bc1e78d9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:32 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-f718f215-73f8-4037-99c8-6d7cd2eef2a2 tempest-VolumesExtendTest-183948177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec3a97b3-7883-4618-a027-39bc1e78d9e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:32 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-f718f215-73f8-4037-99c8-6d7cd2eef2a2 tempest-VolumesExtendTest-183948177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (833cbc29-7ad3-4c40-9634-5c31b77c4fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:32 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-f718f215-73f8-4037-99c8-6d7cd2eef2a2 tempest-VolumesExtendTest-183948177 None] Volume e26352d3-2116-4f6e-a58e-9449018eb40c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e26352d3-2116-4f6e-a58e-9449018eb40c', 'volume_size': 1}
Apr 15 15:55:32 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-f718f215-73f8-4037-99c8-6d7cd2eef2a2 tempest-VolumesExtendTest-183948177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:55:32 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-f718f215-73f8-4037-99c8-6d7cd2eef2a2 tempest-VolumesExtendTest-183948177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:55:32 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-f718f215-73f8-4037-99c8-6d7cd2eef2a2 tempest-VolumesExtendTest-183948177 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1394661805',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e26352d3-2116-4f6e-a58e-9449018eb40c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15816a167c8a41c085c5da3afc98cafa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:55:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:55:33Z,use_quota=True,user_id='faeaa084b4114dcaa9d16606edca79c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:55:32 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-f718f215-73f8-4037-99c8-6d7cd2eef2a2 tempest-VolumesExtendTest-183948177 None] Creating volume e26352d3-2116-4f6e-a58e-9449018eb40c {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:55:32 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-f718f215-73f8-4037-99c8-6d7cd2eef2a2 tempest-VolumesExtendTest-183948177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:55:32 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-f718f215-73f8-4037-99c8-6d7cd2eef2a2 tempest-VolumesExtendTest-183948177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:55:32 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-f718f215-73f8-4037-99c8-6d7cd2eef2a2 tempest-VolumesExtendTest-183948177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:55:32 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-f718f215-73f8-4037-99c8-6d7cd2eef2a2 tempest-VolumesExtendTest-183948177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:55:32 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-f718f215-73f8-4037-99c8-6d7cd2eef2a2 tempest-VolumesExtendTest-183948177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:55:32 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-f718f215-73f8-4037-99c8-6d7cd2eef2a2 tempest-VolumesExtendTest-183948177 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:55:32 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-f718f215-73f8-4037-99c8-6d7cd2eef2a2 tempest-VolumesExtendTest-183948177 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:55:32 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-f718f215-73f8-4037-99c8-6d7cd2eef2a2 tempest-VolumesExtendTest-183948177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e26352d3-2116-4f6e-a58e-9449018eb40c 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:32 devstack sudo[87122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e26352d3-2116-4f6e-a58e-9449018eb40c 1073741824
Apr 15 15:55:32 devstack sudo[87122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:32 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-4f79ab51-06cb-4ec9-9561-c2d3b44e0e7b tempest-GroupsTest-320222849 None] Update group completed successfully.
Apr 15 15:55:33 devstack sudo[87122]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:33 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-f718f215-73f8-4037-99c8-6d7cd2eef2a2 tempest-VolumesExtendTest-183948177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e26352d3-2116-4f6e-a58e-9449018eb40c 1073741824" returned: 0 in 0.563s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:33 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-f718f215-73f8-4037-99c8-6d7cd2eef2a2 tempest-VolumesExtendTest-183948177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e26352d3-2116-4f6e-a58e-9449018eb40c {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:33 devstack sudo[87128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e26352d3-2116-4f6e-a58e-9449018eb40c
Apr 15 15:55:33 devstack sudo[87128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:33 devstack sudo[87128]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:33 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-f718f215-73f8-4037-99c8-6d7cd2eef2a2 tempest-VolumesExtendTest-183948177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e26352d3-2116-4f6e-a58e-9449018eb40c" returned: 0 in 0.438s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:33 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-f718f215-73f8-4037-99c8-6d7cd2eef2a2 tempest-VolumesExtendTest-183948177 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:55:33 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-f718f215-73f8-4037-99c8-6d7cd2eef2a2 tempest-VolumesExtendTest-183948177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:55:33 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-f718f215-73f8-4037-99c8-6d7cd2eef2a2 tempest-VolumesExtendTest-183948177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (833cbc29-7ad3-4c40-9634-5c31b77c4fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e26352d3-2116-4f6e-a58e-9449018eb40c', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:33 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-f718f215-73f8-4037-99c8-6d7cd2eef2a2 tempest-VolumesExtendTest-183948177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa02c28d-fc85-4239-b7ce-217bd90520c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:33 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-f718f215-73f8-4037-99c8-6d7cd2eef2a2 tempest-VolumesExtendTest-183948177 None] Volume volume-e26352d3-2116-4f6e-a58e-9449018eb40c (e26352d3-2116-4f6e-a58e-9449018eb40c): created successfully
Apr 15 15:55:33 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-f718f215-73f8-4037-99c8-6d7cd2eef2a2 tempest-VolumesExtendTest-183948177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa02c28d-fc85-4239-b7ce-217bd90520c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:33 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-f718f215-73f8-4037-99c8-6d7cd2eef2a2 tempest-VolumesExtendTest-183948177 None] Flow 'volume_create_manager' (a8d99022-5239-43b6-a792-bb2059cd510b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:55:33 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-f718f215-73f8-4037-99c8-6d7cd2eef2a2 tempest-VolumesExtendTest-183948177 None] Created volume successfully.
Apr 15 15:55:34 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-8bd4ba7a-210e-4156-b43c-589620061e7a tempest-GroupsTest-320222849 None] Update group completed successfully.
Apr 15 15:55:34 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-337485c5-38e2-45a8-978a-d5c183caf298 tempest-VolumesExtendTest-183948177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:55:34 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-337485c5-38e2-45a8-978a-d5c183caf298 tempest-VolumesExtendTest-183948177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:55:34 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-337485c5-38e2-45a8-978a-d5c183caf298 tempest-VolumesExtendTest-183948177 None] Creating offline snapshot c587b774-3248-4e02-b4b3-8e713a9bd498 of volume e26352d3-2116-4f6e-a58e-9449018eb40c {{(pid=82485) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 15:55:34 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[75867429-b19a-4e9e-a2f5-f6c120b094a7]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:55:34 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-337485c5-38e2-45a8-978a-d5c183caf298 tempest-VolumesExtendTest-183948177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e26352d3-2116-4f6e-a58e-9449018eb40c {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:34 devstack sudo[87163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e26352d3-2116-4f6e-a58e-9449018eb40c
Apr 15 15:55:34 devstack sudo[87163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:35 devstack sudo[87163]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:35 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-337485c5-38e2-45a8-978a-d5c183caf298 tempest-VolumesExtendTest-183948177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e26352d3-2116-4f6e-a58e-9449018eb40c" returned: 0 in 0.520s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:35 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-337485c5-38e2-45a8-978a-d5c183caf298 tempest-VolumesExtendTest-183948177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e26352d3-2116-4f6e-a58e-9449018eb40c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e26352d3-2116-4f6e-a58e-9449018eb40c.c587b774-3248-4e02-b4b3-8e713a9bd498 1G {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:35 devstack sudo[87169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e26352d3-2116-4f6e-a58e-9449018eb40c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e26352d3-2116-4f6e-a58e-9449018eb40c.c587b774-3248-4e02-b4b3-8e713a9bd498 1G
Apr 15 15:55:35 devstack sudo[87169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:35 devstack cinder-volume[82485]: DEBUG dbcounter [-] [82485] Writing DB stats cinder:SELECT=208,cinder:UPDATE=248,cinder:DELETE=16,cinder:INSERT=56 {{(pid=82485) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 15:55:35 devstack cinder-volume[82485]: DEBUG dbcounter [-] [82485] Writing DB stats cinder:SELECT=204,cinder:INSERT=76,cinder:UPDATE=225,cinder:DELETE=14 {{(pid=82485) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 15:55:35 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-9f0d95b8-0423-4bd3-9062-73ecef4d5f23 tempest-GroupsTest-320222849 None] Acquiring lock "cinder-quobyte-b0e7f271-c041-408c-bd26-15409bf147c5" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:55:35 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-9f0d95b8-0423-4bd3-9062-73ecef4d5f23 tempest-GroupsTest-320222849 None] Lock "cinder-quobyte-b0e7f271-c041-408c-bd26-15409bf147c5" acquired by "delete_volume" :: waited 0.024s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:55:35 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b2e5d9-412d-4427-bf35-b04f63e414b0]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:55:35 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9f0d95b8-0423-4bd3-9062-73ecef4d5f23 tempest-GroupsTest-320222849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b0e7f271-c041-408c-bd26-15409bf147c5 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:35 devstack sudo[87171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b0e7f271-c041-408c-bd26-15409bf147c5
Apr 15 15:55:35 devstack sudo[87171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:35 devstack sudo[87169]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:35 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-337485c5-38e2-45a8-978a-d5c183caf298 tempest-VolumesExtendTest-183948177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e26352d3-2116-4f6e-a58e-9449018eb40c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e26352d3-2116-4f6e-a58e-9449018eb40c.c587b774-3248-4e02-b4b3-8e713a9bd498 1G" returned: 0 in 0.574s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:35 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-337485c5-38e2-45a8-978a-d5c183caf298 tempest-VolumesExtendTest-183948177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e26352d3-2116-4f6e-a58e-9449018eb40c -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e26352d3-2116-4f6e-a58e-9449018eb40c.c587b774-3248-4e02-b4b3-8e713a9bd498 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:36 devstack sudo[87177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e26352d3-2116-4f6e-a58e-9449018eb40c -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e26352d3-2116-4f6e-a58e-9449018eb40c.c587b774-3248-4e02-b4b3-8e713a9bd498
Apr 15 15:55:36 devstack sudo[87177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:36 devstack sudo[87171]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:36 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9f0d95b8-0423-4bd3-9062-73ecef4d5f23 tempest-GroupsTest-320222849 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b0e7f271-c041-408c-bd26-15409bf147c5" returned: 0 in 0.503s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:36 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9f0d95b8-0423-4bd3-9062-73ecef4d5f23 tempest-GroupsTest-320222849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b0e7f271-c041-408c-bd26-15409bf147c5 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:36 devstack sudo[87182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b0e7f271-c041-408c-bd26-15409bf147c5
Apr 15 15:55:36 devstack sudo[87182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:36 devstack sudo[87177]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:36 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-337485c5-38e2-45a8-978a-d5c183caf298 tempest-VolumesExtendTest-183948177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e26352d3-2116-4f6e-a58e-9449018eb40c -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e26352d3-2116-4f6e-a58e-9449018eb40c.c587b774-3248-4e02-b4b3-8e713a9bd498" returned: 0 in 0.496s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:36 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-337485c5-38e2-45a8-978a-d5c183caf298 tempest-VolumesExtendTest-183948177 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e26352d3-2116-4f6e-a58e-9449018eb40c.c587b774-3248-4e02-b4b3-8e713a9bd498 is being set with open permissions: ugo+rw
Apr 15 15:55:36 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-337485c5-38e2-45a8-978a-d5c183caf298 tempest-VolumesExtendTest-183948177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e26352d3-2116-4f6e-a58e-9449018eb40c.c587b774-3248-4e02-b4b3-8e713a9bd498 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:36 devstack sudo[87187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e26352d3-2116-4f6e-a58e-9449018eb40c.c587b774-3248-4e02-b4b3-8e713a9bd498
Apr 15 15:55:36 devstack sudo[87187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:36 devstack sudo[87182]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:36 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9f0d95b8-0423-4bd3-9062-73ecef4d5f23 tempest-GroupsTest-320222849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b0e7f271-c041-408c-bd26-15409bf147c5" returned: 0 in 0.418s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:36 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-9f0d95b8-0423-4bd3-9062-73ecef4d5f23 tempest-GroupsTest-320222849 None] Lock "cinder-quobyte-b0e7f271-c041-408c-bd26-15409bf147c5" released by "delete_volume" :: held 0.944s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:55:36 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-9f0d95b8-0423-4bd3-9062-73ecef4d5f23 tempest-GroupsTest-320222849 None] Acquiring lock "cinder-quobyte-da7a5d5a-d5ea-4f4d-97be-c7e2994b132a" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:55:36 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-9f0d95b8-0423-4bd3-9062-73ecef4d5f23 tempest-GroupsTest-320222849 None] Lock "cinder-quobyte-da7a5d5a-d5ea-4f4d-97be-c7e2994b132a" acquired by "delete_volume" :: waited 0.008s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:55:36 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce4061b-5bd4-4264-9f68-9f4eb7d9a952]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:55:36 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9f0d95b8-0423-4bd3-9062-73ecef4d5f23 tempest-GroupsTest-320222849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-da7a5d5a-d5ea-4f4d-97be-c7e2994b132a {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:36 devstack sudo[87190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-da7a5d5a-d5ea-4f4d-97be-c7e2994b132a
Apr 15 15:55:36 devstack sudo[87190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:36 devstack sudo[87187]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:36 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-337485c5-38e2-45a8-978a-d5c183caf298 tempest-VolumesExtendTest-183948177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e26352d3-2116-4f6e-a58e-9449018eb40c.c587b774-3248-4e02-b4b3-8e713a9bd498" returned: 0 in 0.462s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:36 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-337485c5-38e2-45a8-978a-d5c183caf298 tempest-VolumesExtendTest-183948177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e26352d3-2116-4f6e-a58e-9449018eb40c.info {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:36 devstack sudo[87193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e26352d3-2116-4f6e-a58e-9449018eb40c.info
Apr 15 15:55:36 devstack sudo[87193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:37 devstack sudo[87190]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:37 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9f0d95b8-0423-4bd3-9062-73ecef4d5f23 tempest-GroupsTest-320222849 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-da7a5d5a-d5ea-4f4d-97be-c7e2994b132a" returned: 0 in 0.496s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:37 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9f0d95b8-0423-4bd3-9062-73ecef4d5f23 tempest-GroupsTest-320222849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-da7a5d5a-d5ea-4f4d-97be-c7e2994b132a {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:37 devstack sudo[87198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-da7a5d5a-d5ea-4f4d-97be-c7e2994b132a
Apr 15 15:55:37 devstack sudo[87198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:37 devstack sudo[87193]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:37 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-337485c5-38e2-45a8-978a-d5c183caf298 tempest-VolumesExtendTest-183948177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e26352d3-2116-4f6e-a58e-9449018eb40c.info" returned: 0 in 0.434s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:37 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-337485c5-38e2-45a8-978a-d5c183caf298 tempest-VolumesExtendTest-183948177 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e26352d3-2116-4f6e-a58e-9449018eb40c.info is being set with open permissions: ugo+rw
Apr 15 15:55:37 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-337485c5-38e2-45a8-978a-d5c183caf298 tempest-VolumesExtendTest-183948177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e26352d3-2116-4f6e-a58e-9449018eb40c.info {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:37 devstack sudo[87201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e26352d3-2116-4f6e-a58e-9449018eb40c.info
Apr 15 15:55:37 devstack sudo[87201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:37 devstack sudo[87198]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:37 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9f0d95b8-0423-4bd3-9062-73ecef4d5f23 tempest-GroupsTest-320222849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-da7a5d5a-d5ea-4f4d-97be-c7e2994b132a" returned: 0 in 0.431s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:37 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-9f0d95b8-0423-4bd3-9062-73ecef4d5f23 tempest-GroupsTest-320222849 None] Lock "cinder-quobyte-da7a5d5a-d5ea-4f4d-97be-c7e2994b132a" released by "delete_volume" :: held 0.950s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:55:37 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-9f0d95b8-0423-4bd3-9062-73ecef4d5f23 tempest-GroupsTest-320222849 None] Created reservations ['8f64b4c3-b65d-4518-87e7-3cf2dbcdbe21'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:55:37 devstack cinder-volume[82485]: WARNING cinder.quota [None req-9f0d95b8-0423-4bd3-9062-73ecef4d5f23 tempest-GroupsTest-320222849 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-270172176 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-270172176, it is now deprecated. Please use the default quota class for default quota.
Apr 15 15:55:37 devstack cinder-volume[82485]: WARNING cinder.quota [None req-9f0d95b8-0423-4bd3-9062-73ecef4d5f23 tempest-GroupsTest-320222849 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-270172176 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-270172176, it is now deprecated. Please use the default quota class for default quota.
Apr 15 15:55:37 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-9f0d95b8-0423-4bd3-9062-73ecef4d5f23 tempest-GroupsTest-320222849 None] Created reservations ['295a4bc3-e398-407a-94e9-caceb688cbf8', 'ff69f500-9e15-48ed-b9d0-bce97031273a', '1d278f96-d866-4596-9973-51ba779b51c4', '27897f57-1552-4832-a988-593b58a579b4'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:55:37 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-9f0d95b8-0423-4bd3-9062-73ecef4d5f23 tempest-GroupsTest-320222849 None] Created reservations ['f52b26b9-ae2a-469f-95f0-dcf17c4c4a20', '875bb1cc-7db7-4e55-8b0f-0ceec47cd2ea', '3700e53c-2420-4b54-a1c0-a1908eb73b7d', 'c31e5ab9-8b22-44da-9762-462f8ee964a2'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:55:37 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-9f0d95b8-0423-4bd3-9062-73ecef4d5f23 tempest-GroupsTest-320222849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:55:37 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-9f0d95b8-0423-4bd3-9062-73ecef4d5f23 tempest-GroupsTest-320222849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:55:37 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-9f0d95b8-0423-4bd3-9062-73ecef4d5f23 tempest-GroupsTest-320222849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:55:37 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-9f0d95b8-0423-4bd3-9062-73ecef4d5f23 tempest-GroupsTest-320222849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:55:37 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-9f0d95b8-0423-4bd3-9062-73ecef4d5f23 tempest-GroupsTest-320222849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:55:37 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9f0d95b8-0423-4bd3-9062-73ecef4d5f23 tempest-GroupsTest-320222849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:37 devstack sudo[87205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:55:37 devstack sudo[87205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:37 devstack sudo[87201]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:37 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-337485c5-38e2-45a8-978a-d5c183caf298 tempest-VolumesExtendTest-183948177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e26352d3-2116-4f6e-a58e-9449018eb40c.info" returned: 0 in 0.501s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:37 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-337485c5-38e2-45a8-978a-d5c183caf298 tempest-VolumesExtendTest-183948177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.058s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:55:37 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-337485c5-38e2-45a8-978a-d5c183caf298 tempest-VolumesExtendTest-183948177 None] Create snapshot completed successfully
Apr 15 15:55:38 devstack sudo[87205]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:38 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9f0d95b8-0423-4bd3-9062-73ecef4d5f23 tempest-GroupsTest-320222849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.506s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:38 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-9f0d95b8-0423-4bd3-9062-73ecef4d5f23 tempest-GroupsTest-320222849 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:55:38 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-9f0d95b8-0423-4bd3-9062-73ecef4d5f23 tempest-GroupsTest-320222849 None] Delete group completed successfully.
Apr 15 15:55:39 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-e4547da4-2d56-400e-9b01-b2b82d358a41 tempest-VolumesExtendTest-183948177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:55:39 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-e4547da4-2d56-400e-9b01-b2b82d358a41 tempest-VolumesExtendTest-183948177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:55:39 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a99438-061f-408b-a4f1-7fe349262af0]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:55:39 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-e4547da4-2d56-400e-9b01-b2b82d358a41 tempest-VolumesExtendTest-183948177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e26352d3-2116-4f6e-a58e-9449018eb40c {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:39 devstack sudo[87209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e26352d3-2116-4f6e-a58e-9449018eb40c
Apr 15 15:55:39 devstack sudo[87209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:39 devstack sudo[87209]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:39 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-e4547da4-2d56-400e-9b01-b2b82d358a41 tempest-VolumesExtendTest-183948177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e26352d3-2116-4f6e-a58e-9449018eb40c" returned: 0 in 0.599s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:39 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-e4547da4-2d56-400e-9b01-b2b82d358a41 tempest-VolumesExtendTest-183948177 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e26352d3-2116-4f6e-a58e-9449018eb40c.c587b774-3248-4e02-b4b3-8e713a9bd498 2G {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:39 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-e4547da4-2d56-400e-9b01-b2b82d358a41 tempest-VolumesExtendTest-183948177 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e26352d3-2116-4f6e-a58e-9449018eb40c.c587b774-3248-4e02-b4b3-8e713a9bd498 2G" returned: 0 in 0.115s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:39 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-e4547da4-2d56-400e-9b01-b2b82d358a41 tempest-VolumesExtendTest-183948177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.738s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:55:39 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-e4547da4-2d56-400e-9b01-b2b82d358a41 tempest-VolumesExtendTest-183948177 None] Extend volume completed successfully.
Apr 15 15:55:40 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-e64b27ec-d905-43bf-8392-427f54a0ab00 tempest-VolumesExtendTest-183948177 None] Acquiring lock "cinder-c587b774-3248-4e02-b4b3-8e713a9bd498-delete_snapshot" by "delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:55:40 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-e64b27ec-d905-43bf-8392-427f54a0ab00 tempest-VolumesExtendTest-183948177 None] Lock "cinder-c587b774-3248-4e02-b4b3-8e713a9bd498-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:55:40 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-e64b27ec-d905-43bf-8392-427f54a0ab00 tempest-VolumesExtendTest-183948177 None] Acquiring lock "cinder-quobyte-e26352d3-2116-4f6e-a58e-9449018eb40c" by "delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:55:40 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-e64b27ec-d905-43bf-8392-427f54a0ab00 tempest-VolumesExtendTest-183948177 None] Lock "cinder-quobyte-e26352d3-2116-4f6e-a58e-9449018eb40c" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:55:40 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-e64b27ec-d905-43bf-8392-427f54a0ab00 tempest-VolumesExtendTest-183948177 None] Acquiring lock "cinder-quobyte-c587b774-3248-4e02-b4b3-8e713a9bd498" by "_delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:55:40 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-e64b27ec-d905-43bf-8392-427f54a0ab00 tempest-VolumesExtendTest-183948177 None] Lock "cinder-quobyte-c587b774-3248-4e02-b4b3-8e713a9bd498" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:55:40 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-e64b27ec-d905-43bf-8392-427f54a0ab00 tempest-VolumesExtendTest-183948177 None] Deleting offline snapshot c587b774-3248-4e02-b4b3-8e713a9bd498 of volume e26352d3-2116-4f6e-a58e-9449018eb40c {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 15:55:40 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-e64b27ec-d905-43bf-8392-427f54a0ab00 tempest-VolumesExtendTest-183948177 None] snapshot_file for this snap is: volume-e26352d3-2116-4f6e-a58e-9449018eb40c.c587b774-3248-4e02-b4b3-8e713a9bd498 {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 15:55:40 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a77e0f-b42d-4417-84a3-1401e3118b9d]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:55:40 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-e64b27ec-d905-43bf-8392-427f54a0ab00 tempest-VolumesExtendTest-183948177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e26352d3-2116-4f6e-a58e-9449018eb40c.c587b774-3248-4e02-b4b3-8e713a9bd498 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:40 devstack sudo[87272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e26352d3-2116-4f6e-a58e-9449018eb40c.c587b774-3248-4e02-b4b3-8e713a9bd498
Apr 15 15:55:40 devstack sudo[87272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:41 devstack sudo[87272]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:41 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-e64b27ec-d905-43bf-8392-427f54a0ab00 tempest-VolumesExtendTest-183948177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e26352d3-2116-4f6e-a58e-9449018eb40c.c587b774-3248-4e02-b4b3-8e713a9bd498" returned: 0 in 0.642s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:41 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-e64b27ec-d905-43bf-8392-427f54a0ab00 tempest-VolumesExtendTest-183948177 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e26352d3-2116-4f6e-a58e-9449018eb40c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82485) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 15:55:41 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a4790b-4b5c-4b17-b07e-85a22862b297]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:55:41 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-e64b27ec-d905-43bf-8392-427f54a0ab00 tempest-VolumesExtendTest-183948177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e26352d3-2116-4f6e-a58e-9449018eb40c {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:41 devstack sudo[87279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e26352d3-2116-4f6e-a58e-9449018eb40c
Apr 15 15:55:41 devstack sudo[87279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:41 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd487393-7561-4e0d-885a-dce4c61aaa6e tempest-SnapshotsActionsTest-682265405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:55:41 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-bd487393-7561-4e0d-885a-dce4c61aaa6e tempest-SnapshotsActionsTest-682265405 None] Flow 'volume_create_manager' (3c5045e8-ed3a-4fe3-9758-b0973201b177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:55:41 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-bd487393-7561-4e0d-885a-dce4c61aaa6e tempest-SnapshotsActionsTest-682265405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a28bae3-90fb-4c46-8d7d-21230a0ddca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:41 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-bd487393-7561-4e0d-885a-dce4c61aaa6e tempest-SnapshotsActionsTest-682265405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a28bae3-90fb-4c46-8d7d-21230a0ddca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:55:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-639950520',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78b33a64-cdae-492e-abdb-20e2c1f058cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='345c4b76f6fb4b1ea1eb314a5c7bece2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:55:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:55:41Z,use_quota=True,user_id='0fb2b53eac1d40b29e1376f3d59632ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:41 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-bd487393-7561-4e0d-885a-dce4c61aaa6e tempest-SnapshotsActionsTest-682265405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ced955e-47af-48ca-92cf-2e72962134aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:41 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-bd487393-7561-4e0d-885a-dce4c61aaa6e tempest-SnapshotsActionsTest-682265405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ced955e-47af-48ca-92cf-2e72962134aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:41 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-bd487393-7561-4e0d-885a-dce4c61aaa6e tempest-SnapshotsActionsTest-682265405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0750f6f6-f012-469a-b2fe-94aa67e6a7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:41 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-bd487393-7561-4e0d-885a-dce4c61aaa6e tempest-SnapshotsActionsTest-682265405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0750f6f6-f012-469a-b2fe-94aa67e6a7dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78b33a64-cdae-492e-abdb-20e2c1f058cb', 'volume_name': 'volume-78b33a64-cdae-492e-abdb-20e2c1f058cb', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:41 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-bd487393-7561-4e0d-885a-dce4c61aaa6e tempest-SnapshotsActionsTest-682265405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (233222a5-aa66-43b7-ae03-094579c02a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:41 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-bd487393-7561-4e0d-885a-dce4c61aaa6e tempest-SnapshotsActionsTest-682265405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (233222a5-aa66-43b7-ae03-094579c02a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:41 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-bd487393-7561-4e0d-885a-dce4c61aaa6e tempest-SnapshotsActionsTest-682265405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (488f853f-fe0b-405b-89c5-02921c1020b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:41 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-bd487393-7561-4e0d-885a-dce4c61aaa6e tempest-SnapshotsActionsTest-682265405 None] Volume 78b33a64-cdae-492e-abdb-20e2c1f058cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78b33a64-cdae-492e-abdb-20e2c1f058cb', 'volume_size': 1}
Apr 15 15:55:41 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-bd487393-7561-4e0d-885a-dce4c61aaa6e tempest-SnapshotsActionsTest-682265405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:55:41 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-bd487393-7561-4e0d-885a-dce4c61aaa6e tempest-SnapshotsActionsTest-682265405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:55:41 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-bd487393-7561-4e0d-885a-dce4c61aaa6e tempest-SnapshotsActionsTest-682265405 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:55:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-639950520',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78b33a64-cdae-492e-abdb-20e2c1f058cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='345c4b76f6fb4b1ea1eb314a5c7bece2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:55:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:55:41Z,use_quota=True,user_id='0fb2b53eac1d40b29e1376f3d59632ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:55:41 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-bd487393-7561-4e0d-885a-dce4c61aaa6e tempest-SnapshotsActionsTest-682265405 None] Creating volume 78b33a64-cdae-492e-abdb-20e2c1f058cb {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:55:41 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-bd487393-7561-4e0d-885a-dce4c61aaa6e tempest-SnapshotsActionsTest-682265405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:55:41 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-bd487393-7561-4e0d-885a-dce4c61aaa6e tempest-SnapshotsActionsTest-682265405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:55:41 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-bd487393-7561-4e0d-885a-dce4c61aaa6e tempest-SnapshotsActionsTest-682265405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:55:41 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-bd487393-7561-4e0d-885a-dce4c61aaa6e tempest-SnapshotsActionsTest-682265405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:55:41 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-bd487393-7561-4e0d-885a-dce4c61aaa6e tempest-SnapshotsActionsTest-682265405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:55:41 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-bd487393-7561-4e0d-885a-dce4c61aaa6e tempest-SnapshotsActionsTest-682265405 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:55:41 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-bd487393-7561-4e0d-885a-dce4c61aaa6e tempest-SnapshotsActionsTest-682265405 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:55:41 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-bd487393-7561-4e0d-885a-dce4c61aaa6e tempest-SnapshotsActionsTest-682265405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:41 devstack sudo[87281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb 1073741824
Apr 15 15:55:41 devstack sudo[87281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:41 devstack sudo[87279]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:41 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-e64b27ec-d905-43bf-8392-427f54a0ab00 tempest-VolumesExtendTest-183948177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e26352d3-2116-4f6e-a58e-9449018eb40c" returned: 0 in 0.533s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:41 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-e64b27ec-d905-43bf-8392-427f54a0ab00 tempest-VolumesExtendTest-183948177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e26352d3-2116-4f6e-a58e-9449018eb40c.c587b774-3248-4e02-b4b3-8e713a9bd498 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:41 devstack sudo[87287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e26352d3-2116-4f6e-a58e-9449018eb40c.c587b774-3248-4e02-b4b3-8e713a9bd498
Apr 15 15:55:41 devstack sudo[87287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:41 devstack sudo[87281]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:41 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-bd487393-7561-4e0d-885a-dce4c61aaa6e tempest-SnapshotsActionsTest-682265405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb 1073741824" returned: 0 in 0.626s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:42 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-bd487393-7561-4e0d-885a-dce4c61aaa6e tempest-SnapshotsActionsTest-682265405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:42 devstack sudo[87293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb
Apr 15 15:55:42 devstack sudo[87293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:42 devstack sudo[87287]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:42 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-e64b27ec-d905-43bf-8392-427f54a0ab00 tempest-VolumesExtendTest-183948177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e26352d3-2116-4f6e-a58e-9449018eb40c.c587b774-3248-4e02-b4b3-8e713a9bd498" returned: 0 in 0.553s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:42 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-e64b27ec-d905-43bf-8392-427f54a0ab00 tempest-VolumesExtendTest-183948177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e26352d3-2116-4f6e-a58e-9449018eb40c.c587b774-3248-4e02-b4b3-8e713a9bd498 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:42 devstack sudo[87298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e26352d3-2116-4f6e-a58e-9449018eb40c.c587b774-3248-4e02-b4b3-8e713a9bd498
Apr 15 15:55:42 devstack sudo[87298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:42 devstack sudo[87293]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:42 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-bd487393-7561-4e0d-885a-dce4c61aaa6e tempest-SnapshotsActionsTest-682265405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb" returned: 0 in 0.431s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:42 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-bd487393-7561-4e0d-885a-dce4c61aaa6e tempest-SnapshotsActionsTest-682265405 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:55:42 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-bd487393-7561-4e0d-885a-dce4c61aaa6e tempest-SnapshotsActionsTest-682265405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:55:42 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-bd487393-7561-4e0d-885a-dce4c61aaa6e tempest-SnapshotsActionsTest-682265405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (488f853f-fe0b-405b-89c5-02921c1020b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78b33a64-cdae-492e-abdb-20e2c1f058cb', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:42 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-bd487393-7561-4e0d-885a-dce4c61aaa6e tempest-SnapshotsActionsTest-682265405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9c412c6-5622-4ef2-b7fd-84d348004b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:42 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-bd487393-7561-4e0d-885a-dce4c61aaa6e tempest-SnapshotsActionsTest-682265405 None] Volume volume-78b33a64-cdae-492e-abdb-20e2c1f058cb (78b33a64-cdae-492e-abdb-20e2c1f058cb): created successfully
Apr 15 15:55:42 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-bd487393-7561-4e0d-885a-dce4c61aaa6e tempest-SnapshotsActionsTest-682265405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9c412c6-5622-4ef2-b7fd-84d348004b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:42 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-bd487393-7561-4e0d-885a-dce4c61aaa6e tempest-SnapshotsActionsTest-682265405 None] Flow 'volume_create_manager' (3c5045e8-ed3a-4fe3-9758-b0973201b177) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:55:42 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-bd487393-7561-4e0d-885a-dce4c61aaa6e tempest-SnapshotsActionsTest-682265405 None] Created volume successfully.
Apr 15 15:55:42 devstack sudo[87298]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:42 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-e64b27ec-d905-43bf-8392-427f54a0ab00 tempest-VolumesExtendTest-183948177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e26352d3-2116-4f6e-a58e-9449018eb40c.c587b774-3248-4e02-b4b3-8e713a9bd498" returned: 0 in 0.449s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:42 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-e64b27ec-d905-43bf-8392-427f54a0ab00 tempest-VolumesExtendTest-183948177 None] Lock "cinder-quobyte-c587b774-3248-4e02-b4b3-8e713a9bd498" released by "_delete_snapshot" :: held 2.245s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:55:42 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-e64b27ec-d905-43bf-8392-427f54a0ab00 tempest-VolumesExtendTest-183948177 None] Lock "cinder-quobyte-e26352d3-2116-4f6e-a58e-9449018eb40c" released by "delete_snapshot" :: held 2.267s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:55:42 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-e64b27ec-d905-43bf-8392-427f54a0ab00 tempest-VolumesExtendTest-183948177 None] Created reservations ['2fe43f07-78a5-4c7d-8a49-a1a907fc4ec6', '3aedd47b-f18b-4722-9692-b909e6588e71', '56250cc2-e6a7-45e6-ba67-bb58b945ab37', 'a7bc014f-3c34-4a34-b0e8-a85be0a3c6ae'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:55:42 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-e64b27ec-d905-43bf-8392-427f54a0ab00 tempest-VolumesExtendTest-183948177 None] Delete snapshot completed successfully.
Apr 15 15:55:42 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-e64b27ec-d905-43bf-8392-427f54a0ab00 tempest-VolumesExtendTest-183948177 None] Lock "cinder-c587b774-3248-4e02-b4b3-8e713a9bd498-delete_snapshot" released by "delete_snapshot" :: held 2.369s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:55:42 devstack cinder-volume[82485]: INFO cinder.volume.manager [req-e9e43266-c6b7-4795-9bfb-6f23136ba869 req-b0a14ee1-7aa3-4769-bbab-ccf35e1750dc tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Terminate volume connection completed successfully.
Apr 15 15:55:42 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [req-e9e43266-c6b7-4795-9bfb-6f23136ba869 req-b0a14ee1-7aa3-4769-bbab-ccf35e1750dc tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Deleting attachment ad3683ef-30b1-43dc-8fd6-19f6f22c4f56. {{(pid=82485) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 15 15:55:43 devstack cinder-volume[82485]: DEBUG cinder.coordination [req-e9e43266-c6b7-4795-9bfb-6f23136ba869 req-89ae6ec0-1c0e-418c-8516-687fbfd082ba tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Acquiring lock "cinder-f20b67de-38f0-4b05-8963-b4a4123aa132-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:55:43 devstack cinder-volume[82485]: DEBUG cinder.coordination [req-e9e43266-c6b7-4795-9bfb-6f23136ba869 req-89ae6ec0-1c0e-418c-8516-687fbfd082ba tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Lock "cinder-f20b67de-38f0-4b05-8963-b4a4123aa132-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:55:43 devstack cinder-volume[82485]: DEBUG cinder.coordination [req-e9e43266-c6b7-4795-9bfb-6f23136ba869 req-89ae6ec0-1c0e-418c-8516-687fbfd082ba tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Acquiring lock "cinder-quobyte-f20b67de-38f0-4b05-8963-b4a4123aa132" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:55:43 devstack cinder-volume[82485]: DEBUG cinder.coordination [req-e9e43266-c6b7-4795-9bfb-6f23136ba869 req-89ae6ec0-1c0e-418c-8516-687fbfd082ba tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Lock "cinder-quobyte-f20b67de-38f0-4b05-8963-b4a4123aa132" acquired by "delete_volume" :: waited 0.009s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:55:43 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2074ea-8660-4787-863c-8a92d080e416]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:55:43 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-e9e43266-c6b7-4795-9bfb-6f23136ba869 req-89ae6ec0-1c0e-418c-8516-687fbfd082ba tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f20b67de-38f0-4b05-8963-b4a4123aa132 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:43 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-d8d18b91-0c65-4178-83e8-0b5396520848 tempest-SnapshotsActionsTest-682265405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:55:43 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-d8d18b91-0c65-4178-83e8-0b5396520848 tempest-SnapshotsActionsTest-682265405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:55:43 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-d8d18b91-0c65-4178-83e8-0b5396520848 tempest-SnapshotsActionsTest-682265405 None] Creating offline snapshot adf07162-bf97-4787-8d3f-0baa4bcd5051 of volume 78b33a64-cdae-492e-abdb-20e2c1f058cb {{(pid=82485) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 15:55:43 devstack sudo[87302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f20b67de-38f0-4b05-8963-b4a4123aa132
Apr 15 15:55:43 devstack sudo[87302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:43 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[612da913-09cd-4bd1-9ed8-7b2f1a32bc54]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:55:43 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-d8d18b91-0c65-4178-83e8-0b5396520848 tempest-SnapshotsActionsTest-682265405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:43 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-d9f669ad-6160-47bc-b961-2c6cf1a28e89 tempest-VolumesExtendTest-183948177 None] Acquiring lock "cinder-e26352d3-2116-4f6e-a58e-9449018eb40c-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:55:43 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-d9f669ad-6160-47bc-b961-2c6cf1a28e89 tempest-VolumesExtendTest-183948177 None] Lock "cinder-e26352d3-2116-4f6e-a58e-9449018eb40c-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:55:43 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-d9f669ad-6160-47bc-b961-2c6cf1a28e89 tempest-VolumesExtendTest-183948177 None] Acquiring lock "cinder-quobyte-e26352d3-2116-4f6e-a58e-9449018eb40c" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:55:43 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-d9f669ad-6160-47bc-b961-2c6cf1a28e89 tempest-VolumesExtendTest-183948177 None] Lock "cinder-quobyte-e26352d3-2116-4f6e-a58e-9449018eb40c" acquired by "delete_volume" :: waited 0.007s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:55:43 devstack sudo[87304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb
Apr 15 15:55:43 devstack sudo[87304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:43 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a74287-787d-4802-9853-e02ac0750c41]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:55:43 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-d9f669ad-6160-47bc-b961-2c6cf1a28e89 tempest-VolumesExtendTest-183948177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e26352d3-2116-4f6e-a58e-9449018eb40c {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:43 devstack sudo[87306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e26352d3-2116-4f6e-a58e-9449018eb40c
Apr 15 15:55:43 devstack sudo[87306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:44 devstack sudo[87302]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-e9e43266-c6b7-4795-9bfb-6f23136ba869 req-89ae6ec0-1c0e-418c-8516-687fbfd082ba tempest-ServerBootFromVolumeStableRescueTest-854633972 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f20b67de-38f0-4b05-8963-b4a4123aa132" returned: 0 in 0.570s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-e9e43266-c6b7-4795-9bfb-6f23136ba869 req-89ae6ec0-1c0e-418c-8516-687fbfd082ba tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f20b67de-38f0-4b05-8963-b4a4123aa132 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:44 devstack sudo[87314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f20b67de-38f0-4b05-8963-b4a4123aa132
Apr 15 15:55:44 devstack sudo[87314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:44 devstack sudo[87304]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-d8d18b91-0c65-4178-83e8-0b5396520848 tempest-SnapshotsActionsTest-682265405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb" returned: 0 in 0.501s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-d8d18b91-0c65-4178-83e8-0b5396520848 tempest-SnapshotsActionsTest-682265405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.adf07162-bf97-4787-8d3f-0baa4bcd5051 1G {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:44 devstack sudo[87316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.adf07162-bf97-4787-8d3f-0baa4bcd5051 1G
Apr 15 15:55:44 devstack sudo[87316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:44 devstack sudo[87306]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-d9f669ad-6160-47bc-b961-2c6cf1a28e89 tempest-VolumesExtendTest-183948177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e26352d3-2116-4f6e-a58e-9449018eb40c" returned: 0 in 0.538s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-d9f669ad-6160-47bc-b961-2c6cf1a28e89 tempest-VolumesExtendTest-183948177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e26352d3-2116-4f6e-a58e-9449018eb40c {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:44 devstack sudo[87321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e26352d3-2116-4f6e-a58e-9449018eb40c
Apr 15 15:55:44 devstack sudo[87321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:44 devstack cinder-volume[82485]: DEBUG oslo_service.periodic_task [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82485) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 15 15:55:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:55:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:55:44 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:55:44 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:55:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:55:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:44 devstack sudo[87324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:55:44 devstack sudo[87324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:44 devstack sudo[87314]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-e9e43266-c6b7-4795-9bfb-6f23136ba869 req-89ae6ec0-1c0e-418c-8516-687fbfd082ba tempest-ServerBootFromVolumeStableRescueTest-854633972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f20b67de-38f0-4b05-8963-b4a4123aa132" returned: 0 in 0.446s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:44 devstack cinder-volume[82485]: DEBUG cinder.coordination [req-e9e43266-c6b7-4795-9bfb-6f23136ba869 req-89ae6ec0-1c0e-418c-8516-687fbfd082ba tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Lock "cinder-quobyte-f20b67de-38f0-4b05-8963-b4a4123aa132" released by "delete_volume" :: held 1.045s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:55:44 devstack cinder-volume[82485]: DEBUG cinder.quota [req-e9e43266-c6b7-4795-9bfb-6f23136ba869 req-89ae6ec0-1c0e-418c-8516-687fbfd082ba tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Created reservations ['0f2b413e-aa1a-461d-9b5b-cc6b4a346071', 'b422920a-fa7e-4651-9953-49e605614e9d', '476a27eb-3b4f-4542-bb6f-59b2284b85b0', 'a8b636f5-db3d-4d4a-905d-99156c6d43c2'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:55:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [req-e9e43266-c6b7-4795-9bfb-6f23136ba869 req-89ae6ec0-1c0e-418c-8516-687fbfd082ba tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:55:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [req-e9e43266-c6b7-4795-9bfb-6f23136ba869 req-89ae6ec0-1c0e-418c-8516-687fbfd082ba tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:55:44 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [req-e9e43266-c6b7-4795-9bfb-6f23136ba869 req-89ae6ec0-1c0e-418c-8516-687fbfd082ba tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:55:44 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [req-e9e43266-c6b7-4795-9bfb-6f23136ba869 req-89ae6ec0-1c0e-418c-8516-687fbfd082ba tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:55:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [req-e9e43266-c6b7-4795-9bfb-6f23136ba869 req-89ae6ec0-1c0e-418c-8516-687fbfd082ba tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:55:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-e9e43266-c6b7-4795-9bfb-6f23136ba869 req-89ae6ec0-1c0e-418c-8516-687fbfd082ba tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:44 devstack sudo[87331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:55:44 devstack sudo[87331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:44 devstack sudo[87316]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-d8d18b91-0c65-4178-83e8-0b5396520848 tempest-SnapshotsActionsTest-682265405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.adf07162-bf97-4787-8d3f-0baa4bcd5051 1G" returned: 0 in 0.561s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-d8d18b91-0c65-4178-83e8-0b5396520848 tempest-SnapshotsActionsTest-682265405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78b33a64-cdae-492e-abdb-20e2c1f058cb -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.adf07162-bf97-4787-8d3f-0baa4bcd5051 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:44 devstack sudo[87333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78b33a64-cdae-492e-abdb-20e2c1f058cb -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.adf07162-bf97-4787-8d3f-0baa4bcd5051
Apr 15 15:55:44 devstack sudo[87333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:44 devstack sudo[87321]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-d9f669ad-6160-47bc-b961-2c6cf1a28e89 tempest-VolumesExtendTest-183948177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e26352d3-2116-4f6e-a58e-9449018eb40c" returned: 0 in 0.464s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:44 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-d9f669ad-6160-47bc-b961-2c6cf1a28e89 tempest-VolumesExtendTest-183948177 None] Lock "cinder-quobyte-e26352d3-2116-4f6e-a58e-9449018eb40c" released by "delete_volume" :: held 1.032s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:55:44 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-d9f669ad-6160-47bc-b961-2c6cf1a28e89 tempest-VolumesExtendTest-183948177 None] Created reservations ['6d99d810-adb7-4b9a-8150-a6f424f77d7f', 'dde0d88e-5d3e-447f-8b72-b3ba14de53c4', 'def069e5-b123-479e-a8a0-9b15e16c6f91', 'fc116df2-48fd-4f14-a881-f5515cc19ef2'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:55:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-d9f669ad-6160-47bc-b961-2c6cf1a28e89 tempest-VolumesExtendTest-183948177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:55:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-d9f669ad-6160-47bc-b961-2c6cf1a28e89 tempest-VolumesExtendTest-183948177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:55:44 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-d9f669ad-6160-47bc-b961-2c6cf1a28e89 tempest-VolumesExtendTest-183948177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:55:44 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-d9f669ad-6160-47bc-b961-2c6cf1a28e89 tempest-VolumesExtendTest-183948177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:55:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-d9f669ad-6160-47bc-b961-2c6cf1a28e89 tempest-VolumesExtendTest-183948177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:55:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-d9f669ad-6160-47bc-b961-2c6cf1a28e89 tempest-VolumesExtendTest-183948177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:44 devstack sudo[87335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:55:44 devstack sudo[87335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:44 devstack sudo[87324]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.490s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:44 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:55:45 devstack sudo[87331]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:45 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-e9e43266-c6b7-4795-9bfb-6f23136ba869 req-89ae6ec0-1c0e-418c-8516-687fbfd082ba tempest-ServerBootFromVolumeStableRescueTest-854633972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.440s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:45 devstack cinder-volume[82485]: DEBUG cinder.manager [req-e9e43266-c6b7-4795-9bfb-6f23136ba869 req-89ae6ec0-1c0e-418c-8516-687fbfd082ba tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:55:45 devstack cinder-volume[82485]: INFO cinder.volume.manager [req-e9e43266-c6b7-4795-9bfb-6f23136ba869 req-89ae6ec0-1c0e-418c-8516-687fbfd082ba tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Deleted volume successfully.
Apr 15 15:55:45 devstack cinder-volume[82485]: DEBUG cinder.coordination [req-e9e43266-c6b7-4795-9bfb-6f23136ba869 req-89ae6ec0-1c0e-418c-8516-687fbfd082ba tempest-ServerBootFromVolumeStableRescueTest-854633972 None] Lock "cinder-f20b67de-38f0-4b05-8963-b4a4123aa132-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:55:45 devstack sudo[87333]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:45 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-d8d18b91-0c65-4178-83e8-0b5396520848 tempest-SnapshotsActionsTest-682265405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78b33a64-cdae-492e-abdb-20e2c1f058cb -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.adf07162-bf97-4787-8d3f-0baa4bcd5051" returned: 0 in 0.504s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:45 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-d8d18b91-0c65-4178-83e8-0b5396520848 tempest-SnapshotsActionsTest-682265405 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.adf07162-bf97-4787-8d3f-0baa4bcd5051 is being set with open permissions: ugo+rw
Apr 15 15:55:45 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-d8d18b91-0c65-4178-83e8-0b5396520848 tempest-SnapshotsActionsTest-682265405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.adf07162-bf97-4787-8d3f-0baa4bcd5051 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:45 devstack sudo[87343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.adf07162-bf97-4787-8d3f-0baa4bcd5051
Apr 15 15:55:45 devstack sudo[87343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:45 devstack sudo[87335]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:45 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-d9f669ad-6160-47bc-b961-2c6cf1a28e89 tempest-VolumesExtendTest-183948177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.488s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:45 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-d9f669ad-6160-47bc-b961-2c6cf1a28e89 tempest-VolumesExtendTest-183948177 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:55:45 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-d9f669ad-6160-47bc-b961-2c6cf1a28e89 tempest-VolumesExtendTest-183948177 None] Deleted volume successfully.
Apr 15 15:55:45 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-d9f669ad-6160-47bc-b961-2c6cf1a28e89 tempest-VolumesExtendTest-183948177 None] Lock "cinder-e26352d3-2116-4f6e-a58e-9449018eb40c-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:55:45 devstack sudo[87343]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:45 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-d8d18b91-0c65-4178-83e8-0b5396520848 tempest-SnapshotsActionsTest-682265405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.adf07162-bf97-4787-8d3f-0baa4bcd5051" returned: 0 in 0.426s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:45 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-d8d18b91-0c65-4178-83e8-0b5396520848 tempest-SnapshotsActionsTest-682265405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.info {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:45 devstack sudo[87346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.info
Apr 15 15:55:45 devstack sudo[87346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:46 devstack sudo[87346]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:46 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-d8d18b91-0c65-4178-83e8-0b5396520848 tempest-SnapshotsActionsTest-682265405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.info" returned: 0 in 0.448s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:46 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-d8d18b91-0c65-4178-83e8-0b5396520848 tempest-SnapshotsActionsTest-682265405 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.info is being set with open permissions: ugo+rw
Apr 15 15:55:46 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-d8d18b91-0c65-4178-83e8-0b5396520848 tempest-SnapshotsActionsTest-682265405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.info {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:46 devstack sudo[87349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.info
Apr 15 15:55:46 devstack sudo[87349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:46 devstack sudo[87349]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:46 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-d8d18b91-0c65-4178-83e8-0b5396520848 tempest-SnapshotsActionsTest-682265405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.info" returned: 0 in 0.549s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:46 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-d8d18b91-0c65-4178-83e8-0b5396520848 tempest-SnapshotsActionsTest-682265405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.072s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:55:46 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-d8d18b91-0c65-4178-83e8-0b5396520848 tempest-SnapshotsActionsTest-682265405 None] Create snapshot completed successfully
Apr 15 15:55:47 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e44abc6-f2b4-490e-b1d6-34e6a2279e52 tempest-VolumesListTestJSON-80669442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:55:47 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7e44abc6-f2b4-490e-b1d6-34e6a2279e52 tempest-VolumesListTestJSON-80669442 None] Flow 'volume_create_manager' (d9ebe042-c85f-43ca-8748-fedf6fb61668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:55:47 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7e44abc6-f2b4-490e-b1d6-34e6a2279e52 tempest-VolumesListTestJSON-80669442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fa46391-b233-417a-a63c-479f2d393319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:47 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7e44abc6-f2b4-490e-b1d6-34e6a2279e52 tempest-VolumesListTestJSON-80669442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fa46391-b233-417a-a63c-479f2d393319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:55:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-346267143',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=feeaa5cc-bbe6-4f7a-b93c-7f9cb9b6f4f2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='faa873051f094d3fa1b771e7e10551ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:55:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:55:47Z,use_quota=True,user_id='d9bb7107bae24afeac0edc0681e4513d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:47 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7e44abc6-f2b4-490e-b1d6-34e6a2279e52 tempest-VolumesListTestJSON-80669442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c67f981a-644c-4fdd-8a28-93d5f3011d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:47 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7e44abc6-f2b4-490e-b1d6-34e6a2279e52 tempest-VolumesListTestJSON-80669442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c67f981a-644c-4fdd-8a28-93d5f3011d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:47 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7e44abc6-f2b4-490e-b1d6-34e6a2279e52 tempest-VolumesListTestJSON-80669442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a732e93-2577-4d88-99fc-38084ad1959a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:47 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7e44abc6-f2b4-490e-b1d6-34e6a2279e52 tempest-VolumesListTestJSON-80669442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a732e93-2577-4d88-99fc-38084ad1959a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'feeaa5cc-bbe6-4f7a-b93c-7f9cb9b6f4f2', 'volume_name': 'volume-feeaa5cc-bbe6-4f7a-b93c-7f9cb9b6f4f2', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:47 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7e44abc6-f2b4-490e-b1d6-34e6a2279e52 tempest-VolumesListTestJSON-80669442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (725f0dc5-ef1c-4338-8db2-2e3456d80795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:47 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7e44abc6-f2b4-490e-b1d6-34e6a2279e52 tempest-VolumesListTestJSON-80669442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (725f0dc5-ef1c-4338-8db2-2e3456d80795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:47 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7e44abc6-f2b4-490e-b1d6-34e6a2279e52 tempest-VolumesListTestJSON-80669442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59a6c8e5-b847-4d57-8644-61cfd884a4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:47 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-7e44abc6-f2b4-490e-b1d6-34e6a2279e52 tempest-VolumesListTestJSON-80669442 None] Volume feeaa5cc-bbe6-4f7a-b93c-7f9cb9b6f4f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-feeaa5cc-bbe6-4f7a-b93c-7f9cb9b6f4f2', 'volume_size': 1}
Apr 15 15:55:47 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7e44abc6-f2b4-490e-b1d6-34e6a2279e52 tempest-VolumesListTestJSON-80669442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:55:47 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7e44abc6-f2b4-490e-b1d6-34e6a2279e52 tempest-VolumesListTestJSON-80669442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:55:47 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-7e44abc6-f2b4-490e-b1d6-34e6a2279e52 tempest-VolumesListTestJSON-80669442 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:55:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-346267143',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=feeaa5cc-bbe6-4f7a-b93c-7f9cb9b6f4f2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='faa873051f094d3fa1b771e7e10551ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:55:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:55:47Z,use_quota=True,user_id='d9bb7107bae24afeac0edc0681e4513d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:55:47 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-7e44abc6-f2b4-490e-b1d6-34e6a2279e52 tempest-VolumesListTestJSON-80669442 None] Creating volume feeaa5cc-bbe6-4f7a-b93c-7f9cb9b6f4f2 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:55:47 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7e44abc6-f2b4-490e-b1d6-34e6a2279e52 tempest-VolumesListTestJSON-80669442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:55:47 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7e44abc6-f2b4-490e-b1d6-34e6a2279e52 tempest-VolumesListTestJSON-80669442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:55:47 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-7e44abc6-f2b4-490e-b1d6-34e6a2279e52 tempest-VolumesListTestJSON-80669442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:55:47 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-7e44abc6-f2b4-490e-b1d6-34e6a2279e52 tempest-VolumesListTestJSON-80669442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:55:47 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7e44abc6-f2b4-490e-b1d6-34e6a2279e52 tempest-VolumesListTestJSON-80669442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:55:47 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-7e44abc6-f2b4-490e-b1d6-34e6a2279e52 tempest-VolumesListTestJSON-80669442 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:55:47 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-7e44abc6-f2b4-490e-b1d6-34e6a2279e52 tempest-VolumesListTestJSON-80669442 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:55:47 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7e44abc6-f2b4-490e-b1d6-34e6a2279e52 tempest-VolumesListTestJSON-80669442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-feeaa5cc-bbe6-4f7a-b93c-7f9cb9b6f4f2 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:47 devstack sudo[87353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-feeaa5cc-bbe6-4f7a-b93c-7f9cb9b6f4f2 1073741824
Apr 15 15:55:47 devstack sudo[87353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:48 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-adf63b5a-5658-4da2-a201-5d574424e687 tempest-SnapshotsActionsTest-682265405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:55:48 devstack sudo[87353]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:48 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7e44abc6-f2b4-490e-b1d6-34e6a2279e52 tempest-VolumesListTestJSON-80669442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-feeaa5cc-bbe6-4f7a-b93c-7f9cb9b6f4f2 1073741824" returned: 0 in 0.671s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:48 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7e44abc6-f2b4-490e-b1d6-34e6a2279e52 tempest-VolumesListTestJSON-80669442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-feeaa5cc-bbe6-4f7a-b93c-7f9cb9b6f4f2 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:48 devstack sudo[87385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-feeaa5cc-bbe6-4f7a-b93c-7f9cb9b6f4f2
Apr 15 15:55:48 devstack sudo[87385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:48 devstack sudo[87385]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:48 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7e44abc6-f2b4-490e-b1d6-34e6a2279e52 tempest-VolumesListTestJSON-80669442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-feeaa5cc-bbe6-4f7a-b93c-7f9cb9b6f4f2" returned: 0 in 0.454s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:48 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-7e44abc6-f2b4-490e-b1d6-34e6a2279e52 tempest-VolumesListTestJSON-80669442 None] <== create_volume: return (1149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:55:48 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7e44abc6-f2b4-490e-b1d6-34e6a2279e52 tempest-VolumesListTestJSON-80669442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.151s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:55:48 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-adf63b5a-5658-4da2-a201-5d574424e687 tempest-SnapshotsActionsTest-682265405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.533s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:55:48 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-adf63b5a-5658-4da2-a201-5d574424e687 tempest-SnapshotsActionsTest-682265405 None] Creating offline snapshot ce21782a-1cd8-4218-94b6-01d7a8bc9839 of volume 78b33a64-cdae-492e-abdb-20e2c1f058cb {{(pid=82485) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 15:55:48 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7e44abc6-f2b4-490e-b1d6-34e6a2279e52 tempest-VolumesListTestJSON-80669442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59a6c8e5-b847-4d57-8644-61cfd884a4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-feeaa5cc-bbe6-4f7a-b93c-7f9cb9b6f4f2', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:48 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7e44abc6-f2b4-490e-b1d6-34e6a2279e52 tempest-VolumesListTestJSON-80669442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da80fd9c-f3cd-4b8b-8102-4d04e0c50ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:48 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccfaf493-4d93-4f91-bf43-2e5ced4e0a52]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:55:48 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-adf63b5a-5658-4da2-a201-5d574424e687 tempest-SnapshotsActionsTest-682265405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.adf07162-bf97-4787-8d3f-0baa4bcd5051 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:48 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-7e44abc6-f2b4-490e-b1d6-34e6a2279e52 tempest-VolumesListTestJSON-80669442 None] Volume volume-feeaa5cc-bbe6-4f7a-b93c-7f9cb9b6f4f2 (feeaa5cc-bbe6-4f7a-b93c-7f9cb9b6f4f2): created successfully
Apr 15 15:55:48 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7e44abc6-f2b4-490e-b1d6-34e6a2279e52 tempest-VolumesListTestJSON-80669442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da80fd9c-f3cd-4b8b-8102-4d04e0c50ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:48 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7e44abc6-f2b4-490e-b1d6-34e6a2279e52 tempest-VolumesListTestJSON-80669442 None] Flow 'volume_create_manager' (d9ebe042-c85f-43ca-8748-fedf6fb61668) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:55:48 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-7e44abc6-f2b4-490e-b1d6-34e6a2279e52 tempest-VolumesListTestJSON-80669442 None] Created volume successfully.
Apr 15 15:55:48 devstack sudo[87388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.adf07162-bf97-4787-8d3f-0baa4bcd5051
Apr 15 15:55:48 devstack sudo[87388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:49 devstack sudo[87388]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:49 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-adf63b5a-5658-4da2-a201-5d574424e687 tempest-SnapshotsActionsTest-682265405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.adf07162-bf97-4787-8d3f-0baa4bcd5051" returned: 0 in 0.609s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:49 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-adf63b5a-5658-4da2-a201-5d574424e687 tempest-SnapshotsActionsTest-682265405 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78b33a64-cdae-492e-abdb-20e2c1f058cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82485) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 15:55:49 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-adf63b5a-5658-4da2-a201-5d574424e687 tempest-SnapshotsActionsTest-682265405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.adf07162-bf97-4787-8d3f-0baa4bcd5051,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.ce21782a-1cd8-4218-94b6-01d7a8bc9839 1G {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:49 devstack sudo[87395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.adf07162-bf97-4787-8d3f-0baa4bcd5051,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.ce21782a-1cd8-4218-94b6-01d7a8bc9839 1G
Apr 15 15:55:49 devstack sudo[87395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:49 devstack sudo[87395]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:49 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2218870-6fb4-4584-9649-6d9b8be488da tempest-VolumesListTestJSON-80669442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:55:49 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d2218870-6fb4-4584-9649-6d9b8be488da tempest-VolumesListTestJSON-80669442 None] Flow 'volume_create_manager' (98429210-4639-46da-9263-745c7b57eb2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:55:49 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d2218870-6fb4-4584-9649-6d9b8be488da tempest-VolumesListTestJSON-80669442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe51da59-5452-4dc3-a99d-73ca8d377474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:49 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-adf63b5a-5658-4da2-a201-5d574424e687 tempest-SnapshotsActionsTest-682265405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.adf07162-bf97-4787-8d3f-0baa4bcd5051,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.ce21782a-1cd8-4218-94b6-01d7a8bc9839 1G" returned: 0 in 0.611s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:49 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-adf63b5a-5658-4da2-a201-5d574424e687 tempest-SnapshotsActionsTest-682265405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.adf07162-bf97-4787-8d3f-0baa4bcd5051 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.ce21782a-1cd8-4218-94b6-01d7a8bc9839 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:50 devstack sudo[87400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.adf07162-bf97-4787-8d3f-0baa4bcd5051 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.ce21782a-1cd8-4218-94b6-01d7a8bc9839
Apr 15 15:55:50 devstack sudo[87400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d2218870-6fb4-4584-9649-6d9b8be488da tempest-VolumesListTestJSON-80669442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe51da59-5452-4dc3-a99d-73ca8d377474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:55:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1625888904',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5db9a69c-3ed1-4e9a-a19a-cfbf22a66fe9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='faa873051f094d3fa1b771e7e10551ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:55:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:55:50Z,use_quota=True,user_id='d9bb7107bae24afeac0edc0681e4513d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d2218870-6fb4-4584-9649-6d9b8be488da tempest-VolumesListTestJSON-80669442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bd10efb-4388-457e-ae99-06ba37137e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d2218870-6fb4-4584-9649-6d9b8be488da tempest-VolumesListTestJSON-80669442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bd10efb-4388-457e-ae99-06ba37137e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d2218870-6fb4-4584-9649-6d9b8be488da tempest-VolumesListTestJSON-80669442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d736e9a-9a97-4dba-93db-b37fb2e1fecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d2218870-6fb4-4584-9649-6d9b8be488da tempest-VolumesListTestJSON-80669442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d736e9a-9a97-4dba-93db-b37fb2e1fecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5db9a69c-3ed1-4e9a-a19a-cfbf22a66fe9', 'volume_name': 'volume-5db9a69c-3ed1-4e9a-a19a-cfbf22a66fe9', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d2218870-6fb4-4584-9649-6d9b8be488da tempest-VolumesListTestJSON-80669442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96fe1eb7-ce5a-4320-a618-00dbbad7df32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d2218870-6fb4-4584-9649-6d9b8be488da tempest-VolumesListTestJSON-80669442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96fe1eb7-ce5a-4320-a618-00dbbad7df32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d2218870-6fb4-4584-9649-6d9b8be488da tempest-VolumesListTestJSON-80669442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de2e9785-a5d6-41cf-a61a-6d932f8886a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:50 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-d2218870-6fb4-4584-9649-6d9b8be488da tempest-VolumesListTestJSON-80669442 None] Volume 5db9a69c-3ed1-4e9a-a19a-cfbf22a66fe9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5db9a69c-3ed1-4e9a-a19a-cfbf22a66fe9', 'volume_size': 1}
Apr 15 15:55:50 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-d2218870-6fb4-4584-9649-6d9b8be488da tempest-VolumesListTestJSON-80669442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:55:50 devstack sudo[87400]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:50 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-adf63b5a-5658-4da2-a201-5d574424e687 tempest-SnapshotsActionsTest-682265405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.adf07162-bf97-4787-8d3f-0baa4bcd5051 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.ce21782a-1cd8-4218-94b6-01d7a8bc9839" returned: 0 in 0.447s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:50 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-adf63b5a-5658-4da2-a201-5d574424e687 tempest-SnapshotsActionsTest-682265405 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.ce21782a-1cd8-4218-94b6-01d7a8bc9839 is being set with open permissions: ugo+rw
Apr 15 15:55:50 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-adf63b5a-5658-4da2-a201-5d574424e687 tempest-SnapshotsActionsTest-682265405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.ce21782a-1cd8-4218-94b6-01d7a8bc9839 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:50 devstack sudo[87405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.ce21782a-1cd8-4218-94b6-01d7a8bc9839
Apr 15 15:55:50 devstack sudo[87405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:50 devstack sudo[87405]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:50 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-adf63b5a-5658-4da2-a201-5d574424e687 tempest-SnapshotsActionsTest-682265405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.ce21782a-1cd8-4218-94b6-01d7a8bc9839" returned: 0 in 0.404s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:50 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-adf63b5a-5658-4da2-a201-5d574424e687 tempest-SnapshotsActionsTest-682265405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.138s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:55:50 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-d2218870-6fb4-4584-9649-6d9b8be488da tempest-VolumesListTestJSON-80669442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.829s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:55:50 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-d2218870-6fb4-4584-9649-6d9b8be488da tempest-VolumesListTestJSON-80669442 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:55:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1625888904',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5db9a69c-3ed1-4e9a-a19a-cfbf22a66fe9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='faa873051f094d3fa1b771e7e10551ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:55:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:55:50Z,use_quota=True,user_id='d9bb7107bae24afeac0edc0681e4513d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:55:50 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-d2218870-6fb4-4584-9649-6d9b8be488da tempest-VolumesListTestJSON-80669442 None] Creating volume 5db9a69c-3ed1-4e9a-a19a-cfbf22a66fe9 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:55:50 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-d2218870-6fb4-4584-9649-6d9b8be488da tempest-VolumesListTestJSON-80669442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:55:50 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-d2218870-6fb4-4584-9649-6d9b8be488da tempest-VolumesListTestJSON-80669442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:55:50 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-d2218870-6fb4-4584-9649-6d9b8be488da tempest-VolumesListTestJSON-80669442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:55:50 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-d2218870-6fb4-4584-9649-6d9b8be488da tempest-VolumesListTestJSON-80669442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:55:50 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-d2218870-6fb4-4584-9649-6d9b8be488da tempest-VolumesListTestJSON-80669442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:55:50 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-d2218870-6fb4-4584-9649-6d9b8be488da tempest-VolumesListTestJSON-80669442 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:55:50 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-d2218870-6fb4-4584-9649-6d9b8be488da tempest-VolumesListTestJSON-80669442 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:55:50 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-d2218870-6fb4-4584-9649-6d9b8be488da tempest-VolumesListTestJSON-80669442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5db9a69c-3ed1-4e9a-a19a-cfbf22a66fe9 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:50 devstack sudo[87408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5db9a69c-3ed1-4e9a-a19a-cfbf22a66fe9 1073741824
Apr 15 15:55:50 devstack sudo[87408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:50 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-adf63b5a-5658-4da2-a201-5d574424e687 tempest-SnapshotsActionsTest-682265405 None] Create snapshot completed successfully
Apr 15 15:55:51 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-53ccb0eb-7837-463f-a631-25f7f68c3375 tempest-SnapshotsActionsTest-1652539038 None] Acquiring lock "cinder-ce21782a-1cd8-4218-94b6-01d7a8bc9839-delete_snapshot" by "delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:55:51 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-53ccb0eb-7837-463f-a631-25f7f68c3375 tempest-SnapshotsActionsTest-1652539038 None] Lock "cinder-ce21782a-1cd8-4218-94b6-01d7a8bc9839-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:55:51 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-53ccb0eb-7837-463f-a631-25f7f68c3375 tempest-SnapshotsActionsTest-1652539038 None] Acquiring lock "cinder-quobyte-78b33a64-cdae-492e-abdb-20e2c1f058cb" by "delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:55:51 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-53ccb0eb-7837-463f-a631-25f7f68c3375 tempest-SnapshotsActionsTest-1652539038 None] Lock "cinder-quobyte-78b33a64-cdae-492e-abdb-20e2c1f058cb" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:55:51 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-53ccb0eb-7837-463f-a631-25f7f68c3375 tempest-SnapshotsActionsTest-1652539038 None] Acquiring lock "cinder-quobyte-ce21782a-1cd8-4218-94b6-01d7a8bc9839" by "_delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:55:51 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-53ccb0eb-7837-463f-a631-25f7f68c3375 tempest-SnapshotsActionsTest-1652539038 None] Lock "cinder-quobyte-ce21782a-1cd8-4218-94b6-01d7a8bc9839" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:55:51 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-53ccb0eb-7837-463f-a631-25f7f68c3375 tempest-SnapshotsActionsTest-1652539038 None] Deleting offline snapshot ce21782a-1cd8-4218-94b6-01d7a8bc9839 of volume 78b33a64-cdae-492e-abdb-20e2c1f058cb {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 15:55:51 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-53ccb0eb-7837-463f-a631-25f7f68c3375 tempest-SnapshotsActionsTest-1652539038 None] snapshot_file for this snap is: volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.ce21782a-1cd8-4218-94b6-01d7a8bc9839 {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 15:55:51 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[637a2b31-f7eb-49c2-bcbc-85d8f1aaa9df]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:55:51 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-53ccb0eb-7837-463f-a631-25f7f68c3375 tempest-SnapshotsActionsTest-1652539038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.ce21782a-1cd8-4218-94b6-01d7a8bc9839 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:51 devstack sudo[87408]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:51 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-d2218870-6fb4-4584-9649-6d9b8be488da tempest-VolumesListTestJSON-80669442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5db9a69c-3ed1-4e9a-a19a-cfbf22a66fe9 1073741824" returned: 0 in 0.589s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:51 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-d2218870-6fb4-4584-9649-6d9b8be488da tempest-VolumesListTestJSON-80669442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5db9a69c-3ed1-4e9a-a19a-cfbf22a66fe9 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:51 devstack sudo[87414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5db9a69c-3ed1-4e9a-a19a-cfbf22a66fe9
Apr 15 15:55:51 devstack sudo[87414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:51 devstack sudo[87413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.ce21782a-1cd8-4218-94b6-01d7a8bc9839
Apr 15 15:55:51 devstack sudo[87413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:51 devstack sudo[87414]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:51 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-d2218870-6fb4-4584-9649-6d9b8be488da tempest-VolumesListTestJSON-80669442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5db9a69c-3ed1-4e9a-a19a-cfbf22a66fe9" returned: 0 in 0.415s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:51 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-d2218870-6fb4-4584-9649-6d9b8be488da tempest-VolumesListTestJSON-80669442 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:55:51 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-d2218870-6fb4-4584-9649-6d9b8be488da tempest-VolumesListTestJSON-80669442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:55:51 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d2218870-6fb4-4584-9649-6d9b8be488da tempest-VolumesListTestJSON-80669442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de2e9785-a5d6-41cf-a61a-6d932f8886a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5db9a69c-3ed1-4e9a-a19a-cfbf22a66fe9', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:51 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d2218870-6fb4-4584-9649-6d9b8be488da tempest-VolumesListTestJSON-80669442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2e03eb1-c117-4761-8d6c-1b6e692726f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:51 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-d2218870-6fb4-4584-9649-6d9b8be488da tempest-VolumesListTestJSON-80669442 None] Volume volume-5db9a69c-3ed1-4e9a-a19a-cfbf22a66fe9 (5db9a69c-3ed1-4e9a-a19a-cfbf22a66fe9): created successfully
Apr 15 15:55:51 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d2218870-6fb4-4584-9649-6d9b8be488da tempest-VolumesListTestJSON-80669442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2e03eb1-c117-4761-8d6c-1b6e692726f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:51 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d2218870-6fb4-4584-9649-6d9b8be488da tempest-VolumesListTestJSON-80669442 None] Flow 'volume_create_manager' (98429210-4639-46da-9263-745c7b57eb2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:55:51 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-d2218870-6fb4-4584-9649-6d9b8be488da tempest-VolumesListTestJSON-80669442 None] Created volume successfully.
Apr 15 15:55:51 devstack sudo[87413]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:51 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-53ccb0eb-7837-463f-a631-25f7f68c3375 tempest-SnapshotsActionsTest-1652539038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.ce21782a-1cd8-4218-94b6-01d7a8bc9839" returned: 0 in 0.535s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:51 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-53ccb0eb-7837-463f-a631-25f7f68c3375 tempest-SnapshotsActionsTest-1652539038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78b33a64-cdae-492e-abdb-20e2c1f058cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82485) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 15:55:52 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c86ee6b-0272-491b-b874-6da28436811c]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:55:52 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-53ccb0eb-7837-463f-a631-25f7f68c3375 tempest-SnapshotsActionsTest-1652539038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.adf07162-bf97-4787-8d3f-0baa4bcd5051 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:52 devstack sudo[87421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.adf07162-bf97-4787-8d3f-0baa4bcd5051
Apr 15 15:55:52 devstack sudo[87421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:52 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-564e3186-23cb-4a90-be17-7d67504e692a tempest-VolumesListTestJSON-80669442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:55:52 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-564e3186-23cb-4a90-be17-7d67504e692a tempest-VolumesListTestJSON-80669442 None] Flow 'volume_create_manager' (fbc58463-333c-4e9d-b34b-280097ae4ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:55:52 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-564e3186-23cb-4a90-be17-7d67504e692a tempest-VolumesListTestJSON-80669442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7e0252b-5fc1-428a-99fa-17823a0dd5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:52 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-564e3186-23cb-4a90-be17-7d67504e692a tempest-VolumesListTestJSON-80669442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7e0252b-5fc1-428a-99fa-17823a0dd5fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:55:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-311121347',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8379d885-9d2a-455e-a2c0-879805b3c9ea,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='faa873051f094d3fa1b771e7e10551ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:55:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:55:52Z,use_quota=True,user_id='d9bb7107bae24afeac0edc0681e4513d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:52 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-564e3186-23cb-4a90-be17-7d67504e692a tempest-VolumesListTestJSON-80669442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd2fc782-dfd0-4b28-aa2a-bcdbb150d5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:52 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-564e3186-23cb-4a90-be17-7d67504e692a tempest-VolumesListTestJSON-80669442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd2fc782-dfd0-4b28-aa2a-bcdbb150d5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:52 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-564e3186-23cb-4a90-be17-7d67504e692a tempest-VolumesListTestJSON-80669442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6417d5f-82bf-43be-9834-de8ba74f1614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:52 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-564e3186-23cb-4a90-be17-7d67504e692a tempest-VolumesListTestJSON-80669442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6417d5f-82bf-43be-9834-de8ba74f1614) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8379d885-9d2a-455e-a2c0-879805b3c9ea', 'volume_name': 'volume-8379d885-9d2a-455e-a2c0-879805b3c9ea', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:52 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-564e3186-23cb-4a90-be17-7d67504e692a tempest-VolumesListTestJSON-80669442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86d3d8c0-490a-4428-a68f-cae647a98046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:52 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-564e3186-23cb-4a90-be17-7d67504e692a tempest-VolumesListTestJSON-80669442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86d3d8c0-490a-4428-a68f-cae647a98046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:52 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-564e3186-23cb-4a90-be17-7d67504e692a tempest-VolumesListTestJSON-80669442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c47d74fa-9806-4132-b836-de383c68af04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:52 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-564e3186-23cb-4a90-be17-7d67504e692a tempest-VolumesListTestJSON-80669442 None] Volume 8379d885-9d2a-455e-a2c0-879805b3c9ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8379d885-9d2a-455e-a2c0-879805b3c9ea', 'volume_size': 1}
Apr 15 15:55:52 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-564e3186-23cb-4a90-be17-7d67504e692a tempest-VolumesListTestJSON-80669442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:55:52 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-564e3186-23cb-4a90-be17-7d67504e692a tempest-VolumesListTestJSON-80669442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:55:52 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-564e3186-23cb-4a90-be17-7d67504e692a tempest-VolumesListTestJSON-80669442 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:55:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-311121347',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8379d885-9d2a-455e-a2c0-879805b3c9ea,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='faa873051f094d3fa1b771e7e10551ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:55:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:55:52Z,use_quota=True,user_id='d9bb7107bae24afeac0edc0681e4513d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:55:52 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-564e3186-23cb-4a90-be17-7d67504e692a tempest-VolumesListTestJSON-80669442 None] Creating volume 8379d885-9d2a-455e-a2c0-879805b3c9ea {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:55:52 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-564e3186-23cb-4a90-be17-7d67504e692a tempest-VolumesListTestJSON-80669442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:55:52 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-564e3186-23cb-4a90-be17-7d67504e692a tempest-VolumesListTestJSON-80669442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:55:52 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-564e3186-23cb-4a90-be17-7d67504e692a tempest-VolumesListTestJSON-80669442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:55:52 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-564e3186-23cb-4a90-be17-7d67504e692a tempest-VolumesListTestJSON-80669442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:55:52 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-564e3186-23cb-4a90-be17-7d67504e692a tempest-VolumesListTestJSON-80669442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:55:52 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-564e3186-23cb-4a90-be17-7d67504e692a tempest-VolumesListTestJSON-80669442 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:55:52 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-564e3186-23cb-4a90-be17-7d67504e692a tempest-VolumesListTestJSON-80669442 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:55:52 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-564e3186-23cb-4a90-be17-7d67504e692a tempest-VolumesListTestJSON-80669442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8379d885-9d2a-455e-a2c0-879805b3c9ea 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:52 devstack sudo[87423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8379d885-9d2a-455e-a2c0-879805b3c9ea 1073741824
Apr 15 15:55:52 devstack sudo[87423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:52 devstack sudo[87421]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:52 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-53ccb0eb-7837-463f-a631-25f7f68c3375 tempest-SnapshotsActionsTest-1652539038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.adf07162-bf97-4787-8d3f-0baa4bcd5051" returned: 0 in 0.536s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:52 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-53ccb0eb-7837-463f-a631-25f7f68c3375 tempest-SnapshotsActionsTest-1652539038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78b33a64-cdae-492e-abdb-20e2c1f058cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82485) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 15:55:52 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-53ccb0eb-7837-463f-a631-25f7f68c3375 tempest-SnapshotsActionsTest-1652539038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.ce21782a-1cd8-4218-94b6-01d7a8bc9839 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:52 devstack sudo[87428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.ce21782a-1cd8-4218-94b6-01d7a8bc9839
Apr 15 15:55:52 devstack sudo[87428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:52 devstack sudo[87423]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:52 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-564e3186-23cb-4a90-be17-7d67504e692a tempest-VolumesListTestJSON-80669442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8379d885-9d2a-455e-a2c0-879805b3c9ea 1073741824" returned: 0 in 0.546s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:52 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-564e3186-23cb-4a90-be17-7d67504e692a tempest-VolumesListTestJSON-80669442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8379d885-9d2a-455e-a2c0-879805b3c9ea {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:52 devstack sudo[87436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8379d885-9d2a-455e-a2c0-879805b3c9ea
Apr 15 15:55:52 devstack sudo[87436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:53 devstack sudo[87428]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:53 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-53ccb0eb-7837-463f-a631-25f7f68c3375 tempest-SnapshotsActionsTest-1652539038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.ce21782a-1cd8-4218-94b6-01d7a8bc9839" returned: 0 in 0.507s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:53 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-53ccb0eb-7837-463f-a631-25f7f68c3375 tempest-SnapshotsActionsTest-1652539038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.ce21782a-1cd8-4218-94b6-01d7a8bc9839 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:53 devstack sudo[87438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.ce21782a-1cd8-4218-94b6-01d7a8bc9839
Apr 15 15:55:53 devstack sudo[87438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:53 devstack sudo[87436]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:53 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-564e3186-23cb-4a90-be17-7d67504e692a tempest-VolumesListTestJSON-80669442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8379d885-9d2a-455e-a2c0-879805b3c9ea" returned: 0 in 0.467s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:53 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-564e3186-23cb-4a90-be17-7d67504e692a tempest-VolumesListTestJSON-80669442 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:55:53 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-564e3186-23cb-4a90-be17-7d67504e692a tempest-VolumesListTestJSON-80669442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:55:53 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-564e3186-23cb-4a90-be17-7d67504e692a tempest-VolumesListTestJSON-80669442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c47d74fa-9806-4132-b836-de383c68af04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8379d885-9d2a-455e-a2c0-879805b3c9ea', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:53 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-564e3186-23cb-4a90-be17-7d67504e692a tempest-VolumesListTestJSON-80669442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (573ebfdc-b938-48c8-b9cb-a4c90f722baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:53 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-564e3186-23cb-4a90-be17-7d67504e692a tempest-VolumesListTestJSON-80669442 None] Volume volume-8379d885-9d2a-455e-a2c0-879805b3c9ea (8379d885-9d2a-455e-a2c0-879805b3c9ea): created successfully
Apr 15 15:55:53 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-564e3186-23cb-4a90-be17-7d67504e692a tempest-VolumesListTestJSON-80669442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (573ebfdc-b938-48c8-b9cb-a4c90f722baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:53 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-564e3186-23cb-4a90-be17-7d67504e692a tempest-VolumesListTestJSON-80669442 None] Flow 'volume_create_manager' (fbc58463-333c-4e9d-b34b-280097ae4ff3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:55:53 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-564e3186-23cb-4a90-be17-7d67504e692a tempest-VolumesListTestJSON-80669442 None] Created volume successfully.
Apr 15 15:55:53 devstack sudo[87438]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:53 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-53ccb0eb-7837-463f-a631-25f7f68c3375 tempest-SnapshotsActionsTest-1652539038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.ce21782a-1cd8-4218-94b6-01d7a8bc9839" returned: 0 in 0.507s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:53 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-53ccb0eb-7837-463f-a631-25f7f68c3375 tempest-SnapshotsActionsTest-1652539038 None] Lock "cinder-quobyte-ce21782a-1cd8-4218-94b6-01d7a8bc9839" released by "_delete_snapshot" :: held 2.146s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:55:53 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-53ccb0eb-7837-463f-a631-25f7f68c3375 tempest-SnapshotsActionsTest-1652539038 None] Lock "cinder-quobyte-78b33a64-cdae-492e-abdb-20e2c1f058cb" released by "delete_snapshot" :: held 2.163s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:55:53 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-53ccb0eb-7837-463f-a631-25f7f68c3375 tempest-SnapshotsActionsTest-1652539038 None] Created reservations ['1a2169ee-2094-4d52-aa03-1b8e7cf48e4a', 'c1138d81-192d-493e-bb72-8e9e3072cf43', 'b576a649-8079-40ee-8ee6-cf4c516d18c1', '965d02ef-da75-4d8c-8354-273c1cb36c46'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:55:53 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-53ccb0eb-7837-463f-a631-25f7f68c3375 tempest-SnapshotsActionsTest-1652539038 None] Delete snapshot completed successfully.
Apr 15 15:55:53 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-53ccb0eb-7837-463f-a631-25f7f68c3375 tempest-SnapshotsActionsTest-1652539038 None] Lock "cinder-ce21782a-1cd8-4218-94b6-01d7a8bc9839-delete_snapshot" released by "delete_snapshot" :: held 2.248s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:55:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-78bde5de-9cdd-45ff-8175-cdc34e5ef8a6 tempest-SnapshotsActionsTest-682265405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:55:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-78bde5de-9cdd-45ff-8175-cdc34e5ef8a6 tempest-SnapshotsActionsTest-682265405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:55:54 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-78bde5de-9cdd-45ff-8175-cdc34e5ef8a6 tempest-SnapshotsActionsTest-682265405 None] Creating offline snapshot 4cfde7ca-4c2e-4efd-9614-a0f82df9e502 of volume 78b33a64-cdae-492e-abdb-20e2c1f058cb {{(pid=82485) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 15:55:55 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba6af48-4262-4717-88e1-fb8e02ab25ea]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:55:55 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-78bde5de-9cdd-45ff-8175-cdc34e5ef8a6 tempest-SnapshotsActionsTest-682265405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.adf07162-bf97-4787-8d3f-0baa4bcd5051 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:55 devstack sudo[87444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.adf07162-bf97-4787-8d3f-0baa4bcd5051
Apr 15 15:55:55 devstack sudo[87444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:55 devstack sudo[87444]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:55 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-78bde5de-9cdd-45ff-8175-cdc34e5ef8a6 tempest-SnapshotsActionsTest-682265405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.adf07162-bf97-4787-8d3f-0baa4bcd5051" returned: 0 in 0.637s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:55 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-78bde5de-9cdd-45ff-8175-cdc34e5ef8a6 tempest-SnapshotsActionsTest-682265405 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78b33a64-cdae-492e-abdb-20e2c1f058cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82485) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 15:55:55 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-78bde5de-9cdd-45ff-8175-cdc34e5ef8a6 tempest-SnapshotsActionsTest-682265405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.adf07162-bf97-4787-8d3f-0baa4bcd5051,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.4cfde7ca-4c2e-4efd-9614-a0f82df9e502 1G {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:55 devstack sudo[87452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.adf07162-bf97-4787-8d3f-0baa4bcd5051,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.4cfde7ca-4c2e-4efd-9614-a0f82df9e502 1G
Apr 15 15:55:55 devstack sudo[87452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:56 devstack sudo[87452]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:56 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-78bde5de-9cdd-45ff-8175-cdc34e5ef8a6 tempest-SnapshotsActionsTest-682265405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.adf07162-bf97-4787-8d3f-0baa4bcd5051,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.4cfde7ca-4c2e-4efd-9614-a0f82df9e502 1G" returned: 0 in 0.609s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:56 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-78bde5de-9cdd-45ff-8175-cdc34e5ef8a6 tempest-SnapshotsActionsTest-682265405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.adf07162-bf97-4787-8d3f-0baa4bcd5051 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.4cfde7ca-4c2e-4efd-9614-a0f82df9e502 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:56 devstack sudo[87457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.adf07162-bf97-4787-8d3f-0baa4bcd5051 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.4cfde7ca-4c2e-4efd-9614-a0f82df9e502
Apr 15 15:55:56 devstack sudo[87457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:56 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-1b9b01b6-37cf-4f17-b579-db0aeaf6277b tempest-VolumesListTestJSON-80669442 None] Acquiring lock "cinder-8379d885-9d2a-455e-a2c0-879805b3c9ea-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:55:56 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-1b9b01b6-37cf-4f17-b579-db0aeaf6277b tempest-VolumesListTestJSON-80669442 None] Lock "cinder-8379d885-9d2a-455e-a2c0-879805b3c9ea-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:55:56 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-1b9b01b6-37cf-4f17-b579-db0aeaf6277b tempest-VolumesListTestJSON-80669442 None] Acquiring lock "cinder-quobyte-8379d885-9d2a-455e-a2c0-879805b3c9ea" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:55:56 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-1b9b01b6-37cf-4f17-b579-db0aeaf6277b tempest-VolumesListTestJSON-80669442 None] Lock "cinder-quobyte-8379d885-9d2a-455e-a2c0-879805b3c9ea" acquired by "delete_volume" :: waited 0.022s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:55:56 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6491a08-cf15-4f31-a609-6395d23c7cd5]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:55:56 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-1b9b01b6-37cf-4f17-b579-db0aeaf6277b tempest-VolumesListTestJSON-80669442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8379d885-9d2a-455e-a2c0-879805b3c9ea {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:56 devstack sudo[87457]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:56 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-78bde5de-9cdd-45ff-8175-cdc34e5ef8a6 tempest-SnapshotsActionsTest-682265405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.adf07162-bf97-4787-8d3f-0baa4bcd5051 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.4cfde7ca-4c2e-4efd-9614-a0f82df9e502" returned: 0 in 0.544s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:56 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-78bde5de-9cdd-45ff-8175-cdc34e5ef8a6 tempest-SnapshotsActionsTest-682265405 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.4cfde7ca-4c2e-4efd-9614-a0f82df9e502 is being set with open permissions: ugo+rw
Apr 15 15:55:56 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-78bde5de-9cdd-45ff-8175-cdc34e5ef8a6 tempest-SnapshotsActionsTest-682265405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.4cfde7ca-4c2e-4efd-9614-a0f82df9e502 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:56 devstack sudo[87463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.4cfde7ca-4c2e-4efd-9614-a0f82df9e502
Apr 15 15:55:56 devstack sudo[87463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:56 devstack sudo[87462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8379d885-9d2a-455e-a2c0-879805b3c9ea
Apr 15 15:55:56 devstack sudo[87462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:57 devstack sudo[87463]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-78bde5de-9cdd-45ff-8175-cdc34e5ef8a6 tempest-SnapshotsActionsTest-682265405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.4cfde7ca-4c2e-4efd-9614-a0f82df9e502" returned: 0 in 0.497s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-78bde5de-9cdd-45ff-8175-cdc34e5ef8a6 tempest-SnapshotsActionsTest-682265405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.364s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:55:57 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [req-91806fd7-53fa-465a-852a-a7a590e4950d req-2501be69-f2bf-442f-b24f-ef3f7019cc09 tempest-VolumesGetTestJSON-34376584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:55:57 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [req-91806fd7-53fa-465a-852a-a7a590e4950d req-2501be69-f2bf-442f-b24f-ef3f7019cc09 tempest-VolumesGetTestJSON-34376584 None] Flow 'volume_create_manager' (62a073b9-876b-46ba-b8fc-0830bee83014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:55:57 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [req-91806fd7-53fa-465a-852a-a7a590e4950d req-2501be69-f2bf-442f-b24f-ef3f7019cc09 tempest-VolumesGetTestJSON-34376584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ebe055a-2b1d-433c-92ff-ca12f68d1e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:57 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-78bde5de-9cdd-45ff-8175-cdc34e5ef8a6 tempest-SnapshotsActionsTest-682265405 None] Create snapshot completed successfully
Apr 15 15:55:57 devstack sudo[87462]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-1b9b01b6-37cf-4f17-b579-db0aeaf6277b tempest-VolumesListTestJSON-80669442 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8379d885-9d2a-455e-a2c0-879805b3c9ea" returned: 0 in 0.591s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-1b9b01b6-37cf-4f17-b579-db0aeaf6277b tempest-VolumesListTestJSON-80669442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8379d885-9d2a-455e-a2c0-879805b3c9ea {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:57 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [req-91806fd7-53fa-465a-852a-a7a590e4950d req-2501be69-f2bf-442f-b24f-ef3f7019cc09 tempest-VolumesGetTestJSON-34376584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ebe055a-2b1d-433c-92ff-ca12f68d1e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:55:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1000053179',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d83c9b0d-4b7a-4000-964f-6b0745e4f804,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='27876b3806c4452988f829b5e4bad737',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:55:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:55:57Z,use_quota=True,user_id='b1cd715dc35f426ba9729fea014f04c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:57 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [req-91806fd7-53fa-465a-852a-a7a590e4950d req-2501be69-f2bf-442f-b24f-ef3f7019cc09 tempest-VolumesGetTestJSON-34376584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d91a5ee-c155-4be1-9d40-a0c08067b04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:57 devstack sudo[87470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8379d885-9d2a-455e-a2c0-879805b3c9ea
Apr 15 15:55:57 devstack sudo[87470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:57 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [req-91806fd7-53fa-465a-852a-a7a590e4950d req-2501be69-f2bf-442f-b24f-ef3f7019cc09 tempest-VolumesGetTestJSON-34376584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d91a5ee-c155-4be1-9d40-a0c08067b04f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:57 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [req-91806fd7-53fa-465a-852a-a7a590e4950d req-2501be69-f2bf-442f-b24f-ef3f7019cc09 tempest-VolumesGetTestJSON-34376584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1cde3ef-bd90-409d-abeb-181267227516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:57 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [req-91806fd7-53fa-465a-852a-a7a590e4950d req-2501be69-f2bf-442f-b24f-ef3f7019cc09 tempest-VolumesGetTestJSON-34376584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1cde3ef-bd90-409d-abeb-181267227516) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd83c9b0d-4b7a-4000-964f-6b0745e4f804', 'volume_name': 'volume-d83c9b0d-4b7a-4000-964f-6b0745e4f804', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:57 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [req-91806fd7-53fa-465a-852a-a7a590e4950d req-2501be69-f2bf-442f-b24f-ef3f7019cc09 tempest-VolumesGetTestJSON-34376584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f75dddbe-a742-4ed2-b20d-32d4948b2a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:57 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [req-91806fd7-53fa-465a-852a-a7a590e4950d req-2501be69-f2bf-442f-b24f-ef3f7019cc09 tempest-VolumesGetTestJSON-34376584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f75dddbe-a742-4ed2-b20d-32d4948b2a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:57 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [req-91806fd7-53fa-465a-852a-a7a590e4950d req-2501be69-f2bf-442f-b24f-ef3f7019cc09 tempest-VolumesGetTestJSON-34376584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e078014d-4ce2-4ec0-bcf0-d6957d55c5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:57 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [req-91806fd7-53fa-465a-852a-a7a590e4950d req-2501be69-f2bf-442f-b24f-ef3f7019cc09 tempest-VolumesGetTestJSON-34376584 None] Volume d83c9b0d-4b7a-4000-964f-6b0745e4f804: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d83c9b0d-4b7a-4000-964f-6b0745e4f804', 'volume_size': 1}
Apr 15 15:55:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [req-91806fd7-53fa-465a-852a-a7a590e4950d req-2501be69-f2bf-442f-b24f-ef3f7019cc09 tempest-VolumesGetTestJSON-34376584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:55:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [req-91806fd7-53fa-465a-852a-a7a590e4950d req-2501be69-f2bf-442f-b24f-ef3f7019cc09 tempest-VolumesGetTestJSON-34376584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:55:57 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [req-91806fd7-53fa-465a-852a-a7a590e4950d req-2501be69-f2bf-442f-b24f-ef3f7019cc09 tempest-VolumesGetTestJSON-34376584 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:55:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1000053179',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d83c9b0d-4b7a-4000-964f-6b0745e4f804,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='27876b3806c4452988f829b5e4bad737',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:55:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:55:57Z,use_quota=True,user_id='b1cd715dc35f426ba9729fea014f04c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:55:57 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [req-91806fd7-53fa-465a-852a-a7a590e4950d req-2501be69-f2bf-442f-b24f-ef3f7019cc09 tempest-VolumesGetTestJSON-34376584 None] Creating volume d83c9b0d-4b7a-4000-964f-6b0745e4f804 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:55:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [req-91806fd7-53fa-465a-852a-a7a590e4950d req-2501be69-f2bf-442f-b24f-ef3f7019cc09 tempest-VolumesGetTestJSON-34376584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:55:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [req-91806fd7-53fa-465a-852a-a7a590e4950d req-2501be69-f2bf-442f-b24f-ef3f7019cc09 tempest-VolumesGetTestJSON-34376584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:55:57 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [req-91806fd7-53fa-465a-852a-a7a590e4950d req-2501be69-f2bf-442f-b24f-ef3f7019cc09 tempest-VolumesGetTestJSON-34376584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:55:57 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [req-91806fd7-53fa-465a-852a-a7a590e4950d req-2501be69-f2bf-442f-b24f-ef3f7019cc09 tempest-VolumesGetTestJSON-34376584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:55:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [req-91806fd7-53fa-465a-852a-a7a590e4950d req-2501be69-f2bf-442f-b24f-ef3f7019cc09 tempest-VolumesGetTestJSON-34376584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:55:57 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [req-91806fd7-53fa-465a-852a-a7a590e4950d req-2501be69-f2bf-442f-b24f-ef3f7019cc09 tempest-VolumesGetTestJSON-34376584 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:55:57 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [req-91806fd7-53fa-465a-852a-a7a590e4950d req-2501be69-f2bf-442f-b24f-ef3f7019cc09 tempest-VolumesGetTestJSON-34376584 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:55:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-91806fd7-53fa-465a-852a-a7a590e4950d req-2501be69-f2bf-442f-b24f-ef3f7019cc09 tempest-VolumesGetTestJSON-34376584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-d83c9b0d-4b7a-4000-964f-6b0745e4f804 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:57 devstack sudo[87472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-d83c9b0d-4b7a-4000-964f-6b0745e4f804 1073741824
Apr 15 15:55:57 devstack sudo[87472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:57 devstack sudo[87470]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-1b9b01b6-37cf-4f17-b579-db0aeaf6277b tempest-VolumesListTestJSON-80669442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8379d885-9d2a-455e-a2c0-879805b3c9ea" returned: 0 in 0.472s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:57 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-1b9b01b6-37cf-4f17-b579-db0aeaf6277b tempest-VolumesListTestJSON-80669442 None] Lock "cinder-quobyte-8379d885-9d2a-455e-a2c0-879805b3c9ea" released by "delete_volume" :: held 1.104s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:55:57 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-1b9b01b6-37cf-4f17-b579-db0aeaf6277b tempest-VolumesListTestJSON-80669442 None] Created reservations ['317831eb-c971-4f86-a1d0-75eef603835e', 'a7fae223-134c-41ac-86e0-f2fce3f6db51', '4d98bf76-039a-495a-8f00-7decc35dd12e', '726cfe87-aa08-48ae-bfd0-81a62657d606'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:55:57 devstack sudo[87472]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-1b9b01b6-37cf-4f17-b579-db0aeaf6277b tempest-VolumesListTestJSON-80669442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:55:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-1b9b01b6-37cf-4f17-b579-db0aeaf6277b tempest-VolumesListTestJSON-80669442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:55:57 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-1b9b01b6-37cf-4f17-b579-db0aeaf6277b tempest-VolumesListTestJSON-80669442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:55:57 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-1b9b01b6-37cf-4f17-b579-db0aeaf6277b tempest-VolumesListTestJSON-80669442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:55:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-1b9b01b6-37cf-4f17-b579-db0aeaf6277b tempest-VolumesListTestJSON-80669442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:55:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-1b9b01b6-37cf-4f17-b579-db0aeaf6277b tempest-VolumesListTestJSON-80669442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-91806fd7-53fa-465a-852a-a7a590e4950d req-2501be69-f2bf-442f-b24f-ef3f7019cc09 tempest-VolumesGetTestJSON-34376584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-d83c9b0d-4b7a-4000-964f-6b0745e4f804 1073741824" returned: 0 in 0.519s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:57 devstack sudo[87478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:55:57 devstack sudo[87478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-91806fd7-53fa-465a-852a-a7a590e4950d req-2501be69-f2bf-442f-b24f-ef3f7019cc09 tempest-VolumesGetTestJSON-34376584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-d83c9b0d-4b7a-4000-964f-6b0745e4f804 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:57 devstack sudo[87480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-d83c9b0d-4b7a-4000-964f-6b0745e4f804
Apr 15 15:55:57 devstack sudo[87480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:58 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-a79b2dab-16df-4b4d-afdf-231d0bfda66b tempest-SnapshotsActionsTest-1652539038 None] Acquiring lock "cinder-4cfde7ca-4c2e-4efd-9614-a0f82df9e502-delete_snapshot" by "delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:55:58 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-a79b2dab-16df-4b4d-afdf-231d0bfda66b tempest-SnapshotsActionsTest-1652539038 None] Lock "cinder-4cfde7ca-4c2e-4efd-9614-a0f82df9e502-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:55:58 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-a79b2dab-16df-4b4d-afdf-231d0bfda66b tempest-SnapshotsActionsTest-1652539038 None] Acquiring lock "cinder-quobyte-78b33a64-cdae-492e-abdb-20e2c1f058cb" by "delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:55:58 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-a79b2dab-16df-4b4d-afdf-231d0bfda66b tempest-SnapshotsActionsTest-1652539038 None] Lock "cinder-quobyte-78b33a64-cdae-492e-abdb-20e2c1f058cb" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:55:58 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-a79b2dab-16df-4b4d-afdf-231d0bfda66b tempest-SnapshotsActionsTest-1652539038 None] Acquiring lock "cinder-quobyte-4cfde7ca-4c2e-4efd-9614-a0f82df9e502" by "_delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:55:58 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-a79b2dab-16df-4b4d-afdf-231d0bfda66b tempest-SnapshotsActionsTest-1652539038 None] Lock "cinder-quobyte-4cfde7ca-4c2e-4efd-9614-a0f82df9e502" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:55:58 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-a79b2dab-16df-4b4d-afdf-231d0bfda66b tempest-SnapshotsActionsTest-1652539038 None] Deleting offline snapshot 4cfde7ca-4c2e-4efd-9614-a0f82df9e502 of volume 78b33a64-cdae-492e-abdb-20e2c1f058cb {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 15:55:58 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-a79b2dab-16df-4b4d-afdf-231d0bfda66b tempest-SnapshotsActionsTest-1652539038 None] snapshot_file for this snap is: volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.4cfde7ca-4c2e-4efd-9614-a0f82df9e502 {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 15:55:58 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3a8593-ca42-44ea-8fcf-7a61be89d0ea]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:55:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-a79b2dab-16df-4b4d-afdf-231d0bfda66b tempest-SnapshotsActionsTest-1652539038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.4cfde7ca-4c2e-4efd-9614-a0f82df9e502 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:58 devstack sudo[87482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.4cfde7ca-4c2e-4efd-9614-a0f82df9e502
Apr 15 15:55:58 devstack sudo[87482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:58 devstack sudo[87478]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-1b9b01b6-37cf-4f17-b579-db0aeaf6277b tempest-VolumesListTestJSON-80669442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.463s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:58 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-1b9b01b6-37cf-4f17-b579-db0aeaf6277b tempest-VolumesListTestJSON-80669442 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:55:58 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-1b9b01b6-37cf-4f17-b579-db0aeaf6277b tempest-VolumesListTestJSON-80669442 None] Deleted volume successfully.
Apr 15 15:55:58 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-1b9b01b6-37cf-4f17-b579-db0aeaf6277b tempest-VolumesListTestJSON-80669442 None] Lock "cinder-8379d885-9d2a-455e-a2c0-879805b3c9ea-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:55:58 devstack sudo[87480]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-91806fd7-53fa-465a-852a-a7a590e4950d req-2501be69-f2bf-442f-b24f-ef3f7019cc09 tempest-VolumesGetTestJSON-34376584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-d83c9b0d-4b7a-4000-964f-6b0745e4f804" returned: 0 in 0.461s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:58 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [req-91806fd7-53fa-465a-852a-a7a590e4950d req-2501be69-f2bf-442f-b24f-ef3f7019cc09 tempest-VolumesGetTestJSON-34376584 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:55:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [req-91806fd7-53fa-465a-852a-a7a590e4950d req-2501be69-f2bf-442f-b24f-ef3f7019cc09 tempest-VolumesGetTestJSON-34376584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:55:58 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [req-91806fd7-53fa-465a-852a-a7a590e4950d req-2501be69-f2bf-442f-b24f-ef3f7019cc09 tempest-VolumesGetTestJSON-34376584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e078014d-4ce2-4ec0-bcf0-d6957d55c5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d83c9b0d-4b7a-4000-964f-6b0745e4f804', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:58 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [req-91806fd7-53fa-465a-852a-a7a590e4950d req-2501be69-f2bf-442f-b24f-ef3f7019cc09 tempest-VolumesGetTestJSON-34376584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecd16b42-73d5-4eb7-9f58-ba8087075fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:55:58 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [req-91806fd7-53fa-465a-852a-a7a590e4950d req-2501be69-f2bf-442f-b24f-ef3f7019cc09 tempest-VolumesGetTestJSON-34376584 None] Volume volume-d83c9b0d-4b7a-4000-964f-6b0745e4f804 (d83c9b0d-4b7a-4000-964f-6b0745e4f804): created successfully
Apr 15 15:55:58 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [req-91806fd7-53fa-465a-852a-a7a590e4950d req-2501be69-f2bf-442f-b24f-ef3f7019cc09 tempest-VolumesGetTestJSON-34376584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecd16b42-73d5-4eb7-9f58-ba8087075fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:55:58 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [req-91806fd7-53fa-465a-852a-a7a590e4950d req-2501be69-f2bf-442f-b24f-ef3f7019cc09 tempest-VolumesGetTestJSON-34376584 None] Flow 'volume_create_manager' (62a073b9-876b-46ba-b8fc-0830bee83014) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:55:58 devstack cinder-volume[82485]: INFO cinder.volume.manager [req-91806fd7-53fa-465a-852a-a7a590e4950d req-2501be69-f2bf-442f-b24f-ef3f7019cc09 tempest-VolumesGetTestJSON-34376584 None] Created volume successfully.
Apr 15 15:55:58 devstack sudo[87482]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-a79b2dab-16df-4b4d-afdf-231d0bfda66b tempest-SnapshotsActionsTest-1652539038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.4cfde7ca-4c2e-4efd-9614-a0f82df9e502" returned: 0 in 0.487s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:58 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-a79b2dab-16df-4b4d-afdf-231d0bfda66b tempest-SnapshotsActionsTest-1652539038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78b33a64-cdae-492e-abdb-20e2c1f058cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82485) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 15:55:58 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[56eb0470-b4b0-49ca-b639-c790a714e5ee]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:55:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-a79b2dab-16df-4b4d-afdf-231d0bfda66b tempest-SnapshotsActionsTest-1652539038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.adf07162-bf97-4787-8d3f-0baa4bcd5051 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:58 devstack sudo[87489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.adf07162-bf97-4787-8d3f-0baa4bcd5051
Apr 15 15:55:58 devstack sudo[87489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:58 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-4ecfd5a3-485c-4fb9-8c19-658e036ff199 tempest-VolumesListTestJSON-80669442 None] Acquiring lock "cinder-5db9a69c-3ed1-4e9a-a19a-cfbf22a66fe9-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:55:58 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-4ecfd5a3-485c-4fb9-8c19-658e036ff199 tempest-VolumesListTestJSON-80669442 None] Lock "cinder-5db9a69c-3ed1-4e9a-a19a-cfbf22a66fe9-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:55:58 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-4ecfd5a3-485c-4fb9-8c19-658e036ff199 tempest-VolumesListTestJSON-80669442 None] Acquiring lock "cinder-quobyte-5db9a69c-3ed1-4e9a-a19a-cfbf22a66fe9" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:55:58 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-4ecfd5a3-485c-4fb9-8c19-658e036ff199 tempest-VolumesListTestJSON-80669442 None] Lock "cinder-quobyte-5db9a69c-3ed1-4e9a-a19a-cfbf22a66fe9" acquired by "delete_volume" :: waited 0.006s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:55:58 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[9096b89b-4ae6-4654-8a63-d6b1e7006cb2]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:55:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4ecfd5a3-485c-4fb9-8c19-658e036ff199 tempest-VolumesListTestJSON-80669442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5db9a69c-3ed1-4e9a-a19a-cfbf22a66fe9 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:59 devstack sudo[87491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5db9a69c-3ed1-4e9a-a19a-cfbf22a66fe9
Apr 15 15:55:59 devstack sudo[87491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:59 devstack sudo[87489]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:59 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-a79b2dab-16df-4b4d-afdf-231d0bfda66b tempest-SnapshotsActionsTest-1652539038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.adf07162-bf97-4787-8d3f-0baa4bcd5051" returned: 0 in 0.473s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:59 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-a79b2dab-16df-4b4d-afdf-231d0bfda66b tempest-SnapshotsActionsTest-1652539038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78b33a64-cdae-492e-abdb-20e2c1f058cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82485) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 15:55:59 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-a79b2dab-16df-4b4d-afdf-231d0bfda66b tempest-SnapshotsActionsTest-1652539038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.4cfde7ca-4c2e-4efd-9614-a0f82df9e502 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:59 devstack sudo[87496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.4cfde7ca-4c2e-4efd-9614-a0f82df9e502
Apr 15 15:55:59 devstack sudo[87496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:59 devstack sudo[87491]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:59 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4ecfd5a3-485c-4fb9-8c19-658e036ff199 tempest-VolumesListTestJSON-80669442 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5db9a69c-3ed1-4e9a-a19a-cfbf22a66fe9" returned: 0 in 0.482s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:59 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4ecfd5a3-485c-4fb9-8c19-658e036ff199 tempest-VolumesListTestJSON-80669442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5db9a69c-3ed1-4e9a-a19a-cfbf22a66fe9 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:59 devstack sudo[87501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5db9a69c-3ed1-4e9a-a19a-cfbf22a66fe9
Apr 15 15:55:59 devstack sudo[87501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:59 devstack cinder-volume[82485]: DEBUG cinder.coordination [req-aaa282e9-07bf-4549-840e-c0abad56d9c6 req-a0b1805c-b7b8-48be-832d-0f0463856246 tempest-VolumesGetTestJSON-34376584 None] Acquiring lock "cinder-d83c9b0d-4b7a-4000-964f-6b0745e4f804-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:55:59 devstack cinder-volume[82485]: DEBUG cinder.coordination [req-aaa282e9-07bf-4549-840e-c0abad56d9c6 req-a0b1805c-b7b8-48be-832d-0f0463856246 tempest-VolumesGetTestJSON-34376584 None] Lock "cinder-d83c9b0d-4b7a-4000-964f-6b0745e4f804-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:55:59 devstack cinder-volume[82485]: DEBUG cinder.coordination [req-aaa282e9-07bf-4549-840e-c0abad56d9c6 req-a0b1805c-b7b8-48be-832d-0f0463856246 tempest-VolumesGetTestJSON-34376584 None] Acquiring lock "cinder-quobyte-d83c9b0d-4b7a-4000-964f-6b0745e4f804" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:55:59 devstack cinder-volume[82485]: DEBUG cinder.coordination [req-aaa282e9-07bf-4549-840e-c0abad56d9c6 req-a0b1805c-b7b8-48be-832d-0f0463856246 tempest-VolumesGetTestJSON-34376584 None] Lock "cinder-quobyte-d83c9b0d-4b7a-4000-964f-6b0745e4f804" acquired by "delete_volume" :: waited 0.009s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:55:59 devstack sudo[87496]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:59 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-a79b2dab-16df-4b4d-afdf-231d0bfda66b tempest-SnapshotsActionsTest-1652539038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.4cfde7ca-4c2e-4efd-9614-a0f82df9e502" returned: 0 in 0.537s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:59 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-a79b2dab-16df-4b4d-afdf-231d0bfda66b tempest-SnapshotsActionsTest-1652539038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.4cfde7ca-4c2e-4efd-9614-a0f82df9e502 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:59 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[247c338d-fc01-4b15-a4ad-b608296ce399]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:55:59 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-aaa282e9-07bf-4549-840e-c0abad56d9c6 req-a0b1805c-b7b8-48be-832d-0f0463856246 tempest-VolumesGetTestJSON-34376584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-d83c9b0d-4b7a-4000-964f-6b0745e4f804 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:59 devstack sudo[87506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.4cfde7ca-4c2e-4efd-9614-a0f82df9e502
Apr 15 15:55:59 devstack sudo[87506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:59 devstack sudo[87507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-d83c9b0d-4b7a-4000-964f-6b0745e4f804
Apr 15 15:55:59 devstack sudo[87507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:55:59 devstack sudo[87501]: pam_unix(sudo:session): session closed for user root
Apr 15 15:55:59 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4ecfd5a3-485c-4fb9-8c19-658e036ff199 tempest-VolumesListTestJSON-80669442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-5db9a69c-3ed1-4e9a-a19a-cfbf22a66fe9" returned: 0 in 0.420s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:55:59 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-4ecfd5a3-485c-4fb9-8c19-658e036ff199 tempest-VolumesListTestJSON-80669442 None] Lock "cinder-quobyte-5db9a69c-3ed1-4e9a-a19a-cfbf22a66fe9" released by "delete_volume" :: held 0.924s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:55:59 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-4ecfd5a3-485c-4fb9-8c19-658e036ff199 tempest-VolumesListTestJSON-80669442 None] Created reservations ['d6cb26ca-b3fe-4343-bf42-ee910cd26a5a', '46b49ebd-1832-4206-8142-b3c73fa4d33c', 'f499c478-7273-4df5-ba1c-363543b81488', '04102939-282c-4373-910a-9ac614b7aa1e'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:55:59 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-4ecfd5a3-485c-4fb9-8c19-658e036ff199 tempest-VolumesListTestJSON-80669442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:55:59 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-4ecfd5a3-485c-4fb9-8c19-658e036ff199 tempest-VolumesListTestJSON-80669442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:55:59 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-4ecfd5a3-485c-4fb9-8c19-658e036ff199 tempest-VolumesListTestJSON-80669442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:55:59 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-4ecfd5a3-485c-4fb9-8c19-658e036ff199 tempest-VolumesListTestJSON-80669442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:55:59 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-4ecfd5a3-485c-4fb9-8c19-658e036ff199 tempest-VolumesListTestJSON-80669442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:55:59 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4ecfd5a3-485c-4fb9-8c19-658e036ff199 tempest-VolumesListTestJSON-80669442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:55:59 devstack sudo[87511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:55:59 devstack sudo[87511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:00 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-99a1bd5a-f000-43d3-b7a8-26ab91f6df7c tempest-VolumesListTestJSON-80669442 None] Acquiring lock "cinder-feeaa5cc-bbe6-4f7a-b93c-7f9cb9b6f4f2-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:56:00 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-99a1bd5a-f000-43d3-b7a8-26ab91f6df7c tempest-VolumesListTestJSON-80669442 None] Lock "cinder-feeaa5cc-bbe6-4f7a-b93c-7f9cb9b6f4f2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:56:00 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-99a1bd5a-f000-43d3-b7a8-26ab91f6df7c tempest-VolumesListTestJSON-80669442 None] Acquiring lock "cinder-quobyte-feeaa5cc-bbe6-4f7a-b93c-7f9cb9b6f4f2" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:56:00 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-99a1bd5a-f000-43d3-b7a8-26ab91f6df7c tempest-VolumesListTestJSON-80669442 None] Lock "cinder-quobyte-feeaa5cc-bbe6-4f7a-b93c-7f9cb9b6f4f2" acquired by "delete_volume" :: waited 0.014s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:56:00 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20f86d4-77bf-4230-81fb-2a5475169d8d]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:56:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-99a1bd5a-f000-43d3-b7a8-26ab91f6df7c tempest-VolumesListTestJSON-80669442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-feeaa5cc-bbe6-4f7a-b93c-7f9cb9b6f4f2 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:00 devstack sudo[87506]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-a79b2dab-16df-4b4d-afdf-231d0bfda66b tempest-SnapshotsActionsTest-1652539038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.4cfde7ca-4c2e-4efd-9614-a0f82df9e502" returned: 0 in 0.473s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:00 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-a79b2dab-16df-4b4d-afdf-231d0bfda66b tempest-SnapshotsActionsTest-1652539038 None] Lock "cinder-quobyte-4cfde7ca-4c2e-4efd-9614-a0f82df9e502" released by "_delete_snapshot" :: held 2.029s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:56:00 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-a79b2dab-16df-4b4d-afdf-231d0bfda66b tempest-SnapshotsActionsTest-1652539038 None] Lock "cinder-quobyte-78b33a64-cdae-492e-abdb-20e2c1f058cb" released by "delete_snapshot" :: held 2.049s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:56:00 devstack sudo[87514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-feeaa5cc-bbe6-4f7a-b93c-7f9cb9b6f4f2
Apr 15 15:56:00 devstack sudo[87514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:00 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-a79b2dab-16df-4b4d-afdf-231d0bfda66b tempest-SnapshotsActionsTest-1652539038 None] Created reservations ['a0ab34bd-c7b3-4ed9-ba19-02b805ff3f38', '16529ee9-7b14-478a-8b83-5c54c2266313', '009eb9e7-b610-41ae-be32-d899f4d1abef', 'bc338ee5-ff65-4f05-84e1-4b2d153866af'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:56:00 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-a79b2dab-16df-4b4d-afdf-231d0bfda66b tempest-SnapshotsActionsTest-1652539038 None] Delete snapshot completed successfully.
Apr 15 15:56:00 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-a79b2dab-16df-4b4d-afdf-231d0bfda66b tempest-SnapshotsActionsTest-1652539038 None] Lock "cinder-4cfde7ca-4c2e-4efd-9614-a0f82df9e502-delete_snapshot" released by "delete_snapshot" :: held 2.153s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:56:00 devstack sudo[87507]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-aaa282e9-07bf-4549-840e-c0abad56d9c6 req-a0b1805c-b7b8-48be-832d-0f0463856246 tempest-VolumesGetTestJSON-34376584 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-d83c9b0d-4b7a-4000-964f-6b0745e4f804" returned: 0 in 0.590s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-aaa282e9-07bf-4549-840e-c0abad56d9c6 req-a0b1805c-b7b8-48be-832d-0f0463856246 tempest-VolumesGetTestJSON-34376584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-d83c9b0d-4b7a-4000-964f-6b0745e4f804 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:00 devstack sudo[87519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-d83c9b0d-4b7a-4000-964f-6b0745e4f804
Apr 15 15:56:00 devstack sudo[87519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:00 devstack sudo[87511]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4ecfd5a3-485c-4fb9-8c19-658e036ff199 tempest-VolumesListTestJSON-80669442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.488s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:00 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-4ecfd5a3-485c-4fb9-8c19-658e036ff199 tempest-VolumesListTestJSON-80669442 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:56:00 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-4ecfd5a3-485c-4fb9-8c19-658e036ff199 tempest-VolumesListTestJSON-80669442 None] Deleted volume successfully.
Apr 15 15:56:00 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-4ecfd5a3-485c-4fb9-8c19-658e036ff199 tempest-VolumesListTestJSON-80669442 None] Lock "cinder-5db9a69c-3ed1-4e9a-a19a-cfbf22a66fe9-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:56:00 devstack sudo[87514]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-99a1bd5a-f000-43d3-b7a8-26ab91f6df7c tempest-VolumesListTestJSON-80669442 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-feeaa5cc-bbe6-4f7a-b93c-7f9cb9b6f4f2" returned: 0 in 0.512s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-99a1bd5a-f000-43d3-b7a8-26ab91f6df7c tempest-VolumesListTestJSON-80669442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-feeaa5cc-bbe6-4f7a-b93c-7f9cb9b6f4f2 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:00 devstack sudo[87525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-feeaa5cc-bbe6-4f7a-b93c-7f9cb9b6f4f2
Apr 15 15:56:00 devstack sudo[87525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:00 devstack sudo[87519]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-aaa282e9-07bf-4549-840e-c0abad56d9c6 req-a0b1805c-b7b8-48be-832d-0f0463856246 tempest-VolumesGetTestJSON-34376584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-d83c9b0d-4b7a-4000-964f-6b0745e4f804" returned: 0 in 0.454s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:00 devstack cinder-volume[82485]: DEBUG cinder.coordination [req-aaa282e9-07bf-4549-840e-c0abad56d9c6 req-a0b1805c-b7b8-48be-832d-0f0463856246 tempest-VolumesGetTestJSON-34376584 None] Lock "cinder-quobyte-d83c9b0d-4b7a-4000-964f-6b0745e4f804" released by "delete_volume" :: held 1.075s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:56:00 devstack cinder-volume[82485]: DEBUG cinder.quota [req-aaa282e9-07bf-4549-840e-c0abad56d9c6 req-a0b1805c-b7b8-48be-832d-0f0463856246 tempest-VolumesGetTestJSON-34376584 None] Created reservations ['dcae2481-e5fb-4165-bdbb-f9a19c030a53', '372477df-4e9f-4f59-89fa-66a4531ce4c5', '156a5cf0-0935-484c-a351-5b0e57d4d626', '913d53e5-dbbf-4c93-b233-3649b22f3419'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:56:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [req-aaa282e9-07bf-4549-840e-c0abad56d9c6 req-a0b1805c-b7b8-48be-832d-0f0463856246 tempest-VolumesGetTestJSON-34376584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:56:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [req-aaa282e9-07bf-4549-840e-c0abad56d9c6 req-a0b1805c-b7b8-48be-832d-0f0463856246 tempest-VolumesGetTestJSON-34376584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:56:00 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [req-aaa282e9-07bf-4549-840e-c0abad56d9c6 req-a0b1805c-b7b8-48be-832d-0f0463856246 tempest-VolumesGetTestJSON-34376584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:56:00 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [req-aaa282e9-07bf-4549-840e-c0abad56d9c6 req-a0b1805c-b7b8-48be-832d-0f0463856246 tempest-VolumesGetTestJSON-34376584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:56:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [req-aaa282e9-07bf-4549-840e-c0abad56d9c6 req-a0b1805c-b7b8-48be-832d-0f0463856246 tempest-VolumesGetTestJSON-34376584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:56:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-aaa282e9-07bf-4549-840e-c0abad56d9c6 req-a0b1805c-b7b8-48be-832d-0f0463856246 tempest-VolumesGetTestJSON-34376584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:00 devstack sudo[87528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:56:00 devstack sudo[87528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:01 devstack sudo[87525]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:01 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-99a1bd5a-f000-43d3-b7a8-26ab91f6df7c tempest-VolumesListTestJSON-80669442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-feeaa5cc-bbe6-4f7a-b93c-7f9cb9b6f4f2" returned: 0 in 0.486s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:01 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-99a1bd5a-f000-43d3-b7a8-26ab91f6df7c tempest-VolumesListTestJSON-80669442 None] Lock "cinder-quobyte-feeaa5cc-bbe6-4f7a-b93c-7f9cb9b6f4f2" released by "delete_volume" :: held 1.021s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:56:01 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-99a1bd5a-f000-43d3-b7a8-26ab91f6df7c tempest-VolumesListTestJSON-80669442 None] Created reservations ['c1d67422-7232-486d-b1fa-59ba680482dd', 'a7bc8e13-95eb-46d9-b36a-03c05b4a4bb1', 'd51b6a65-d469-434a-9f90-0b514e03c86f', '79742558-a5f7-4c6d-9323-8764489b8bff'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:56:01 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-99a1bd5a-f000-43d3-b7a8-26ab91f6df7c tempest-VolumesListTestJSON-80669442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:56:01 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-99a1bd5a-f000-43d3-b7a8-26ab91f6df7c tempest-VolumesListTestJSON-80669442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:56:01 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-99a1bd5a-f000-43d3-b7a8-26ab91f6df7c tempest-VolumesListTestJSON-80669442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:56:01 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-99a1bd5a-f000-43d3-b7a8-26ab91f6df7c tempest-VolumesListTestJSON-80669442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:56:01 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-99a1bd5a-f000-43d3-b7a8-26ab91f6df7c tempest-VolumesListTestJSON-80669442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:56:01 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-99a1bd5a-f000-43d3-b7a8-26ab91f6df7c tempest-VolumesListTestJSON-80669442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:01 devstack sudo[87532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:56:01 devstack sudo[87532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:01 devstack sudo[87528]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:01 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [req-aaa282e9-07bf-4549-840e-c0abad56d9c6 req-a0b1805c-b7b8-48be-832d-0f0463856246 tempest-VolumesGetTestJSON-34376584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.466s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:01 devstack cinder-volume[82485]: DEBUG cinder.manager [req-aaa282e9-07bf-4549-840e-c0abad56d9c6 req-a0b1805c-b7b8-48be-832d-0f0463856246 tempest-VolumesGetTestJSON-34376584 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:56:01 devstack cinder-volume[82485]: INFO cinder.volume.manager [req-aaa282e9-07bf-4549-840e-c0abad56d9c6 req-a0b1805c-b7b8-48be-832d-0f0463856246 tempest-VolumesGetTestJSON-34376584 None] Deleted volume successfully.
Apr 15 15:56:01 devstack cinder-volume[82485]: DEBUG cinder.coordination [req-aaa282e9-07bf-4549-840e-c0abad56d9c6 req-a0b1805c-b7b8-48be-832d-0f0463856246 tempest-VolumesGetTestJSON-34376584 None] Lock "cinder-d83c9b0d-4b7a-4000-964f-6b0745e4f804-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:56:01 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-bf34accf-f0a9-4003-b558-c935e71d94c7 tempest-SnapshotsActionsTest-682265405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:56:01 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-bf34accf-f0a9-4003-b558-c935e71d94c7 tempest-SnapshotsActionsTest-682265405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:56:01 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-bf34accf-f0a9-4003-b558-c935e71d94c7 tempest-SnapshotsActionsTest-682265405 None] Creating offline snapshot bc37b300-30c8-4e53-b274-9fe19e4e1c01 of volume 78b33a64-cdae-492e-abdb-20e2c1f058cb {{(pid=82485) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 15:56:01 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[8174bd7f-0856-4956-b72d-9dd02c792800]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:56:01 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-bf34accf-f0a9-4003-b558-c935e71d94c7 tempest-SnapshotsActionsTest-682265405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.adf07162-bf97-4787-8d3f-0baa4bcd5051 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:01 devstack sudo[87534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.adf07162-bf97-4787-8d3f-0baa4bcd5051
Apr 15 15:56:01 devstack sudo[87534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:01 devstack sudo[87532]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:01 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-99a1bd5a-f000-43d3-b7a8-26ab91f6df7c tempest-VolumesListTestJSON-80669442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.491s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:01 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-99a1bd5a-f000-43d3-b7a8-26ab91f6df7c tempest-VolumesListTestJSON-80669442 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:56:01 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-99a1bd5a-f000-43d3-b7a8-26ab91f6df7c tempest-VolumesListTestJSON-80669442 None] Deleted volume successfully.
Apr 15 15:56:01 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-99a1bd5a-f000-43d3-b7a8-26ab91f6df7c tempest-VolumesListTestJSON-80669442 None] Lock "cinder-feeaa5cc-bbe6-4f7a-b93c-7f9cb9b6f4f2-delete_volume" released by "delete_volume" :: held 1.697s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:56:02 devstack sudo[87534]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:02 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-bf34accf-f0a9-4003-b558-c935e71d94c7 tempest-SnapshotsActionsTest-682265405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.adf07162-bf97-4787-8d3f-0baa4bcd5051" returned: 0 in 0.526s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:02 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-bf34accf-f0a9-4003-b558-c935e71d94c7 tempest-SnapshotsActionsTest-682265405 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78b33a64-cdae-492e-abdb-20e2c1f058cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82485) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 15:56:02 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-bf34accf-f0a9-4003-b558-c935e71d94c7 tempest-SnapshotsActionsTest-682265405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.adf07162-bf97-4787-8d3f-0baa4bcd5051,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.bc37b300-30c8-4e53-b274-9fe19e4e1c01 1G {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:02 devstack sudo[87540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.adf07162-bf97-4787-8d3f-0baa4bcd5051,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.bc37b300-30c8-4e53-b274-9fe19e4e1c01 1G
Apr 15 15:56:02 devstack sudo[87540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:02 devstack sudo[87540]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:02 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-bf34accf-f0a9-4003-b558-c935e71d94c7 tempest-SnapshotsActionsTest-682265405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.adf07162-bf97-4787-8d3f-0baa4bcd5051,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.bc37b300-30c8-4e53-b274-9fe19e4e1c01 1G" returned: 0 in 0.605s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:02 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-bf34accf-f0a9-4003-b558-c935e71d94c7 tempest-SnapshotsActionsTest-682265405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.adf07162-bf97-4787-8d3f-0baa4bcd5051 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.bc37b300-30c8-4e53-b274-9fe19e4e1c01 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:02 devstack sudo[87545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.adf07162-bf97-4787-8d3f-0baa4bcd5051 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.bc37b300-30c8-4e53-b274-9fe19e4e1c01
Apr 15 15:56:02 devstack sudo[87545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:03 devstack sudo[87545]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:03 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-bf34accf-f0a9-4003-b558-c935e71d94c7 tempest-SnapshotsActionsTest-682265405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.adf07162-bf97-4787-8d3f-0baa4bcd5051 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.bc37b300-30c8-4e53-b274-9fe19e4e1c01" returned: 0 in 0.546s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:03 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-bf34accf-f0a9-4003-b558-c935e71d94c7 tempest-SnapshotsActionsTest-682265405 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.bc37b300-30c8-4e53-b274-9fe19e4e1c01 is being set with open permissions: ugo+rw
Apr 15 15:56:03 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-bf34accf-f0a9-4003-b558-c935e71d94c7 tempest-SnapshotsActionsTest-682265405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.bc37b300-30c8-4e53-b274-9fe19e4e1c01 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:03 devstack sudo[87550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.bc37b300-30c8-4e53-b274-9fe19e4e1c01
Apr 15 15:56:03 devstack sudo[87550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:03 devstack sudo[87550]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:03 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-bf34accf-f0a9-4003-b558-c935e71d94c7 tempest-SnapshotsActionsTest-682265405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.bc37b300-30c8-4e53-b274-9fe19e4e1c01" returned: 0 in 0.519s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:03 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-bf34accf-f0a9-4003-b558-c935e71d94c7 tempest-SnapshotsActionsTest-682265405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.262s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:56:03 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-bf34accf-f0a9-4003-b558-c935e71d94c7 tempest-SnapshotsActionsTest-682265405 None] Create snapshot completed successfully
Apr 15 15:56:04 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-044b4387-ef36-4c3f-89e0-664097f324cd tempest-VolumesNegativeTest-1226130539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:56:04 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-044b4387-ef36-4c3f-89e0-664097f324cd tempest-VolumesNegativeTest-1226130539 None] Flow 'volume_create_manager' (c1fd6774-67a9-43ef-af2e-25ca5d04f1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:56:04 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-044b4387-ef36-4c3f-89e0-664097f324cd tempest-VolumesNegativeTest-1226130539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2760ea08-c7b6-4ec5-a531-7deec1526d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:56:04 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-044b4387-ef36-4c3f-89e0-664097f324cd tempest-VolumesNegativeTest-1226130539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2760ea08-c7b6-4ec5-a531-7deec1526d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:56:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-869676435',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51e16d55-8ca3-43f0-b725-35505a91118a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d56128b86329404d8483445370c9def5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:56:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:56:04Z,use_quota=True,user_id='42763e2a78c1412ea60b583b0bdfcd1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:56:04 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-044b4387-ef36-4c3f-89e0-664097f324cd tempest-VolumesNegativeTest-1226130539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (354a7af8-168d-4c78-b36f-3f727e7d4a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:56:04 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-044b4387-ef36-4c3f-89e0-664097f324cd tempest-VolumesNegativeTest-1226130539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (354a7af8-168d-4c78-b36f-3f727e7d4a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:56:04 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-044b4387-ef36-4c3f-89e0-664097f324cd tempest-VolumesNegativeTest-1226130539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c298e8b2-ac3d-4dc6-a932-46fc3ad382f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:56:04 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-044b4387-ef36-4c3f-89e0-664097f324cd tempest-VolumesNegativeTest-1226130539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c298e8b2-ac3d-4dc6-a932-46fc3ad382f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51e16d55-8ca3-43f0-b725-35505a91118a', 'volume_name': 'volume-51e16d55-8ca3-43f0-b725-35505a91118a', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:56:04 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-044b4387-ef36-4c3f-89e0-664097f324cd tempest-VolumesNegativeTest-1226130539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56f79464-c5ab-408d-a95f-085b0b211dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:56:04 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-044b4387-ef36-4c3f-89e0-664097f324cd tempest-VolumesNegativeTest-1226130539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56f79464-c5ab-408d-a95f-085b0b211dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:56:04 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-044b4387-ef36-4c3f-89e0-664097f324cd tempest-VolumesNegativeTest-1226130539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c1deb8b-ce8a-487e-9697-1ebdc1d2bf2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:56:04 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-044b4387-ef36-4c3f-89e0-664097f324cd tempest-VolumesNegativeTest-1226130539 None] Volume 51e16d55-8ca3-43f0-b725-35505a91118a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51e16d55-8ca3-43f0-b725-35505a91118a', 'volume_size': 1}
Apr 15 15:56:04 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-044b4387-ef36-4c3f-89e0-664097f324cd tempest-VolumesNegativeTest-1226130539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:56:04 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-044b4387-ef36-4c3f-89e0-664097f324cd tempest-VolumesNegativeTest-1226130539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:56:04 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-044b4387-ef36-4c3f-89e0-664097f324cd tempest-VolumesNegativeTest-1226130539 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:56:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-869676435',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51e16d55-8ca3-43f0-b725-35505a91118a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d56128b86329404d8483445370c9def5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:56:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:56:04Z,use_quota=True,user_id='42763e2a78c1412ea60b583b0bdfcd1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:56:04 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-044b4387-ef36-4c3f-89e0-664097f324cd tempest-VolumesNegativeTest-1226130539 None] Creating volume 51e16d55-8ca3-43f0-b725-35505a91118a {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:56:04 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-044b4387-ef36-4c3f-89e0-664097f324cd tempest-VolumesNegativeTest-1226130539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:56:04 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-044b4387-ef36-4c3f-89e0-664097f324cd tempest-VolumesNegativeTest-1226130539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:56:04 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-044b4387-ef36-4c3f-89e0-664097f324cd tempest-VolumesNegativeTest-1226130539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:56:04 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-044b4387-ef36-4c3f-89e0-664097f324cd tempest-VolumesNegativeTest-1226130539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:56:04 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-044b4387-ef36-4c3f-89e0-664097f324cd tempest-VolumesNegativeTest-1226130539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:56:04 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-044b4387-ef36-4c3f-89e0-664097f324cd tempest-VolumesNegativeTest-1226130539 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:56:04 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-044b4387-ef36-4c3f-89e0-664097f324cd tempest-VolumesNegativeTest-1226130539 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:56:04 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-044b4387-ef36-4c3f-89e0-664097f324cd tempest-VolumesNegativeTest-1226130539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-51e16d55-8ca3-43f0-b725-35505a91118a 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:04 devstack sudo[87553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-51e16d55-8ca3-43f0-b725-35505a91118a 1073741824
Apr 15 15:56:04 devstack sudo[87553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:04 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-e492b6e4-626f-403f-8ced-1123ac2fe216 tempest-SnapshotsActionsTest-1652539038 None] Acquiring lock "cinder-bc37b300-30c8-4e53-b274-9fe19e4e1c01-delete_snapshot" by "delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:56:04 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-e492b6e4-626f-403f-8ced-1123ac2fe216 tempest-SnapshotsActionsTest-1652539038 None] Lock "cinder-bc37b300-30c8-4e53-b274-9fe19e4e1c01-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:56:04 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-e492b6e4-626f-403f-8ced-1123ac2fe216 tempest-SnapshotsActionsTest-1652539038 None] Acquiring lock "cinder-quobyte-78b33a64-cdae-492e-abdb-20e2c1f058cb" by "delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:56:04 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-e492b6e4-626f-403f-8ced-1123ac2fe216 tempest-SnapshotsActionsTest-1652539038 None] Lock "cinder-quobyte-78b33a64-cdae-492e-abdb-20e2c1f058cb" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:56:04 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-e492b6e4-626f-403f-8ced-1123ac2fe216 tempest-SnapshotsActionsTest-1652539038 None] Acquiring lock "cinder-quobyte-bc37b300-30c8-4e53-b274-9fe19e4e1c01" by "_delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:56:04 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-e492b6e4-626f-403f-8ced-1123ac2fe216 tempest-SnapshotsActionsTest-1652539038 None] Lock "cinder-quobyte-bc37b300-30c8-4e53-b274-9fe19e4e1c01" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:56:04 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-e492b6e4-626f-403f-8ced-1123ac2fe216 tempest-SnapshotsActionsTest-1652539038 None] Deleting offline snapshot bc37b300-30c8-4e53-b274-9fe19e4e1c01 of volume 78b33a64-cdae-492e-abdb-20e2c1f058cb {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 15:56:04 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-e492b6e4-626f-403f-8ced-1123ac2fe216 tempest-SnapshotsActionsTest-1652539038 None] snapshot_file for this snap is: volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.bc37b300-30c8-4e53-b274-9fe19e4e1c01 {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 15:56:04 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[e998e301-aa35-44f8-a152-3ba0802606c0]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:56:04 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-e492b6e4-626f-403f-8ced-1123ac2fe216 tempest-SnapshotsActionsTest-1652539038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.bc37b300-30c8-4e53-b274-9fe19e4e1c01 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:04 devstack sudo[87559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.bc37b300-30c8-4e53-b274-9fe19e4e1c01
Apr 15 15:56:04 devstack sudo[87559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:04 devstack sudo[87553]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:04 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-044b4387-ef36-4c3f-89e0-664097f324cd tempest-VolumesNegativeTest-1226130539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-51e16d55-8ca3-43f0-b725-35505a91118a 1073741824" returned: 0 in 0.528s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:04 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-044b4387-ef36-4c3f-89e0-664097f324cd tempest-VolumesNegativeTest-1226130539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-51e16d55-8ca3-43f0-b725-35505a91118a {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:04 devstack sudo[87561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-51e16d55-8ca3-43f0-b725-35505a91118a
Apr 15 15:56:04 devstack sudo[87561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:05 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-ca339a56-35c0-4521-a712-805533f8b1f9 tempest-BackendsCapabilitiesAdminTestsJSON-1278881821 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.732810974121, 'free_capacity_gb': 1775.732810974121, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82485) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 15 15:56:05 devstack sudo[87559]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:05 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-e492b6e4-626f-403f-8ced-1123ac2fe216 tempest-SnapshotsActionsTest-1652539038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.bc37b300-30c8-4e53-b274-9fe19e4e1c01" returned: 0 in 0.518s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:05 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-e492b6e4-626f-403f-8ced-1123ac2fe216 tempest-SnapshotsActionsTest-1652539038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78b33a64-cdae-492e-abdb-20e2c1f058cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82485) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 15:56:05 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[617543ce-1969-45a6-b547-6e4dcfc5a709]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:56:05 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-e492b6e4-626f-403f-8ced-1123ac2fe216 tempest-SnapshotsActionsTest-1652539038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.adf07162-bf97-4787-8d3f-0baa4bcd5051 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:05 devstack sudo[87561]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:05 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-044b4387-ef36-4c3f-89e0-664097f324cd tempest-VolumesNegativeTest-1226130539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-51e16d55-8ca3-43f0-b725-35505a91118a" returned: 0 in 0.453s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:05 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-044b4387-ef36-4c3f-89e0-664097f324cd tempest-VolumesNegativeTest-1226130539 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:56:05 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-044b4387-ef36-4c3f-89e0-664097f324cd tempest-VolumesNegativeTest-1226130539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:56:05 devstack sudo[87567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.adf07162-bf97-4787-8d3f-0baa4bcd5051
Apr 15 15:56:05 devstack sudo[87567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:05 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-044b4387-ef36-4c3f-89e0-664097f324cd tempest-VolumesNegativeTest-1226130539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c1deb8b-ce8a-487e-9697-1ebdc1d2bf2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51e16d55-8ca3-43f0-b725-35505a91118a', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:56:05 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-044b4387-ef36-4c3f-89e0-664097f324cd tempest-VolumesNegativeTest-1226130539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22e6bb5f-69eb-4e59-958e-654e7da2620e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:56:05 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-044b4387-ef36-4c3f-89e0-664097f324cd tempest-VolumesNegativeTest-1226130539 None] Volume volume-51e16d55-8ca3-43f0-b725-35505a91118a (51e16d55-8ca3-43f0-b725-35505a91118a): created successfully
Apr 15 15:56:05 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-044b4387-ef36-4c3f-89e0-664097f324cd tempest-VolumesNegativeTest-1226130539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22e6bb5f-69eb-4e59-958e-654e7da2620e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:56:05 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-044b4387-ef36-4c3f-89e0-664097f324cd tempest-VolumesNegativeTest-1226130539 None] Flow 'volume_create_manager' (c1fd6774-67a9-43ef-af2e-25ca5d04f1c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:56:05 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-044b4387-ef36-4c3f-89e0-664097f324cd tempest-VolumesNegativeTest-1226130539 None] Created volume successfully.
Apr 15 15:56:05 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9e694d42-4339-48d4-9123-8dd88c294637 tempest-BackendsCapabilitiesAdminTestsJSON-1278881821 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.732810974121, 'free_capacity_gb': 1775.732810974121, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82485) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 15 15:56:05 devstack sudo[87567]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:05 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-e492b6e4-626f-403f-8ced-1123ac2fe216 tempest-SnapshotsActionsTest-1652539038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.adf07162-bf97-4787-8d3f-0baa4bcd5051" returned: 0 in 0.515s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:05 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-e492b6e4-626f-403f-8ced-1123ac2fe216 tempest-SnapshotsActionsTest-1652539038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78b33a64-cdae-492e-abdb-20e2c1f058cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82485) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 15:56:05 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-e492b6e4-626f-403f-8ced-1123ac2fe216 tempest-SnapshotsActionsTest-1652539038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.bc37b300-30c8-4e53-b274-9fe19e4e1c01 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:05 devstack sudo[87572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.bc37b300-30c8-4e53-b274-9fe19e4e1c01
Apr 15 15:56:05 devstack sudo[87572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:06 devstack sudo[87572]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:06 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-e492b6e4-626f-403f-8ced-1123ac2fe216 tempest-SnapshotsActionsTest-1652539038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.bc37b300-30c8-4e53-b274-9fe19e4e1c01" returned: 0 in 0.491s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:06 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-e492b6e4-626f-403f-8ced-1123ac2fe216 tempest-SnapshotsActionsTest-1652539038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.bc37b300-30c8-4e53-b274-9fe19e4e1c01 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:06 devstack sudo[87577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.bc37b300-30c8-4e53-b274-9fe19e4e1c01
Apr 15 15:56:06 devstack sudo[87577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:06 devstack sudo[87577]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:06 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-e492b6e4-626f-403f-8ced-1123ac2fe216 tempest-SnapshotsActionsTest-1652539038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.bc37b300-30c8-4e53-b274-9fe19e4e1c01" returned: 0 in 0.528s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:06 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-e492b6e4-626f-403f-8ced-1123ac2fe216 tempest-SnapshotsActionsTest-1652539038 None] Lock "cinder-quobyte-bc37b300-30c8-4e53-b274-9fe19e4e1c01" released by "_delete_snapshot" :: held 2.108s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:56:06 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-e492b6e4-626f-403f-8ced-1123ac2fe216 tempest-SnapshotsActionsTest-1652539038 None] Lock "cinder-quobyte-78b33a64-cdae-492e-abdb-20e2c1f058cb" released by "delete_snapshot" :: held 2.125s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:56:06 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-e492b6e4-626f-403f-8ced-1123ac2fe216 tempest-SnapshotsActionsTest-1652539038 None] Created reservations ['93d91027-ee26-485e-b349-8e5c4c6ac958', '745c3598-4597-4189-bf03-7e9bcb633a02', '635d8ee4-0281-403a-896a-b973c2df6fc9', '64310fe9-b0d8-45cd-b7cd-758d5c470e3d'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:56:06 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-e492b6e4-626f-403f-8ced-1123ac2fe216 tempest-SnapshotsActionsTest-1652539038 None] Delete snapshot completed successfully.
Apr 15 15:56:06 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-e492b6e4-626f-403f-8ced-1123ac2fe216 tempest-SnapshotsActionsTest-1652539038 None] Lock "cinder-bc37b300-30c8-4e53-b274-9fe19e4e1c01-delete_snapshot" released by "delete_snapshot" :: held 2.217s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:56:08 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-41360cc0-1e41-4377-baee-85767c0253af tempest-SnapshotsActionsTest-682265405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:56:08 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-41360cc0-1e41-4377-baee-85767c0253af tempest-SnapshotsActionsTest-682265405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:56:08 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-41360cc0-1e41-4377-baee-85767c0253af tempest-SnapshotsActionsTest-682265405 None] Creating offline snapshot 90791a23-4391-40e3-94ba-f19d49fcc01b of volume 78b33a64-cdae-492e-abdb-20e2c1f058cb {{(pid=82485) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 15:56:08 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a1c9e6-e761-4070-ae2e-4340dab39b6f]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:56:08 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-41360cc0-1e41-4377-baee-85767c0253af tempest-SnapshotsActionsTest-682265405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.adf07162-bf97-4787-8d3f-0baa4bcd5051 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:08 devstack sudo[87584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.adf07162-bf97-4787-8d3f-0baa4bcd5051
Apr 15 15:56:08 devstack sudo[87584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:08 devstack sudo[87584]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:08 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-41360cc0-1e41-4377-baee-85767c0253af tempest-SnapshotsActionsTest-682265405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.adf07162-bf97-4787-8d3f-0baa4bcd5051" returned: 0 in 0.545s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:08 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-41360cc0-1e41-4377-baee-85767c0253af tempest-SnapshotsActionsTest-682265405 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78b33a64-cdae-492e-abdb-20e2c1f058cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82485) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 15:56:08 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-41360cc0-1e41-4377-baee-85767c0253af tempest-SnapshotsActionsTest-682265405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.adf07162-bf97-4787-8d3f-0baa4bcd5051,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.90791a23-4391-40e3-94ba-f19d49fcc01b 1G {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:08 devstack sudo[87589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.adf07162-bf97-4787-8d3f-0baa4bcd5051,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.90791a23-4391-40e3-94ba-f19d49fcc01b 1G
Apr 15 15:56:08 devstack sudo[87589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:09 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-9f5198c3-385c-4c2b-a191-7982d6a6b1a2 tempest-GroupsV320Test-535014281 None] Group tempest-GroupsV320Test-Group-1073030945: creating
Apr 15 15:56:09 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-9f5198c3-385c-4c2b-a191-7982d6a6b1a2 tempest-GroupsV320Test-535014281 None] Group tempest-GroupsV320Test-Group-1073030945: created successfully
Apr 15 15:56:09 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-9f5198c3-385c-4c2b-a191-7982d6a6b1a2 tempest-GroupsV320Test-535014281 None] Create group completed successfully.
Apr 15 15:56:09 devstack sudo[87589]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:09 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-41360cc0-1e41-4377-baee-85767c0253af tempest-SnapshotsActionsTest-682265405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.adf07162-bf97-4787-8d3f-0baa4bcd5051,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.90791a23-4391-40e3-94ba-f19d49fcc01b 1G" returned: 0 in 0.611s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:09 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-41360cc0-1e41-4377-baee-85767c0253af tempest-SnapshotsActionsTest-682265405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.adf07162-bf97-4787-8d3f-0baa4bcd5051 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.90791a23-4391-40e3-94ba-f19d49fcc01b {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:09 devstack sudo[87594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.adf07162-bf97-4787-8d3f-0baa4bcd5051 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.90791a23-4391-40e3-94ba-f19d49fcc01b
Apr 15 15:56:09 devstack sudo[87594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:09 devstack sudo[87594]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:09 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-41360cc0-1e41-4377-baee-85767c0253af tempest-SnapshotsActionsTest-682265405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.adf07162-bf97-4787-8d3f-0baa4bcd5051 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.90791a23-4391-40e3-94ba-f19d49fcc01b" returned: 0 in 0.440s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:09 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-41360cc0-1e41-4377-baee-85767c0253af tempest-SnapshotsActionsTest-682265405 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.90791a23-4391-40e3-94ba-f19d49fcc01b is being set with open permissions: ugo+rw
Apr 15 15:56:09 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-41360cc0-1e41-4377-baee-85767c0253af tempest-SnapshotsActionsTest-682265405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.90791a23-4391-40e3-94ba-f19d49fcc01b {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:09 devstack sudo[87599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.90791a23-4391-40e3-94ba-f19d49fcc01b
Apr 15 15:56:09 devstack sudo[87599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:10 devstack sudo[87599]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-41360cc0-1e41-4377-baee-85767c0253af tempest-SnapshotsActionsTest-682265405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.90791a23-4391-40e3-94ba-f19d49fcc01b" returned: 0 in 0.426s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-41360cc0-1e41-4377-baee-85767c0253af tempest-SnapshotsActionsTest-682265405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.101s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:56:10 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-41360cc0-1e41-4377-baee-85767c0253af tempest-SnapshotsActionsTest-682265405 None] Create snapshot completed successfully
Apr 15 15:56:10 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-00b7c756-1d78-41ef-8ca4-7f44c7d7b6a0 tempest-GroupsV320Test-535014281 None] Created reservations ['7d76cee5-cdd2-4eee-8613-4af7496c1c35'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:56:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-00b7c756-1d78-41ef-8ca4-7f44c7d7b6a0 tempest-GroupsV320Test-535014281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:56:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-00b7c756-1d78-41ef-8ca4-7f44c7d7b6a0 tempest-GroupsV320Test-535014281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:56:10 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-00b7c756-1d78-41ef-8ca4-7f44c7d7b6a0 tempest-GroupsV320Test-535014281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:56:10 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-00b7c756-1d78-41ef-8ca4-7f44c7d7b6a0 tempest-GroupsV320Test-535014281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:56:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-00b7c756-1d78-41ef-8ca4-7f44c7d7b6a0 tempest-GroupsV320Test-535014281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:56:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-00b7c756-1d78-41ef-8ca4-7f44c7d7b6a0 tempest-GroupsV320Test-535014281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:10 devstack sudo[87602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:56:10 devstack sudo[87602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:11 devstack sudo[87602]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:11 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-00b7c756-1d78-41ef-8ca4-7f44c7d7b6a0 tempest-GroupsV320Test-535014281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.440s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:11 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-00b7c756-1d78-41ef-8ca4-7f44c7d7b6a0 tempest-GroupsV320Test-535014281 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:56:11 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-00b7c756-1d78-41ef-8ca4-7f44c7d7b6a0 tempest-GroupsV320Test-535014281 None] Delete group completed successfully.
Apr 15 15:56:11 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-a7a5458d-cb24-4c08-85cc-e35b86ddeb1a tempest-SnapshotsActionsTest-1652539038 None] Acquiring lock "cinder-90791a23-4391-40e3-94ba-f19d49fcc01b-delete_snapshot" by "delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:56:11 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-a7a5458d-cb24-4c08-85cc-e35b86ddeb1a tempest-SnapshotsActionsTest-1652539038 None] Lock "cinder-90791a23-4391-40e3-94ba-f19d49fcc01b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:56:11 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-a7a5458d-cb24-4c08-85cc-e35b86ddeb1a tempest-SnapshotsActionsTest-1652539038 None] Acquiring lock "cinder-quobyte-78b33a64-cdae-492e-abdb-20e2c1f058cb" by "delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:56:11 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-a7a5458d-cb24-4c08-85cc-e35b86ddeb1a tempest-SnapshotsActionsTest-1652539038 None] Lock "cinder-quobyte-78b33a64-cdae-492e-abdb-20e2c1f058cb" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:56:11 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-a7a5458d-cb24-4c08-85cc-e35b86ddeb1a tempest-SnapshotsActionsTest-1652539038 None] Acquiring lock "cinder-quobyte-90791a23-4391-40e3-94ba-f19d49fcc01b" by "_delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:56:11 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-a7a5458d-cb24-4c08-85cc-e35b86ddeb1a tempest-SnapshotsActionsTest-1652539038 None] Lock "cinder-quobyte-90791a23-4391-40e3-94ba-f19d49fcc01b" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:56:11 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-a7a5458d-cb24-4c08-85cc-e35b86ddeb1a tempest-SnapshotsActionsTest-1652539038 None] Deleting offline snapshot 90791a23-4391-40e3-94ba-f19d49fcc01b of volume 78b33a64-cdae-492e-abdb-20e2c1f058cb {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 15:56:11 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-a7a5458d-cb24-4c08-85cc-e35b86ddeb1a tempest-SnapshotsActionsTest-1652539038 None] snapshot_file for this snap is: volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.90791a23-4391-40e3-94ba-f19d49fcc01b {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 15:56:11 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f540dfb-62c2-4ba8-84b1-917133d82815]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:56:11 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-a7a5458d-cb24-4c08-85cc-e35b86ddeb1a tempest-SnapshotsActionsTest-1652539038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.90791a23-4391-40e3-94ba-f19d49fcc01b {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:11 devstack sudo[87606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.90791a23-4391-40e3-94ba-f19d49fcc01b
Apr 15 15:56:11 devstack sudo[87606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:11 devstack sudo[87606]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:11 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-a7a5458d-cb24-4c08-85cc-e35b86ddeb1a tempest-SnapshotsActionsTest-1652539038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.90791a23-4391-40e3-94ba-f19d49fcc01b" returned: 0 in 0.560s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:11 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-a7a5458d-cb24-4c08-85cc-e35b86ddeb1a tempest-SnapshotsActionsTest-1652539038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78b33a64-cdae-492e-abdb-20e2c1f058cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82485) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 15:56:11 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe719f58-37c7-4749-9663-8f08988bfbd5]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:56:11 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-a7a5458d-cb24-4c08-85cc-e35b86ddeb1a tempest-SnapshotsActionsTest-1652539038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.adf07162-bf97-4787-8d3f-0baa4bcd5051 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:12 devstack sudo[87611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.adf07162-bf97-4787-8d3f-0baa4bcd5051
Apr 15 15:56:12 devstack sudo[87611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:12 devstack sudo[87611]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-a7a5458d-cb24-4c08-85cc-e35b86ddeb1a tempest-SnapshotsActionsTest-1652539038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.adf07162-bf97-4787-8d3f-0baa4bcd5051" returned: 0 in 0.637s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:12 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-a7a5458d-cb24-4c08-85cc-e35b86ddeb1a tempest-SnapshotsActionsTest-1652539038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78b33a64-cdae-492e-abdb-20e2c1f058cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82485) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 15:56:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-a7a5458d-cb24-4c08-85cc-e35b86ddeb1a tempest-SnapshotsActionsTest-1652539038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.90791a23-4391-40e3-94ba-f19d49fcc01b {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:12 devstack sudo[87616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.90791a23-4391-40e3-94ba-f19d49fcc01b
Apr 15 15:56:12 devstack sudo[87616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:13 devstack sudo[87616]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:13 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-a7a5458d-cb24-4c08-85cc-e35b86ddeb1a tempest-SnapshotsActionsTest-1652539038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.90791a23-4391-40e3-94ba-f19d49fcc01b" returned: 0 in 0.650s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:13 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-a7a5458d-cb24-4c08-85cc-e35b86ddeb1a tempest-SnapshotsActionsTest-1652539038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.90791a23-4391-40e3-94ba-f19d49fcc01b {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:13 devstack sudo[87622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.90791a23-4391-40e3-94ba-f19d49fcc01b
Apr 15 15:56:13 devstack sudo[87622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:13 devstack sudo[87622]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:13 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-a7a5458d-cb24-4c08-85cc-e35b86ddeb1a tempest-SnapshotsActionsTest-1652539038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.90791a23-4391-40e3-94ba-f19d49fcc01b" returned: 0 in 0.503s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:13 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-a7a5458d-cb24-4c08-85cc-e35b86ddeb1a tempest-SnapshotsActionsTest-1652539038 None] Lock "cinder-quobyte-90791a23-4391-40e3-94ba-f19d49fcc01b" released by "_delete_snapshot" :: held 2.428s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:56:13 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-a7a5458d-cb24-4c08-85cc-e35b86ddeb1a tempest-SnapshotsActionsTest-1652539038 None] Lock "cinder-quobyte-78b33a64-cdae-492e-abdb-20e2c1f058cb" released by "delete_snapshot" :: held 2.462s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:56:13 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-a7a5458d-cb24-4c08-85cc-e35b86ddeb1a tempest-SnapshotsActionsTest-1652539038 None] Created reservations ['40b52803-0469-4f87-8e28-7a1af834b547', '5b3c38cc-7a18-4783-a032-4c8eac535369', 'd2feb7f6-5259-4115-94d3-90578fea5c42', '034cc224-64a1-4630-9558-9d100c09ab5c'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:56:13 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-a7a5458d-cb24-4c08-85cc-e35b86ddeb1a tempest-SnapshotsActionsTest-1652539038 None] Delete snapshot completed successfully.
Apr 15 15:56:13 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-a7a5458d-cb24-4c08-85cc-e35b86ddeb1a tempest-SnapshotsActionsTest-1652539038 None] Lock "cinder-90791a23-4391-40e3-94ba-f19d49fcc01b-delete_snapshot" released by "delete_snapshot" :: held 2.562s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:56:14 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-5867961c-e786-4dce-8c15-f113256a5e1a tempest-SnapshotsActionsTest-682265405 None] Acquiring lock "cinder-adf07162-bf97-4787-8d3f-0baa4bcd5051-delete_snapshot" by "delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:56:14 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-5867961c-e786-4dce-8c15-f113256a5e1a tempest-SnapshotsActionsTest-682265405 None] Lock "cinder-adf07162-bf97-4787-8d3f-0baa4bcd5051-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:56:14 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-5867961c-e786-4dce-8c15-f113256a5e1a tempest-SnapshotsActionsTest-682265405 None] Acquiring lock "cinder-quobyte-78b33a64-cdae-492e-abdb-20e2c1f058cb" by "delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:56:14 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-5867961c-e786-4dce-8c15-f113256a5e1a tempest-SnapshotsActionsTest-682265405 None] Lock "cinder-quobyte-78b33a64-cdae-492e-abdb-20e2c1f058cb" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:56:14 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-5867961c-e786-4dce-8c15-f113256a5e1a tempest-SnapshotsActionsTest-682265405 None] Acquiring lock "cinder-quobyte-adf07162-bf97-4787-8d3f-0baa4bcd5051" by "_delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:56:14 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-5867961c-e786-4dce-8c15-f113256a5e1a tempest-SnapshotsActionsTest-682265405 None] Lock "cinder-quobyte-adf07162-bf97-4787-8d3f-0baa4bcd5051" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:56:14 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-5867961c-e786-4dce-8c15-f113256a5e1a tempest-SnapshotsActionsTest-682265405 None] Deleting offline snapshot adf07162-bf97-4787-8d3f-0baa4bcd5051 of volume 78b33a64-cdae-492e-abdb-20e2c1f058cb {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 15:56:14 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-5867961c-e786-4dce-8c15-f113256a5e1a tempest-SnapshotsActionsTest-682265405 None] snapshot_file for this snap is: volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.adf07162-bf97-4787-8d3f-0baa4bcd5051 {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 15:56:14 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f70e36-8cb7-4833-9f01-072b9ea18b27]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:56:14 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-5867961c-e786-4dce-8c15-f113256a5e1a tempest-SnapshotsActionsTest-682265405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.adf07162-bf97-4787-8d3f-0baa4bcd5051 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:14 devstack sudo[87641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.adf07162-bf97-4787-8d3f-0baa4bcd5051
Apr 15 15:56:14 devstack sudo[87641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:15 devstack sudo[87641]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:15 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-5867961c-e786-4dce-8c15-f113256a5e1a tempest-SnapshotsActionsTest-682265405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.adf07162-bf97-4787-8d3f-0baa4bcd5051" returned: 0 in 0.634s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:15 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-5867961c-e786-4dce-8c15-f113256a5e1a tempest-SnapshotsActionsTest-682265405 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78b33a64-cdae-492e-abdb-20e2c1f058cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82485) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 15:56:15 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[443eee19-669b-47e3-b301-bd5101f37086]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:56:15 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-5867961c-e786-4dce-8c15-f113256a5e1a tempest-SnapshotsActionsTest-682265405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:15 devstack sudo[87646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb
Apr 15 15:56:15 devstack sudo[87646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:15 devstack sudo[87646]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:15 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-5867961c-e786-4dce-8c15-f113256a5e1a tempest-SnapshotsActionsTest-682265405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb" returned: 0 in 0.468s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:15 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-5867961c-e786-4dce-8c15-f113256a5e1a tempest-SnapshotsActionsTest-682265405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.adf07162-bf97-4787-8d3f-0baa4bcd5051 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:15 devstack sudo[87651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.adf07162-bf97-4787-8d3f-0baa4bcd5051
Apr 15 15:56:15 devstack sudo[87651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:16 devstack sudo[87651]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:16 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-5867961c-e786-4dce-8c15-f113256a5e1a tempest-SnapshotsActionsTest-682265405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.adf07162-bf97-4787-8d3f-0baa4bcd5051" returned: 0 in 0.486s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:16 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-5867961c-e786-4dce-8c15-f113256a5e1a tempest-SnapshotsActionsTest-682265405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.adf07162-bf97-4787-8d3f-0baa4bcd5051 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:16 devstack sudo[87659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.adf07162-bf97-4787-8d3f-0baa4bcd5051
Apr 15 15:56:16 devstack sudo[87659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:16 devstack sudo[87659]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:16 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-5867961c-e786-4dce-8c15-f113256a5e1a tempest-SnapshotsActionsTest-682265405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb.adf07162-bf97-4787-8d3f-0baa4bcd5051" returned: 0 in 0.503s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:16 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-5867961c-e786-4dce-8c15-f113256a5e1a tempest-SnapshotsActionsTest-682265405 None] Lock "cinder-quobyte-adf07162-bf97-4787-8d3f-0baa4bcd5051" released by "_delete_snapshot" :: held 2.154s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:56:16 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-5867961c-e786-4dce-8c15-f113256a5e1a tempest-SnapshotsActionsTest-682265405 None] Lock "cinder-quobyte-78b33a64-cdae-492e-abdb-20e2c1f058cb" released by "delete_snapshot" :: held 2.170s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:56:16 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-5867961c-e786-4dce-8c15-f113256a5e1a tempest-SnapshotsActionsTest-682265405 None] Created reservations ['ff7a1c8b-e65c-48ce-9143-84e94367cbc4', '7e2b859f-90bd-4759-a4e9-3a5f14cec8f8', '20b81c0d-b94a-4a77-8409-fd05b7c1c3db', '8c641401-a6c1-4c3d-914f-469baa085c86'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:56:16 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-5867961c-e786-4dce-8c15-f113256a5e1a tempest-SnapshotsActionsTest-682265405 None] Delete snapshot completed successfully.
Apr 15 15:56:16 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-5867961c-e786-4dce-8c15-f113256a5e1a tempest-SnapshotsActionsTest-682265405 None] Lock "cinder-adf07162-bf97-4787-8d3f-0baa4bcd5051-delete_snapshot" released by "delete_snapshot" :: held 2.268s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:56:17 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-ec212171-dbe7-426f-9360-dd647cd018e1 tempest-SnapshotsActionsTest-682265405 None] Acquiring lock "cinder-78b33a64-cdae-492e-abdb-20e2c1f058cb-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:56:18 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-ec212171-dbe7-426f-9360-dd647cd018e1 tempest-SnapshotsActionsTest-682265405 None] Lock "cinder-78b33a64-cdae-492e-abdb-20e2c1f058cb-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:56:18 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-ec212171-dbe7-426f-9360-dd647cd018e1 tempest-SnapshotsActionsTest-682265405 None] Acquiring lock "cinder-quobyte-78b33a64-cdae-492e-abdb-20e2c1f058cb" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:56:18 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-ec212171-dbe7-426f-9360-dd647cd018e1 tempest-SnapshotsActionsTest-682265405 None] Lock "cinder-quobyte-78b33a64-cdae-492e-abdb-20e2c1f058cb" acquired by "delete_volume" :: waited 0.020s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:56:18 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[538d9f04-c0d8-4356-b89c-8a999f3e7cb1]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:56:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ec212171-dbe7-426f-9360-dd647cd018e1 tempest-SnapshotsActionsTest-682265405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:18 devstack sudo[87688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb
Apr 15 15:56:18 devstack sudo[87688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:18 devstack sudo[87688]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ec212171-dbe7-426f-9360-dd647cd018e1 tempest-SnapshotsActionsTest-682265405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb" returned: 0 in 0.703s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ec212171-dbe7-426f-9360-dd647cd018e1 tempest-SnapshotsActionsTest-682265405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:18 devstack sudo[87695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb
Apr 15 15:56:18 devstack sudo[87695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:19 devstack sudo[87695]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ec212171-dbe7-426f-9360-dd647cd018e1 tempest-SnapshotsActionsTest-682265405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78b33a64-cdae-492e-abdb-20e2c1f058cb" returned: 0 in 0.637s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:19 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-ec212171-dbe7-426f-9360-dd647cd018e1 tempest-SnapshotsActionsTest-682265405 None] Lock "cinder-quobyte-78b33a64-cdae-492e-abdb-20e2c1f058cb" released by "delete_volume" :: held 1.414s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:56:19 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-ec212171-dbe7-426f-9360-dd647cd018e1 tempest-SnapshotsActionsTest-682265405 None] Created reservations ['6ca8e18d-3beb-452b-bcb2-4fdd401723f2', 'beeade96-ad7c-4f2e-b46d-0e646dc47140', 'b786c8cf-69d0-4ca1-8ccf-d8dc5798b033', '7e6cf379-dd94-4b77-b10f-66ea7612f482'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:56:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-ec212171-dbe7-426f-9360-dd647cd018e1 tempest-SnapshotsActionsTest-682265405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:56:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-ec212171-dbe7-426f-9360-dd647cd018e1 tempest-SnapshotsActionsTest-682265405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:56:19 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-ec212171-dbe7-426f-9360-dd647cd018e1 tempest-SnapshotsActionsTest-682265405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:56:19 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-ec212171-dbe7-426f-9360-dd647cd018e1 tempest-SnapshotsActionsTest-682265405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:56:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-ec212171-dbe7-426f-9360-dd647cd018e1 tempest-SnapshotsActionsTest-682265405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:56:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ec212171-dbe7-426f-9360-dd647cd018e1 tempest-SnapshotsActionsTest-682265405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:19 devstack sudo[87699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:56:19 devstack sudo[87699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:20 devstack sudo[87699]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:20 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ec212171-dbe7-426f-9360-dd647cd018e1 tempest-SnapshotsActionsTest-682265405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.596s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:20 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-ec212171-dbe7-426f-9360-dd647cd018e1 tempest-SnapshotsActionsTest-682265405 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:56:20 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-ec212171-dbe7-426f-9360-dd647cd018e1 tempest-SnapshotsActionsTest-682265405 None] Deleted volume successfully.
Apr 15 15:56:20 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-ec212171-dbe7-426f-9360-dd647cd018e1 tempest-SnapshotsActionsTest-682265405 None] Lock "cinder-78b33a64-cdae-492e-abdb-20e2c1f058cb-delete_volume" released by "delete_volume" :: held 2.582s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:56:29 devstack cinder-volume[82485]: DEBUG dbcounter [-] [82485] Writing DB stats cinder:SELECT=106,cinder:UPDATE=132,cinder:INSERT=39,cinder:DELETE=11 {{(pid=82485) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 15:56:30 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e643a8b-55df-4dca-8a32-624ecc1f1a26 tempest-VolumeQuotasAdminTestJSON-911368046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:56:30 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9e643a8b-55df-4dca-8a32-624ecc1f1a26 tempest-VolumeQuotasAdminTestJSON-911368046 None] Flow 'volume_create_manager' (23bdfb0e-4822-4925-9a30-c17647d9b26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:56:30 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9e643a8b-55df-4dca-8a32-624ecc1f1a26 tempest-VolumeQuotasAdminTestJSON-911368046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c14980df-7858-44ed-b07f-c948f86dd98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:56:30 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9e643a8b-55df-4dca-8a32-624ecc1f1a26 tempest-VolumeQuotasAdminTestJSON-911368046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c14980df-7858-44ed-b07f-c948f86dd98a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:56:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1926885380',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af26a0fc-e564-4bb2-aeb2-85ca6e9d4ff7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a9674db9eee4cec847c9ef5a46bcd50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:56:30Z,use_quota=True,user_id='2f7d43cb5684417e80e8bbcde39ab4a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:56:30 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9e643a8b-55df-4dca-8a32-624ecc1f1a26 tempest-VolumeQuotasAdminTestJSON-911368046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d2dd0fb-b10b-4616-8612-92cc4d60070f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:56:30 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9e643a8b-55df-4dca-8a32-624ecc1f1a26 tempest-VolumeQuotasAdminTestJSON-911368046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d2dd0fb-b10b-4616-8612-92cc4d60070f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:56:30 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9e643a8b-55df-4dca-8a32-624ecc1f1a26 tempest-VolumeQuotasAdminTestJSON-911368046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a632e66-ce4a-47ba-a404-137fb4a88a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:56:30 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9e643a8b-55df-4dca-8a32-624ecc1f1a26 tempest-VolumeQuotasAdminTestJSON-911368046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a632e66-ce4a-47ba-a404-137fb4a88a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af26a0fc-e564-4bb2-aeb2-85ca6e9d4ff7', 'volume_name': 'volume-af26a0fc-e564-4bb2-aeb2-85ca6e9d4ff7', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:56:30 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9e643a8b-55df-4dca-8a32-624ecc1f1a26 tempest-VolumeQuotasAdminTestJSON-911368046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34992348-bdb4-4da3-8f7b-3daa443405f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:56:30 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9e643a8b-55df-4dca-8a32-624ecc1f1a26 tempest-VolumeQuotasAdminTestJSON-911368046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34992348-bdb4-4da3-8f7b-3daa443405f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:56:30 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9e643a8b-55df-4dca-8a32-624ecc1f1a26 tempest-VolumeQuotasAdminTestJSON-911368046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a19a4aa-6a8a-476c-8ea6-a952b29b1a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:56:30 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-9e643a8b-55df-4dca-8a32-624ecc1f1a26 tempest-VolumeQuotasAdminTestJSON-911368046 None] Volume af26a0fc-e564-4bb2-aeb2-85ca6e9d4ff7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af26a0fc-e564-4bb2-aeb2-85ca6e9d4ff7', 'volume_size': 1}
Apr 15 15:56:30 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-9e643a8b-55df-4dca-8a32-624ecc1f1a26 tempest-VolumeQuotasAdminTestJSON-911368046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:56:30 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-9e643a8b-55df-4dca-8a32-624ecc1f1a26 tempest-VolumeQuotasAdminTestJSON-911368046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:56:30 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-9e643a8b-55df-4dca-8a32-624ecc1f1a26 tempest-VolumeQuotasAdminTestJSON-911368046 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:56:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1926885380',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af26a0fc-e564-4bb2-aeb2-85ca6e9d4ff7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a9674db9eee4cec847c9ef5a46bcd50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:56:30Z,use_quota=True,user_id='2f7d43cb5684417e80e8bbcde39ab4a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:56:30 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-9e643a8b-55df-4dca-8a32-624ecc1f1a26 tempest-VolumeQuotasAdminTestJSON-911368046 None] Creating volume af26a0fc-e564-4bb2-aeb2-85ca6e9d4ff7 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:56:30 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-9e643a8b-55df-4dca-8a32-624ecc1f1a26 tempest-VolumeQuotasAdminTestJSON-911368046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:56:30 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-9e643a8b-55df-4dca-8a32-624ecc1f1a26 tempest-VolumeQuotasAdminTestJSON-911368046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:56:30 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-9e643a8b-55df-4dca-8a32-624ecc1f1a26 tempest-VolumeQuotasAdminTestJSON-911368046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:56:30 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-9e643a8b-55df-4dca-8a32-624ecc1f1a26 tempest-VolumeQuotasAdminTestJSON-911368046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:56:30 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-9e643a8b-55df-4dca-8a32-624ecc1f1a26 tempest-VolumeQuotasAdminTestJSON-911368046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:56:30 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-9e643a8b-55df-4dca-8a32-624ecc1f1a26 tempest-VolumeQuotasAdminTestJSON-911368046 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:56:30 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-9e643a8b-55df-4dca-8a32-624ecc1f1a26 tempest-VolumeQuotasAdminTestJSON-911368046 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:56:30 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9e643a8b-55df-4dca-8a32-624ecc1f1a26 tempest-VolumeQuotasAdminTestJSON-911368046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-af26a0fc-e564-4bb2-aeb2-85ca6e9d4ff7 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:30 devstack sudo[87734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-af26a0fc-e564-4bb2-aeb2-85ca6e9d4ff7 1073741824
Apr 15 15:56:30 devstack sudo[87734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:31 devstack sudo[87734]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:31 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9e643a8b-55df-4dca-8a32-624ecc1f1a26 tempest-VolumeQuotasAdminTestJSON-911368046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-af26a0fc-e564-4bb2-aeb2-85ca6e9d4ff7 1073741824" returned: 0 in 0.605s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:31 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9e643a8b-55df-4dca-8a32-624ecc1f1a26 tempest-VolumeQuotasAdminTestJSON-911368046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-af26a0fc-e564-4bb2-aeb2-85ca6e9d4ff7 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:31 devstack sudo[87739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-af26a0fc-e564-4bb2-aeb2-85ca6e9d4ff7
Apr 15 15:56:31 devstack sudo[87739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:31 devstack sudo[87739]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:31 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9e643a8b-55df-4dca-8a32-624ecc1f1a26 tempest-VolumeQuotasAdminTestJSON-911368046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-af26a0fc-e564-4bb2-aeb2-85ca6e9d4ff7" returned: 0 in 0.520s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:31 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-9e643a8b-55df-4dca-8a32-624ecc1f1a26 tempest-VolumeQuotasAdminTestJSON-911368046 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:56:31 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-9e643a8b-55df-4dca-8a32-624ecc1f1a26 tempest-VolumeQuotasAdminTestJSON-911368046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.161s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:56:31 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9e643a8b-55df-4dca-8a32-624ecc1f1a26 tempest-VolumeQuotasAdminTestJSON-911368046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a19a4aa-6a8a-476c-8ea6-a952b29b1a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af26a0fc-e564-4bb2-aeb2-85ca6e9d4ff7', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:56:31 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9e643a8b-55df-4dca-8a32-624ecc1f1a26 tempest-VolumeQuotasAdminTestJSON-911368046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54c53aa1-588c-433d-8fc9-cf884e0dee6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:56:31 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-9e643a8b-55df-4dca-8a32-624ecc1f1a26 tempest-VolumeQuotasAdminTestJSON-911368046 None] Volume volume-af26a0fc-e564-4bb2-aeb2-85ca6e9d4ff7 (af26a0fc-e564-4bb2-aeb2-85ca6e9d4ff7): created successfully
Apr 15 15:56:31 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9e643a8b-55df-4dca-8a32-624ecc1f1a26 tempest-VolumeQuotasAdminTestJSON-911368046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54c53aa1-588c-433d-8fc9-cf884e0dee6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:56:31 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9e643a8b-55df-4dca-8a32-624ecc1f1a26 tempest-VolumeQuotasAdminTestJSON-911368046 None] Flow 'volume_create_manager' (23bdfb0e-4822-4925-9a30-c17647d9b26c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:56:31 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-9e643a8b-55df-4dca-8a32-624ecc1f1a26 tempest-VolumeQuotasAdminTestJSON-911368046 None] Created volume successfully.
Apr 15 15:56:32 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-9c09b831-a877-4e2e-bb04-38d48af11d3c tempest-VolumeQuotasAdminTestJSON-911368046 None] Acquiring lock "cinder-af26a0fc-e564-4bb2-aeb2-85ca6e9d4ff7-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:56:32 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-9c09b831-a877-4e2e-bb04-38d48af11d3c tempest-VolumeQuotasAdminTestJSON-911368046 None] Lock "cinder-af26a0fc-e564-4bb2-aeb2-85ca6e9d4ff7-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:56:32 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-9c09b831-a877-4e2e-bb04-38d48af11d3c tempest-VolumeQuotasAdminTestJSON-911368046 None] Acquiring lock "cinder-quobyte-af26a0fc-e564-4bb2-aeb2-85ca6e9d4ff7" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:56:32 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-9c09b831-a877-4e2e-bb04-38d48af11d3c tempest-VolumeQuotasAdminTestJSON-911368046 None] Lock "cinder-quobyte-af26a0fc-e564-4bb2-aeb2-85ca6e9d4ff7" acquired by "delete_volume" :: waited 0.008s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:56:32 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f2b995-3246-4170-bbe7-ce400c8f7efd]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:56:32 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9c09b831-a877-4e2e-bb04-38d48af11d3c tempest-VolumeQuotasAdminTestJSON-911368046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-af26a0fc-e564-4bb2-aeb2-85ca6e9d4ff7 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:32 devstack sudo[87742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-af26a0fc-e564-4bb2-aeb2-85ca6e9d4ff7
Apr 15 15:56:32 devstack sudo[87742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:33 devstack sudo[87742]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:33 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9c09b831-a877-4e2e-bb04-38d48af11d3c tempest-VolumeQuotasAdminTestJSON-911368046 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-af26a0fc-e564-4bb2-aeb2-85ca6e9d4ff7" returned: 0 in 0.586s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:33 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9c09b831-a877-4e2e-bb04-38d48af11d3c tempest-VolumeQuotasAdminTestJSON-911368046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-af26a0fc-e564-4bb2-aeb2-85ca6e9d4ff7 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:33 devstack sudo[87747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-af26a0fc-e564-4bb2-aeb2-85ca6e9d4ff7
Apr 15 15:56:33 devstack sudo[87747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:33 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d96c2ef-7038-417c-a3a1-fc30964f6dff tempest-VolumeTypesAccessTest-597260551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:56:33 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-6d96c2ef-7038-417c-a3a1-fc30964f6dff tempest-VolumeTypesAccessTest-597260551 None] Flow 'volume_create_manager' (426e74f2-7a22-4257-af29-646e27983a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:56:33 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-6d96c2ef-7038-417c-a3a1-fc30964f6dff tempest-VolumeTypesAccessTest-597260551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea01e6d6-22d7-46b0-94ff-19f6c744087b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:56:33 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-6d96c2ef-7038-417c-a3a1-fc30964f6dff tempest-VolumeTypesAccessTest-597260551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea01e6d6-22d7-46b0-94ff-19f6c744087b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:56:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1766555849',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68d92ed8-9326-4b7f-90b3-fcc5ae9dd4d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ccd9f752ded405e88b37b79a94e4ff5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:56:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:56:34Z,use_quota=True,user_id='312c58279c1a4c0caa645734c0c9e5a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9424733c-8207-48d2-9f15-18e762b7e905),volume_type_id=9424733c-8207-48d2-9f15-18e762b7e905)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:56:33 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-6d96c2ef-7038-417c-a3a1-fc30964f6dff tempest-VolumeTypesAccessTest-597260551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (297e7d3d-0226-4500-8b33-7b4b23be6dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:56:33 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-6d96c2ef-7038-417c-a3a1-fc30964f6dff tempest-VolumeTypesAccessTest-597260551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (297e7d3d-0226-4500-8b33-7b4b23be6dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:56:33 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-6d96c2ef-7038-417c-a3a1-fc30964f6dff tempest-VolumeTypesAccessTest-597260551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (675f64c8-1829-4397-967a-9adec6ed0645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:56:33 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-6d96c2ef-7038-417c-a3a1-fc30964f6dff tempest-VolumeTypesAccessTest-597260551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (675f64c8-1829-4397-967a-9adec6ed0645) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68d92ed8-9326-4b7f-90b3-fcc5ae9dd4d4', 'volume_name': 'volume-68d92ed8-9326-4b7f-90b3-fcc5ae9dd4d4', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:56:33 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-6d96c2ef-7038-417c-a3a1-fc30964f6dff tempest-VolumeTypesAccessTest-597260551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b13f8f7e-4242-49be-8de8-ab1248e36038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:56:33 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-6d96c2ef-7038-417c-a3a1-fc30964f6dff tempest-VolumeTypesAccessTest-597260551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b13f8f7e-4242-49be-8de8-ab1248e36038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:56:33 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-6d96c2ef-7038-417c-a3a1-fc30964f6dff tempest-VolumeTypesAccessTest-597260551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e497b31-b57b-4d77-a2c5-4986e2250244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:56:33 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-6d96c2ef-7038-417c-a3a1-fc30964f6dff tempest-VolumeTypesAccessTest-597260551 None] Volume 68d92ed8-9326-4b7f-90b3-fcc5ae9dd4d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68d92ed8-9326-4b7f-90b3-fcc5ae9dd4d4', 'volume_size': 1}
Apr 15 15:56:33 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-6d96c2ef-7038-417c-a3a1-fc30964f6dff tempest-VolumeTypesAccessTest-597260551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:56:33 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-6d96c2ef-7038-417c-a3a1-fc30964f6dff tempest-VolumeTypesAccessTest-597260551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:56:33 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-6d96c2ef-7038-417c-a3a1-fc30964f6dff tempest-VolumeTypesAccessTest-597260551 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:56:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1766555849',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68d92ed8-9326-4b7f-90b3-fcc5ae9dd4d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ccd9f752ded405e88b37b79a94e4ff5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:56:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:56:34Z,use_quota=True,user_id='312c58279c1a4c0caa645734c0c9e5a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9424733c-8207-48d2-9f15-18e762b7e905),volume_type_id=9424733c-8207-48d2-9f15-18e762b7e905)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:56:33 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-6d96c2ef-7038-417c-a3a1-fc30964f6dff tempest-VolumeTypesAccessTest-597260551 None] Creating volume 68d92ed8-9326-4b7f-90b3-fcc5ae9dd4d4 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:56:33 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-6d96c2ef-7038-417c-a3a1-fc30964f6dff tempest-VolumeTypesAccessTest-597260551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:56:33 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-6d96c2ef-7038-417c-a3a1-fc30964f6dff tempest-VolumeTypesAccessTest-597260551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:56:33 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-6d96c2ef-7038-417c-a3a1-fc30964f6dff tempest-VolumeTypesAccessTest-597260551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:56:33 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-6d96c2ef-7038-417c-a3a1-fc30964f6dff tempest-VolumeTypesAccessTest-597260551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:56:33 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-6d96c2ef-7038-417c-a3a1-fc30964f6dff tempest-VolumeTypesAccessTest-597260551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:56:33 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-6d96c2ef-7038-417c-a3a1-fc30964f6dff tempest-VolumeTypesAccessTest-597260551 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:56:33 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-6d96c2ef-7038-417c-a3a1-fc30964f6dff tempest-VolumeTypesAccessTest-597260551 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:56:33 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6d96c2ef-7038-417c-a3a1-fc30964f6dff tempest-VolumeTypesAccessTest-597260551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-68d92ed8-9326-4b7f-90b3-fcc5ae9dd4d4 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:33 devstack sudo[87750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-68d92ed8-9326-4b7f-90b3-fcc5ae9dd4d4 1073741824
Apr 15 15:56:33 devstack sudo[87750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:33 devstack sudo[87747]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:33 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9c09b831-a877-4e2e-bb04-38d48af11d3c tempest-VolumeQuotasAdminTestJSON-911368046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-af26a0fc-e564-4bb2-aeb2-85ca6e9d4ff7" returned: 0 in 0.489s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:33 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-9c09b831-a877-4e2e-bb04-38d48af11d3c tempest-VolumeQuotasAdminTestJSON-911368046 None] Lock "cinder-quobyte-af26a0fc-e564-4bb2-aeb2-85ca6e9d4ff7" released by "delete_volume" :: held 1.100s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:56:33 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-9c09b831-a877-4e2e-bb04-38d48af11d3c tempest-VolumeQuotasAdminTestJSON-911368046 None] Created reservations ['da1791ed-3f00-444a-a6f7-41a265abcad4', '57961bb4-d711-40fd-a95c-e81f925ec21b', '5dc254ed-f3d9-40b8-8157-9c2bc212993e', 'bb3e5f3a-4fa1-443b-a6ab-bbdd76576490'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:56:33 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-9c09b831-a877-4e2e-bb04-38d48af11d3c tempest-VolumeQuotasAdminTestJSON-911368046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:56:33 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-9c09b831-a877-4e2e-bb04-38d48af11d3c tempest-VolumeQuotasAdminTestJSON-911368046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:56:33 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-9c09b831-a877-4e2e-bb04-38d48af11d3c tempest-VolumeQuotasAdminTestJSON-911368046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:56:33 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-9c09b831-a877-4e2e-bb04-38d48af11d3c tempest-VolumeQuotasAdminTestJSON-911368046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:56:33 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-9c09b831-a877-4e2e-bb04-38d48af11d3c tempest-VolumeQuotasAdminTestJSON-911368046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:56:33 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9c09b831-a877-4e2e-bb04-38d48af11d3c tempest-VolumeQuotasAdminTestJSON-911368046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:33 devstack sudo[87753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:56:33 devstack sudo[87753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:34 devstack sudo[87750]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:34 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6d96c2ef-7038-417c-a3a1-fc30964f6dff tempest-VolumeTypesAccessTest-597260551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-68d92ed8-9326-4b7f-90b3-fcc5ae9dd4d4 1073741824" returned: 0 in 0.583s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:34 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6d96c2ef-7038-417c-a3a1-fc30964f6dff tempest-VolumeTypesAccessTest-597260551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-68d92ed8-9326-4b7f-90b3-fcc5ae9dd4d4 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:34 devstack sudo[87760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-68d92ed8-9326-4b7f-90b3-fcc5ae9dd4d4
Apr 15 15:56:34 devstack sudo[87760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:34 devstack sudo[87753]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:34 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9c09b831-a877-4e2e-bb04-38d48af11d3c tempest-VolumeQuotasAdminTestJSON-911368046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.524s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:34 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-9c09b831-a877-4e2e-bb04-38d48af11d3c tempest-VolumeQuotasAdminTestJSON-911368046 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:56:34 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-9c09b831-a877-4e2e-bb04-38d48af11d3c tempest-VolumeQuotasAdminTestJSON-911368046 None] Deleted volume successfully.
Apr 15 15:56:34 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-9c09b831-a877-4e2e-bb04-38d48af11d3c tempest-VolumeQuotasAdminTestJSON-911368046 None] Lock "cinder-af26a0fc-e564-4bb2-aeb2-85ca6e9d4ff7-delete_volume" released by "delete_volume" :: held 1.754s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:56:34 devstack sudo[87760]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:34 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6d96c2ef-7038-417c-a3a1-fc30964f6dff tempest-VolumeTypesAccessTest-597260551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-68d92ed8-9326-4b7f-90b3-fcc5ae9dd4d4" returned: 0 in 0.450s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:34 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-6d96c2ef-7038-417c-a3a1-fc30964f6dff tempest-VolumeTypesAccessTest-597260551 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:56:34 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-6d96c2ef-7038-417c-a3a1-fc30964f6dff tempest-VolumeTypesAccessTest-597260551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:56:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-6d96c2ef-7038-417c-a3a1-fc30964f6dff tempest-VolumeTypesAccessTest-597260551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e497b31-b57b-4d77-a2c5-4986e2250244) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68d92ed8-9326-4b7f-90b3-fcc5ae9dd4d4', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:56:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-6d96c2ef-7038-417c-a3a1-fc30964f6dff tempest-VolumeTypesAccessTest-597260551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4848e955-1e93-4b09-a209-d70faac65a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:56:34 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-6d96c2ef-7038-417c-a3a1-fc30964f6dff tempest-VolumeTypesAccessTest-597260551 None] Volume volume-68d92ed8-9326-4b7f-90b3-fcc5ae9dd4d4 (68d92ed8-9326-4b7f-90b3-fcc5ae9dd4d4): created successfully
Apr 15 15:56:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-6d96c2ef-7038-417c-a3a1-fc30964f6dff tempest-VolumeTypesAccessTest-597260551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4848e955-1e93-4b09-a209-d70faac65a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:56:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-6d96c2ef-7038-417c-a3a1-fc30964f6dff tempest-VolumeTypesAccessTest-597260551 None] Flow 'volume_create_manager' (426e74f2-7a22-4257-af29-646e27983a5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:56:34 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-6d96c2ef-7038-417c-a3a1-fc30964f6dff tempest-VolumeTypesAccessTest-597260551 None] Created volume successfully.
Apr 15 15:56:35 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-23a4f005-e70a-4a64-9c5e-a28a73a262d2 tempest-VolumeQuotasAdminTestJSON-911368046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:56:35 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-23a4f005-e70a-4a64-9c5e-a28a73a262d2 tempest-VolumeQuotasAdminTestJSON-911368046 None] Flow 'volume_create_manager' (5f56da24-2776-4cc1-bda3-74d02a247a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:56:35 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-23a4f005-e70a-4a64-9c5e-a28a73a262d2 tempest-VolumeQuotasAdminTestJSON-911368046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (968883e3-da7f-43f0-9c6b-d9c6c43e3533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:56:35 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-23a4f005-e70a-4a64-9c5e-a28a73a262d2 tempest-VolumeQuotasAdminTestJSON-911368046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (968883e3-da7f-43f0-9c6b-d9c6c43e3533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:56:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-284186240',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e77ac73c-9627-4c00-a371-aad93f103d95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a9674db9eee4cec847c9ef5a46bcd50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:56:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:56:35Z,use_quota=True,user_id='2f7d43cb5684417e80e8bbcde39ab4a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:56:35 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-23a4f005-e70a-4a64-9c5e-a28a73a262d2 tempest-VolumeQuotasAdminTestJSON-911368046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3acae73-5fec-440f-86dc-6d62e91fb450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:56:35 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-23a4f005-e70a-4a64-9c5e-a28a73a262d2 tempest-VolumeQuotasAdminTestJSON-911368046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3acae73-5fec-440f-86dc-6d62e91fb450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:56:35 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-23a4f005-e70a-4a64-9c5e-a28a73a262d2 tempest-VolumeQuotasAdminTestJSON-911368046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a2005bf-7708-4384-87f9-8e848f7146da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:56:35 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-23a4f005-e70a-4a64-9c5e-a28a73a262d2 tempest-VolumeQuotasAdminTestJSON-911368046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a2005bf-7708-4384-87f9-8e848f7146da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e77ac73c-9627-4c00-a371-aad93f103d95', 'volume_name': 'volume-e77ac73c-9627-4c00-a371-aad93f103d95', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:56:35 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-23a4f005-e70a-4a64-9c5e-a28a73a262d2 tempest-VolumeQuotasAdminTestJSON-911368046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d539c83d-72f5-4c4d-a3a7-1bfd96da625f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:56:35 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-23a4f005-e70a-4a64-9c5e-a28a73a262d2 tempest-VolumeQuotasAdminTestJSON-911368046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d539c83d-72f5-4c4d-a3a7-1bfd96da625f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:56:35 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-23a4f005-e70a-4a64-9c5e-a28a73a262d2 tempest-VolumeQuotasAdminTestJSON-911368046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9840662-a3ea-415e-9779-8107ed876705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:56:35 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-23a4f005-e70a-4a64-9c5e-a28a73a262d2 tempest-VolumeQuotasAdminTestJSON-911368046 None] Volume e77ac73c-9627-4c00-a371-aad93f103d95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e77ac73c-9627-4c00-a371-aad93f103d95', 'volume_size': 1}
Apr 15 15:56:35 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-23a4f005-e70a-4a64-9c5e-a28a73a262d2 tempest-VolumeQuotasAdminTestJSON-911368046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:56:35 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-23a4f005-e70a-4a64-9c5e-a28a73a262d2 tempest-VolumeQuotasAdminTestJSON-911368046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:56:35 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-23a4f005-e70a-4a64-9c5e-a28a73a262d2 tempest-VolumeQuotasAdminTestJSON-911368046 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:56:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-284186240',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e77ac73c-9627-4c00-a371-aad93f103d95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a9674db9eee4cec847c9ef5a46bcd50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:56:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:56:35Z,use_quota=True,user_id='2f7d43cb5684417e80e8bbcde39ab4a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:56:35 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-23a4f005-e70a-4a64-9c5e-a28a73a262d2 tempest-VolumeQuotasAdminTestJSON-911368046 None] Creating volume e77ac73c-9627-4c00-a371-aad93f103d95 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:56:35 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-23a4f005-e70a-4a64-9c5e-a28a73a262d2 tempest-VolumeQuotasAdminTestJSON-911368046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:56:35 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-23a4f005-e70a-4a64-9c5e-a28a73a262d2 tempest-VolumeQuotasAdminTestJSON-911368046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:56:35 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-23a4f005-e70a-4a64-9c5e-a28a73a262d2 tempest-VolumeQuotasAdminTestJSON-911368046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:56:35 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-23a4f005-e70a-4a64-9c5e-a28a73a262d2 tempest-VolumeQuotasAdminTestJSON-911368046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:56:35 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-23a4f005-e70a-4a64-9c5e-a28a73a262d2 tempest-VolumeQuotasAdminTestJSON-911368046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:56:35 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-23a4f005-e70a-4a64-9c5e-a28a73a262d2 tempest-VolumeQuotasAdminTestJSON-911368046 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:56:35 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-23a4f005-e70a-4a64-9c5e-a28a73a262d2 tempest-VolumeQuotasAdminTestJSON-911368046 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:56:35 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-23a4f005-e70a-4a64-9c5e-a28a73a262d2 tempest-VolumeQuotasAdminTestJSON-911368046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e77ac73c-9627-4c00-a371-aad93f103d95 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:35 devstack sudo[87771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e77ac73c-9627-4c00-a371-aad93f103d95 1073741824
Apr 15 15:56:35 devstack sudo[87771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:35 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-30b0101e-ea78-4b4c-a0b4-5afc2b41d1cf tempest-VolumeTypesAccessTest-597260551 None] Acquiring lock "cinder-68d92ed8-9326-4b7f-90b3-fcc5ae9dd4d4-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:56:35 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-30b0101e-ea78-4b4c-a0b4-5afc2b41d1cf tempest-VolumeTypesAccessTest-597260551 None] Lock "cinder-68d92ed8-9326-4b7f-90b3-fcc5ae9dd4d4-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:56:35 devstack cinder-volume[82485]: DEBUG dbcounter [-] [82485] Writing DB stats cinder:SELECT=132,cinder:INSERT=33,cinder:UPDATE=157,cinder:DELETE=11 {{(pid=82485) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 15:56:35 devstack sudo[87771]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:35 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-23a4f005-e70a-4a64-9c5e-a28a73a262d2 tempest-VolumeQuotasAdminTestJSON-911368046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e77ac73c-9627-4c00-a371-aad93f103d95 1073741824" returned: 0 in 0.591s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:35 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-30b0101e-ea78-4b4c-a0b4-5afc2b41d1cf tempest-VolumeTypesAccessTest-597260551 None] Acquiring lock "cinder-quobyte-68d92ed8-9326-4b7f-90b3-fcc5ae9dd4d4" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:56:35 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-30b0101e-ea78-4b4c-a0b4-5afc2b41d1cf tempest-VolumeTypesAccessTest-597260551 None] Lock "cinder-quobyte-68d92ed8-9326-4b7f-90b3-fcc5ae9dd4d4" acquired by "delete_volume" :: waited 0.015s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:56:35 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[291b6a35-3201-4e5d-a934-d5808c1f83d6]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:56:35 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-30b0101e-ea78-4b4c-a0b4-5afc2b41d1cf tempest-VolumeTypesAccessTest-597260551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-68d92ed8-9326-4b7f-90b3-fcc5ae9dd4d4 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:35 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-23a4f005-e70a-4a64-9c5e-a28a73a262d2 tempest-VolumeQuotasAdminTestJSON-911368046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e77ac73c-9627-4c00-a371-aad93f103d95 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:35 devstack sudo[87777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e77ac73c-9627-4c00-a371-aad93f103d95
Apr 15 15:56:35 devstack sudo[87777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:35 devstack sudo[87776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-68d92ed8-9326-4b7f-90b3-fcc5ae9dd4d4
Apr 15 15:56:35 devstack sudo[87776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:36 devstack sudo[87777]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:36 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-23a4f005-e70a-4a64-9c5e-a28a73a262d2 tempest-VolumeQuotasAdminTestJSON-911368046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e77ac73c-9627-4c00-a371-aad93f103d95" returned: 0 in 0.501s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:36 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-23a4f005-e70a-4a64-9c5e-a28a73a262d2 tempest-VolumeQuotasAdminTestJSON-911368046 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:56:36 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-23a4f005-e70a-4a64-9c5e-a28a73a262d2 tempest-VolumeQuotasAdminTestJSON-911368046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:56:36 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-23a4f005-e70a-4a64-9c5e-a28a73a262d2 tempest-VolumeQuotasAdminTestJSON-911368046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9840662-a3ea-415e-9779-8107ed876705) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e77ac73c-9627-4c00-a371-aad93f103d95', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:56:36 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-23a4f005-e70a-4a64-9c5e-a28a73a262d2 tempest-VolumeQuotasAdminTestJSON-911368046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60596d5d-89ee-48d0-868f-d82396933de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:56:36 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-23a4f005-e70a-4a64-9c5e-a28a73a262d2 tempest-VolumeQuotasAdminTestJSON-911368046 None] Volume volume-e77ac73c-9627-4c00-a371-aad93f103d95 (e77ac73c-9627-4c00-a371-aad93f103d95): created successfully
Apr 15 15:56:36 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-23a4f005-e70a-4a64-9c5e-a28a73a262d2 tempest-VolumeQuotasAdminTestJSON-911368046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60596d5d-89ee-48d0-868f-d82396933de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:56:36 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-23a4f005-e70a-4a64-9c5e-a28a73a262d2 tempest-VolumeQuotasAdminTestJSON-911368046 None] Flow 'volume_create_manager' (5f56da24-2776-4cc1-bda3-74d02a247a10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:56:36 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-23a4f005-e70a-4a64-9c5e-a28a73a262d2 tempest-VolumeQuotasAdminTestJSON-911368046 None] Created volume successfully.
Apr 15 15:56:36 devstack sudo[87776]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:36 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-30b0101e-ea78-4b4c-a0b4-5afc2b41d1cf tempest-VolumeTypesAccessTest-597260551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-68d92ed8-9326-4b7f-90b3-fcc5ae9dd4d4" returned: 0 in 0.591s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:36 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-30b0101e-ea78-4b4c-a0b4-5afc2b41d1cf tempest-VolumeTypesAccessTest-597260551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-68d92ed8-9326-4b7f-90b3-fcc5ae9dd4d4 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:36 devstack sudo[87784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-68d92ed8-9326-4b7f-90b3-fcc5ae9dd4d4
Apr 15 15:56:36 devstack sudo[87784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:36 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-019ac94a-4ea3-4eca-a361-89be649d4f34 tempest-VolumesNegativeTest-1226130539 None] Acquiring lock "cinder-51e16d55-8ca3-43f0-b725-35505a91118a-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:56:36 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-019ac94a-4ea3-4eca-a361-89be649d4f34 tempest-VolumesNegativeTest-1226130539 None] Lock "cinder-51e16d55-8ca3-43f0-b725-35505a91118a-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:56:36 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-019ac94a-4ea3-4eca-a361-89be649d4f34 tempest-VolumesNegativeTest-1226130539 None] Acquiring lock "cinder-quobyte-51e16d55-8ca3-43f0-b725-35505a91118a" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:56:36 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-019ac94a-4ea3-4eca-a361-89be649d4f34 tempest-VolumesNegativeTest-1226130539 None] Lock "cinder-quobyte-51e16d55-8ca3-43f0-b725-35505a91118a" acquired by "delete_volume" :: waited 0.007s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:56:36 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[72bccfb4-c372-4b24-b4f5-9262fceee967]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:56:36 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-019ac94a-4ea3-4eca-a361-89be649d4f34 tempest-VolumesNegativeTest-1226130539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-51e16d55-8ca3-43f0-b725-35505a91118a {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:36 devstack sudo[87784]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:36 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-30b0101e-ea78-4b4c-a0b4-5afc2b41d1cf tempest-VolumeTypesAccessTest-597260551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-68d92ed8-9326-4b7f-90b3-fcc5ae9dd4d4" returned: 0 in 0.433s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:36 devstack sudo[87787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-51e16d55-8ca3-43f0-b725-35505a91118a
Apr 15 15:56:36 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-30b0101e-ea78-4b4c-a0b4-5afc2b41d1cf tempest-VolumeTypesAccessTest-597260551 None] Lock "cinder-quobyte-68d92ed8-9326-4b7f-90b3-fcc5ae9dd4d4" released by "delete_volume" :: held 1.049s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:56:36 devstack sudo[87787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:36 devstack cinder-volume[82485]: WARNING cinder.quota [None req-30b0101e-ea78-4b4c-a0b4-5afc2b41d1cf tempest-VolumeTypesAccessTest-597260551 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1409880349 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1409880349, it is now deprecated. Please use the default quota class for default quota.
Apr 15 15:56:36 devstack cinder-volume[82485]: WARNING cinder.quota [None req-30b0101e-ea78-4b4c-a0b4-5afc2b41d1cf tempest-VolumeTypesAccessTest-597260551 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1409880349 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1409880349, it is now deprecated. Please use the default quota class for default quota.
Apr 15 15:56:36 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-30b0101e-ea78-4b4c-a0b4-5afc2b41d1cf tempest-VolumeTypesAccessTest-597260551 None] Created reservations ['4696a967-74fb-462f-ab98-8ff0a95f5a07', 'cb4f8423-3a9f-491f-ba99-1cbb64f05140', '00ec59e3-f74a-4c40-b2f5-7195062b4d8c', 'c26cead5-f226-4a05-ad93-d1842d4b94ca'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:56:36 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-30b0101e-ea78-4b4c-a0b4-5afc2b41d1cf tempest-VolumeTypesAccessTest-597260551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:56:36 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-30b0101e-ea78-4b4c-a0b4-5afc2b41d1cf tempest-VolumeTypesAccessTest-597260551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:56:36 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-30b0101e-ea78-4b4c-a0b4-5afc2b41d1cf tempest-VolumeTypesAccessTest-597260551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:56:36 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-30b0101e-ea78-4b4c-a0b4-5afc2b41d1cf tempest-VolumeTypesAccessTest-597260551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:56:36 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-30b0101e-ea78-4b4c-a0b4-5afc2b41d1cf tempest-VolumeTypesAccessTest-597260551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:56:36 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-30b0101e-ea78-4b4c-a0b4-5afc2b41d1cf tempest-VolumeTypesAccessTest-597260551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:36 devstack sudo[87789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:56:36 devstack sudo[87789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:37 devstack sudo[87787]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:37 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-019ac94a-4ea3-4eca-a361-89be649d4f34 tempest-VolumesNegativeTest-1226130539 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-51e16d55-8ca3-43f0-b725-35505a91118a" returned: 0 in 0.553s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:37 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-019ac94a-4ea3-4eca-a361-89be649d4f34 tempest-VolumesNegativeTest-1226130539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-51e16d55-8ca3-43f0-b725-35505a91118a {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:37 devstack sudo[87795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-51e16d55-8ca3-43f0-b725-35505a91118a
Apr 15 15:56:37 devstack sudo[87795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:37 devstack sudo[87789]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:37 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-30b0101e-ea78-4b4c-a0b4-5afc2b41d1cf tempest-VolumeTypesAccessTest-597260551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.479s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:37 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-30b0101e-ea78-4b4c-a0b4-5afc2b41d1cf tempest-VolumeTypesAccessTest-597260551 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:56:37 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-30b0101e-ea78-4b4c-a0b4-5afc2b41d1cf tempest-VolumeTypesAccessTest-597260551 None] Deleted volume successfully.
Apr 15 15:56:37 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-30b0101e-ea78-4b4c-a0b4-5afc2b41d1cf tempest-VolumeTypesAccessTest-597260551 None] Lock "cinder-68d92ed8-9326-4b7f-90b3-fcc5ae9dd4d4-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:56:37 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-5a75baa1-1646-45a2-b1e7-1a54ab3e2ffb tempest-VolumeQuotasAdminTestJSON-1900940050 None] Transfer volume completed successfully.
Apr 15 15:56:37 devstack sudo[87795]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:37 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-019ac94a-4ea3-4eca-a361-89be649d4f34 tempest-VolumesNegativeTest-1226130539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-51e16d55-8ca3-43f0-b725-35505a91118a" returned: 0 in 0.425s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:37 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-019ac94a-4ea3-4eca-a361-89be649d4f34 tempest-VolumesNegativeTest-1226130539 None] Lock "cinder-quobyte-51e16d55-8ca3-43f0-b725-35505a91118a" released by "delete_volume" :: held 1.010s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:56:37 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-019ac94a-4ea3-4eca-a361-89be649d4f34 tempest-VolumesNegativeTest-1226130539 None] Created reservations ['99aebb4b-4c4d-4e30-8293-a14fa55231eb', 'e68bc704-b7a1-4a52-96ba-1f1db9d4ee35', 'f9d3c20c-9afc-431f-a204-2d4571d340f2', 'e84df50e-6cc9-4c90-869d-83c1df7ebe40'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:56:37 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-019ac94a-4ea3-4eca-a361-89be649d4f34 tempest-VolumesNegativeTest-1226130539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:56:37 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-019ac94a-4ea3-4eca-a361-89be649d4f34 tempest-VolumesNegativeTest-1226130539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:56:37 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-019ac94a-4ea3-4eca-a361-89be649d4f34 tempest-VolumesNegativeTest-1226130539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:56:37 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-019ac94a-4ea3-4eca-a361-89be649d4f34 tempest-VolumesNegativeTest-1226130539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:56:37 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-019ac94a-4ea3-4eca-a361-89be649d4f34 tempest-VolumesNegativeTest-1226130539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:56:37 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-019ac94a-4ea3-4eca-a361-89be649d4f34 tempest-VolumesNegativeTest-1226130539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:37 devstack sudo[87798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:56:37 devstack sudo[87798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:38 devstack sudo[87798]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:38 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-019ac94a-4ea3-4eca-a361-89be649d4f34 tempest-VolumesNegativeTest-1226130539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.488s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:38 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-019ac94a-4ea3-4eca-a361-89be649d4f34 tempest-VolumesNegativeTest-1226130539 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:56:38 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-019ac94a-4ea3-4eca-a361-89be649d4f34 tempest-VolumesNegativeTest-1226130539 None] Deleted volume successfully.
Apr 15 15:56:38 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-019ac94a-4ea3-4eca-a361-89be649d4f34 tempest-VolumesNegativeTest-1226130539 None] Lock "cinder-51e16d55-8ca3-43f0-b725-35505a91118a-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:56:38 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-7032efc7-6d9b-4c10-a0c3-39e75688001b tempest-VolumeQuotasAdminTestJSON-543218053 None] Acquiring lock "cinder-e77ac73c-9627-4c00-a371-aad93f103d95-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:56:38 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-7032efc7-6d9b-4c10-a0c3-39e75688001b tempest-VolumeQuotasAdminTestJSON-543218053 None] Lock "cinder-e77ac73c-9627-4c00-a371-aad93f103d95-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:56:38 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-7032efc7-6d9b-4c10-a0c3-39e75688001b tempest-VolumeQuotasAdminTestJSON-543218053 None] Acquiring lock "cinder-quobyte-e77ac73c-9627-4c00-a371-aad93f103d95" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:56:38 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-7032efc7-6d9b-4c10-a0c3-39e75688001b tempest-VolumeQuotasAdminTestJSON-543218053 None] Lock "cinder-quobyte-e77ac73c-9627-4c00-a371-aad93f103d95" acquired by "delete_volume" :: waited 0.008s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:56:38 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[5438c391-cf44-4299-aa99-812c39dc4b3e]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:56:38 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7032efc7-6d9b-4c10-a0c3-39e75688001b tempest-VolumeQuotasAdminTestJSON-543218053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e77ac73c-9627-4c00-a371-aad93f103d95 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:38 devstack sudo[87801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e77ac73c-9627-4c00-a371-aad93f103d95
Apr 15 15:56:38 devstack sudo[87801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:39 devstack sudo[87801]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:39 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7032efc7-6d9b-4c10-a0c3-39e75688001b tempest-VolumeQuotasAdminTestJSON-543218053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e77ac73c-9627-4c00-a371-aad93f103d95" returned: 0 in 0.543s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:39 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7032efc7-6d9b-4c10-a0c3-39e75688001b tempest-VolumeQuotasAdminTestJSON-543218053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e77ac73c-9627-4c00-a371-aad93f103d95 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:39 devstack sudo[87806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e77ac73c-9627-4c00-a371-aad93f103d95
Apr 15 15:56:39 devstack sudo[87806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:39 devstack sudo[87806]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:39 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7032efc7-6d9b-4c10-a0c3-39e75688001b tempest-VolumeQuotasAdminTestJSON-543218053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e77ac73c-9627-4c00-a371-aad93f103d95" returned: 0 in 0.468s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:39 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-7032efc7-6d9b-4c10-a0c3-39e75688001b tempest-VolumeQuotasAdminTestJSON-543218053 None] Lock "cinder-quobyte-e77ac73c-9627-4c00-a371-aad93f103d95" released by "delete_volume" :: held 1.049s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:56:39 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-7032efc7-6d9b-4c10-a0c3-39e75688001b tempest-VolumeQuotasAdminTestJSON-543218053 None] Created reservations ['6b0e68a9-a27d-489e-a2fb-336289150f89', '6c7d4a3c-acdd-43bb-9f27-878efd8544e2', '8304f195-9ec6-47c8-be1a-bb6a0e389d1e', '1fc93d1d-a680-4a50-90f7-96b753bcbe4f'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:56:39 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7032efc7-6d9b-4c10-a0c3-39e75688001b tempest-VolumeQuotasAdminTestJSON-543218053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:56:39 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7032efc7-6d9b-4c10-a0c3-39e75688001b tempest-VolumeQuotasAdminTestJSON-543218053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:56:39 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-7032efc7-6d9b-4c10-a0c3-39e75688001b tempest-VolumeQuotasAdminTestJSON-543218053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:56:39 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-7032efc7-6d9b-4c10-a0c3-39e75688001b tempest-VolumeQuotasAdminTestJSON-543218053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:56:39 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7032efc7-6d9b-4c10-a0c3-39e75688001b tempest-VolumeQuotasAdminTestJSON-543218053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:56:39 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7032efc7-6d9b-4c10-a0c3-39e75688001b tempest-VolumeQuotasAdminTestJSON-543218053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:39 devstack sudo[87809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:56:39 devstack sudo[87809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:40 devstack sudo[87809]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:40 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7032efc7-6d9b-4c10-a0c3-39e75688001b tempest-VolumeQuotasAdminTestJSON-543218053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.550s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:40 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-7032efc7-6d9b-4c10-a0c3-39e75688001b tempest-VolumeQuotasAdminTestJSON-543218053 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:56:40 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-7032efc7-6d9b-4c10-a0c3-39e75688001b tempest-VolumeQuotasAdminTestJSON-543218053 None] Deleted volume successfully.
Apr 15 15:56:40 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-7032efc7-6d9b-4c10-a0c3-39e75688001b tempest-VolumeQuotasAdminTestJSON-543218053 None] Lock "cinder-e77ac73c-9627-4c00-a371-aad93f103d95-delete_volume" released by "delete_volume" :: held 1.747s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:56:44 devstack cinder-volume[82485]: DEBUG oslo_service.periodic_task [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82485) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 15 15:56:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:56:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:56:44 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:56:44 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:56:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:56:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:44 devstack sudo[87846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:56:44 devstack sudo[87846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:44 devstack sudo[87846]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.537s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:44 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:56:46 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1c8b475-1158-48b6-bd19-1aefbff36626 tempest-VolumeQuotasNegativeTestJSON-1774620537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:56:46 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-c1c8b475-1158-48b6-bd19-1aefbff36626 tempest-VolumeQuotasNegativeTestJSON-1774620537 None] Flow 'volume_create_manager' (40b11286-7338-4d52-b506-54cab1ae085f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:56:46 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-c1c8b475-1158-48b6-bd19-1aefbff36626 tempest-VolumeQuotasNegativeTestJSON-1774620537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50881ff6-e068-482b-83e9-3c35e7f12f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:56:46 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-c1c8b475-1158-48b6-bd19-1aefbff36626 tempest-VolumeQuotasNegativeTestJSON-1774620537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50881ff6-e068-482b-83e9-3c35e7f12f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:56:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2117925668',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d50868c8-da19-4f8f-ab23-c2c550e9737c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e16f94cd2f2e4513b110c9bb0f4274fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:56:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:56:46Z,use_quota=True,user_id='95b6209d055443a58db5a9487bdefc80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:56:46 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-c1c8b475-1158-48b6-bd19-1aefbff36626 tempest-VolumeQuotasNegativeTestJSON-1774620537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (554c202b-bb76-4890-a3ec-c303ffd9e6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:56:46 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-c1c8b475-1158-48b6-bd19-1aefbff36626 tempest-VolumeQuotasNegativeTestJSON-1774620537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (554c202b-bb76-4890-a3ec-c303ffd9e6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:56:46 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-c1c8b475-1158-48b6-bd19-1aefbff36626 tempest-VolumeQuotasNegativeTestJSON-1774620537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0428698a-a76e-4da1-98ef-88bec481cccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:56:46 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-c1c8b475-1158-48b6-bd19-1aefbff36626 tempest-VolumeQuotasNegativeTestJSON-1774620537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0428698a-a76e-4da1-98ef-88bec481cccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd50868c8-da19-4f8f-ab23-c2c550e9737c', 'volume_name': 'volume-d50868c8-da19-4f8f-ab23-c2c550e9737c', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:56:46 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-c1c8b475-1158-48b6-bd19-1aefbff36626 tempest-VolumeQuotasNegativeTestJSON-1774620537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2e39123-9e92-4ee2-bcd8-06907af0836a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:56:46 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-c1c8b475-1158-48b6-bd19-1aefbff36626 tempest-VolumeQuotasNegativeTestJSON-1774620537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2e39123-9e92-4ee2-bcd8-06907af0836a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:56:46 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-c1c8b475-1158-48b6-bd19-1aefbff36626 tempest-VolumeQuotasNegativeTestJSON-1774620537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce443ce5-90e0-434a-bdc4-55f0779325ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:56:46 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-c1c8b475-1158-48b6-bd19-1aefbff36626 tempest-VolumeQuotasNegativeTestJSON-1774620537 None] Volume d50868c8-da19-4f8f-ab23-c2c550e9737c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d50868c8-da19-4f8f-ab23-c2c550e9737c', 'volume_size': 1}
Apr 15 15:56:46 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-c1c8b475-1158-48b6-bd19-1aefbff36626 tempest-VolumeQuotasNegativeTestJSON-1774620537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:56:46 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-c1c8b475-1158-48b6-bd19-1aefbff36626 tempest-VolumeQuotasNegativeTestJSON-1774620537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:56:46 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-c1c8b475-1158-48b6-bd19-1aefbff36626 tempest-VolumeQuotasNegativeTestJSON-1774620537 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:56:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2117925668',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d50868c8-da19-4f8f-ab23-c2c550e9737c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e16f94cd2f2e4513b110c9bb0f4274fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:56:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:56:46Z,use_quota=True,user_id='95b6209d055443a58db5a9487bdefc80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:56:46 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-c1c8b475-1158-48b6-bd19-1aefbff36626 tempest-VolumeQuotasNegativeTestJSON-1774620537 None] Creating volume d50868c8-da19-4f8f-ab23-c2c550e9737c {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:56:46 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-c1c8b475-1158-48b6-bd19-1aefbff36626 tempest-VolumeQuotasNegativeTestJSON-1774620537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:56:46 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-c1c8b475-1158-48b6-bd19-1aefbff36626 tempest-VolumeQuotasNegativeTestJSON-1774620537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:56:46 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-c1c8b475-1158-48b6-bd19-1aefbff36626 tempest-VolumeQuotasNegativeTestJSON-1774620537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:56:46 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-c1c8b475-1158-48b6-bd19-1aefbff36626 tempest-VolumeQuotasNegativeTestJSON-1774620537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:56:46 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-c1c8b475-1158-48b6-bd19-1aefbff36626 tempest-VolumeQuotasNegativeTestJSON-1774620537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:56:46 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-c1c8b475-1158-48b6-bd19-1aefbff36626 tempest-VolumeQuotasNegativeTestJSON-1774620537 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:56:46 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-c1c8b475-1158-48b6-bd19-1aefbff36626 tempest-VolumeQuotasNegativeTestJSON-1774620537 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:56:46 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-c1c8b475-1158-48b6-bd19-1aefbff36626 tempest-VolumeQuotasNegativeTestJSON-1774620537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-d50868c8-da19-4f8f-ab23-c2c550e9737c 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:46 devstack sudo[87850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-d50868c8-da19-4f8f-ab23-c2c550e9737c 1073741824
Apr 15 15:56:46 devstack sudo[87850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:47 devstack sudo[87850]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:47 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-c1c8b475-1158-48b6-bd19-1aefbff36626 tempest-VolumeQuotasNegativeTestJSON-1774620537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-d50868c8-da19-4f8f-ab23-c2c550e9737c 1073741824" returned: 0 in 0.587s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:47 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-c1c8b475-1158-48b6-bd19-1aefbff36626 tempest-VolumeQuotasNegativeTestJSON-1774620537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-d50868c8-da19-4f8f-ab23-c2c550e9737c {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:47 devstack sudo[87855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-d50868c8-da19-4f8f-ab23-c2c550e9737c
Apr 15 15:56:47 devstack sudo[87855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:47 devstack sudo[87855]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:47 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-c1c8b475-1158-48b6-bd19-1aefbff36626 tempest-VolumeQuotasNegativeTestJSON-1774620537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-d50868c8-da19-4f8f-ab23-c2c550e9737c" returned: 0 in 0.562s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:47 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-c1c8b475-1158-48b6-bd19-1aefbff36626 tempest-VolumeQuotasNegativeTestJSON-1774620537 None] <== create_volume: return (1194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:56:47 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-c1c8b475-1158-48b6-bd19-1aefbff36626 tempest-VolumeQuotasNegativeTestJSON-1774620537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:56:47 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-c1c8b475-1158-48b6-bd19-1aefbff36626 tempest-VolumeQuotasNegativeTestJSON-1774620537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce443ce5-90e0-434a-bdc4-55f0779325ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d50868c8-da19-4f8f-ab23-c2c550e9737c', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:56:47 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-c1c8b475-1158-48b6-bd19-1aefbff36626 tempest-VolumeQuotasNegativeTestJSON-1774620537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f9de4c9-ffa2-4eaf-8b75-abac338460c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:56:47 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-c1c8b475-1158-48b6-bd19-1aefbff36626 tempest-VolumeQuotasNegativeTestJSON-1774620537 None] Volume volume-d50868c8-da19-4f8f-ab23-c2c550e9737c (d50868c8-da19-4f8f-ab23-c2c550e9737c): created successfully
Apr 15 15:56:47 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-c1c8b475-1158-48b6-bd19-1aefbff36626 tempest-VolumeQuotasNegativeTestJSON-1774620537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f9de4c9-ffa2-4eaf-8b75-abac338460c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:56:47 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-c1c8b475-1158-48b6-bd19-1aefbff36626 tempest-VolumeQuotasNegativeTestJSON-1774620537 None] Flow 'volume_create_manager' (40b11286-7338-4d52-b506-54cab1ae085f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:56:47 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-c1c8b475-1158-48b6-bd19-1aefbff36626 tempest-VolumeQuotasNegativeTestJSON-1774620537 None] Created volume successfully.
Apr 15 15:56:49 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-57a0c01d-750f-4b18-bb62-4599244da46e tempest-VolumeQuotasNegativeTestJSON-1774620537 None] Acquiring lock "cinder-d50868c8-da19-4f8f-ab23-c2c550e9737c-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:56:49 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-57a0c01d-750f-4b18-bb62-4599244da46e tempest-VolumeQuotasNegativeTestJSON-1774620537 None] Lock "cinder-d50868c8-da19-4f8f-ab23-c2c550e9737c-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:56:49 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-57a0c01d-750f-4b18-bb62-4599244da46e tempest-VolumeQuotasNegativeTestJSON-1774620537 None] Acquiring lock "cinder-quobyte-d50868c8-da19-4f8f-ab23-c2c550e9737c" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:56:49 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-57a0c01d-750f-4b18-bb62-4599244da46e tempest-VolumeQuotasNegativeTestJSON-1774620537 None] Lock "cinder-quobyte-d50868c8-da19-4f8f-ab23-c2c550e9737c" acquired by "delete_volume" :: waited 0.011s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:56:49 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a6b984-02f4-4d2c-b6fa-272585b82669]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:56:49 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-57a0c01d-750f-4b18-bb62-4599244da46e tempest-VolumeQuotasNegativeTestJSON-1774620537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-d50868c8-da19-4f8f-ab23-c2c550e9737c {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:49 devstack sudo[87858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-d50868c8-da19-4f8f-ab23-c2c550e9737c
Apr 15 15:56:49 devstack sudo[87858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:50 devstack sudo[87858]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:50 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-57a0c01d-750f-4b18-bb62-4599244da46e tempest-VolumeQuotasNegativeTestJSON-1774620537 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-d50868c8-da19-4f8f-ab23-c2c550e9737c" returned: 0 in 0.535s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:50 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-57a0c01d-750f-4b18-bb62-4599244da46e tempest-VolumeQuotasNegativeTestJSON-1774620537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-d50868c8-da19-4f8f-ab23-c2c550e9737c {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:50 devstack sudo[87863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-d50868c8-da19-4f8f-ab23-c2c550e9737c
Apr 15 15:56:50 devstack sudo[87863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:50 devstack sudo[87863]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:50 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-57a0c01d-750f-4b18-bb62-4599244da46e tempest-VolumeQuotasNegativeTestJSON-1774620537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-d50868c8-da19-4f8f-ab23-c2c550e9737c" returned: 0 in 0.594s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:50 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-57a0c01d-750f-4b18-bb62-4599244da46e tempest-VolumeQuotasNegativeTestJSON-1774620537 None] Lock "cinder-quobyte-d50868c8-da19-4f8f-ab23-c2c550e9737c" released by "delete_volume" :: held 1.165s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:56:50 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-57a0c01d-750f-4b18-bb62-4599244da46e tempest-VolumeQuotasNegativeTestJSON-1774620537 None] Created reservations ['3fab4de9-01a7-428a-92ce-14f12e46ee82', '645a9ad6-dcf6-4fe0-b183-37e3fdb59b76', 'ba57df7f-f5f9-48ba-9241-715d0cc01b10', 'b8427969-fd11-4cdb-800e-94c05d8dbc7c'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:56:50 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-57a0c01d-750f-4b18-bb62-4599244da46e tempest-VolumeQuotasNegativeTestJSON-1774620537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:56:50 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-57a0c01d-750f-4b18-bb62-4599244da46e tempest-VolumeQuotasNegativeTestJSON-1774620537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:56:50 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-57a0c01d-750f-4b18-bb62-4599244da46e tempest-VolumeQuotasNegativeTestJSON-1774620537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:56:50 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-57a0c01d-750f-4b18-bb62-4599244da46e tempest-VolumeQuotasNegativeTestJSON-1774620537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:56:50 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-57a0c01d-750f-4b18-bb62-4599244da46e tempest-VolumeQuotasNegativeTestJSON-1774620537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:56:50 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-57a0c01d-750f-4b18-bb62-4599244da46e tempest-VolumeQuotasNegativeTestJSON-1774620537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:50 devstack sudo[87866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:56:50 devstack sudo[87866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:50 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcd7183f-8dcd-4f1f-8826-8bbfcb0e5796 tempest-VolumesSnapshotTestJSON-539243248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:56:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-dcd7183f-8dcd-4f1f-8826-8bbfcb0e5796 tempest-VolumesSnapshotTestJSON-539243248 None] Flow 'volume_create_manager' (b39b8e8e-5b8b-4e21-8b50-d773a37ec76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:56:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-dcd7183f-8dcd-4f1f-8826-8bbfcb0e5796 tempest-VolumesSnapshotTestJSON-539243248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (868d39dd-493a-418c-9019-8e1821495981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:56:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-dcd7183f-8dcd-4f1f-8826-8bbfcb0e5796 tempest-VolumesSnapshotTestJSON-539243248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (868d39dd-493a-418c-9019-8e1821495981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:56:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-598519727',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9063d82-911e-40dc-994c-8f69a9f20727,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='684ff22a15b54836b8ad525b331c7ac4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:56:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:56:51Z,use_quota=True,user_id='c6701d96ef4a437a9b23c523b99519f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:56:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-dcd7183f-8dcd-4f1f-8826-8bbfcb0e5796 tempest-VolumesSnapshotTestJSON-539243248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18367f8b-80bf-4132-8f42-d175f458a36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:56:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-dcd7183f-8dcd-4f1f-8826-8bbfcb0e5796 tempest-VolumesSnapshotTestJSON-539243248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18367f8b-80bf-4132-8f42-d175f458a36b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:56:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-dcd7183f-8dcd-4f1f-8826-8bbfcb0e5796 tempest-VolumesSnapshotTestJSON-539243248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bb7d3f3-1d6e-4e71-88a1-d9256ae788cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:56:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-dcd7183f-8dcd-4f1f-8826-8bbfcb0e5796 tempest-VolumesSnapshotTestJSON-539243248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bb7d3f3-1d6e-4e71-88a1-d9256ae788cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9063d82-911e-40dc-994c-8f69a9f20727', 'volume_name': 'volume-c9063d82-911e-40dc-994c-8f69a9f20727', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:56:51 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-dcd7183f-8dcd-4f1f-8826-8bbfcb0e5796 tempest-VolumesSnapshotTestJSON-539243248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (258379ec-0d1e-4b95-90e9-afcd286f2e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:56:51 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-dcd7183f-8dcd-4f1f-8826-8bbfcb0e5796 tempest-VolumesSnapshotTestJSON-539243248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (258379ec-0d1e-4b95-90e9-afcd286f2e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:56:51 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-dcd7183f-8dcd-4f1f-8826-8bbfcb0e5796 tempest-VolumesSnapshotTestJSON-539243248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69221579-4d8b-4ced-8caa-e83190c86d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:56:51 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-dcd7183f-8dcd-4f1f-8826-8bbfcb0e5796 tempest-VolumesSnapshotTestJSON-539243248 None] Volume c9063d82-911e-40dc-994c-8f69a9f20727: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9063d82-911e-40dc-994c-8f69a9f20727', 'volume_size': 1}
Apr 15 15:56:51 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-dcd7183f-8dcd-4f1f-8826-8bbfcb0e5796 tempest-VolumesSnapshotTestJSON-539243248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:56:51 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-dcd7183f-8dcd-4f1f-8826-8bbfcb0e5796 tempest-VolumesSnapshotTestJSON-539243248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:56:51 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-dcd7183f-8dcd-4f1f-8826-8bbfcb0e5796 tempest-VolumesSnapshotTestJSON-539243248 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:56:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-598519727',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9063d82-911e-40dc-994c-8f69a9f20727,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='684ff22a15b54836b8ad525b331c7ac4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:56:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:56:51Z,use_quota=True,user_id='c6701d96ef4a437a9b23c523b99519f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:56:51 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-dcd7183f-8dcd-4f1f-8826-8bbfcb0e5796 tempest-VolumesSnapshotTestJSON-539243248 None] Creating volume c9063d82-911e-40dc-994c-8f69a9f20727 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:56:51 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-dcd7183f-8dcd-4f1f-8826-8bbfcb0e5796 tempest-VolumesSnapshotTestJSON-539243248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:56:51 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-dcd7183f-8dcd-4f1f-8826-8bbfcb0e5796 tempest-VolumesSnapshotTestJSON-539243248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:56:51 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-dcd7183f-8dcd-4f1f-8826-8bbfcb0e5796 tempest-VolumesSnapshotTestJSON-539243248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:56:51 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-dcd7183f-8dcd-4f1f-8826-8bbfcb0e5796 tempest-VolumesSnapshotTestJSON-539243248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:56:51 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-dcd7183f-8dcd-4f1f-8826-8bbfcb0e5796 tempest-VolumesSnapshotTestJSON-539243248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:56:51 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-dcd7183f-8dcd-4f1f-8826-8bbfcb0e5796 tempest-VolumesSnapshotTestJSON-539243248 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:56:51 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-dcd7183f-8dcd-4f1f-8826-8bbfcb0e5796 tempest-VolumesSnapshotTestJSON-539243248 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:56:51 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-dcd7183f-8dcd-4f1f-8826-8bbfcb0e5796 tempest-VolumesSnapshotTestJSON-539243248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c9063d82-911e-40dc-994c-8f69a9f20727 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:51 devstack sudo[87868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c9063d82-911e-40dc-994c-8f69a9f20727 1073741824
Apr 15 15:56:51 devstack sudo[87868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:51 devstack sudo[87866]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:51 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-57a0c01d-750f-4b18-bb62-4599244da46e tempest-VolumeQuotasNegativeTestJSON-1774620537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.529s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:51 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-57a0c01d-750f-4b18-bb62-4599244da46e tempest-VolumeQuotasNegativeTestJSON-1774620537 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:56:51 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-378ca8bb-df7a-4b2b-a533-86c487418af6 tempest-AbsoluteLimitsTests-295855329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:56:51 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-378ca8bb-df7a-4b2b-a533-86c487418af6 tempest-AbsoluteLimitsTests-295855329 None] Flow 'volume_create_manager' (f94796e1-9039-46c9-9313-1e186b1f3735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:56:51 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-378ca8bb-df7a-4b2b-a533-86c487418af6 tempest-AbsoluteLimitsTests-295855329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a8b6608-0d8c-4e10-a8f6-586f99172087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:56:51 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-378ca8bb-df7a-4b2b-a533-86c487418af6 tempest-AbsoluteLimitsTests-295855329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a8b6608-0d8c-4e10-a8f6-586f99172087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:56:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1561374040',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6800264e-a553-4586-96b1-e5104fc51142,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6eeb1621de0488f8fb2bdd6a60c8c46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:56:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:56:51Z,use_quota=True,user_id='77eaa749b4ca4edc8503f88d4988ad6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:56:51 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-378ca8bb-df7a-4b2b-a533-86c487418af6 tempest-AbsoluteLimitsTests-295855329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e34ce42a-c578-48b1-80bd-32c0222c06df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:56:51 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-378ca8bb-df7a-4b2b-a533-86c487418af6 tempest-AbsoluteLimitsTests-295855329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e34ce42a-c578-48b1-80bd-32c0222c06df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:56:51 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-378ca8bb-df7a-4b2b-a533-86c487418af6 tempest-AbsoluteLimitsTests-295855329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dc09e89-d4f9-4ea0-b50a-1b7b98700d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:56:51 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-378ca8bb-df7a-4b2b-a533-86c487418af6 tempest-AbsoluteLimitsTests-295855329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dc09e89-d4f9-4ea0-b50a-1b7b98700d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6800264e-a553-4586-96b1-e5104fc51142', 'volume_name': 'volume-6800264e-a553-4586-96b1-e5104fc51142', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:56:51 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-378ca8bb-df7a-4b2b-a533-86c487418af6 tempest-AbsoluteLimitsTests-295855329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22e6a7f4-2a78-4308-b375-1e61c697c39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:56:51 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-378ca8bb-df7a-4b2b-a533-86c487418af6 tempest-AbsoluteLimitsTests-295855329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22e6a7f4-2a78-4308-b375-1e61c697c39f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:56:51 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-378ca8bb-df7a-4b2b-a533-86c487418af6 tempest-AbsoluteLimitsTests-295855329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e2daa12-ab21-4824-993f-aee28310160c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:56:51 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-378ca8bb-df7a-4b2b-a533-86c487418af6 tempest-AbsoluteLimitsTests-295855329 None] Volume 6800264e-a553-4586-96b1-e5104fc51142: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6800264e-a553-4586-96b1-e5104fc51142', 'volume_size': 1}
Apr 15 15:56:51 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-378ca8bb-df7a-4b2b-a533-86c487418af6 tempest-AbsoluteLimitsTests-295855329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:56:51 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-57a0c01d-750f-4b18-bb62-4599244da46e tempest-VolumeQuotasNegativeTestJSON-1774620537 None] Deleted volume successfully.
Apr 15 15:56:51 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-57a0c01d-750f-4b18-bb62-4599244da46e tempest-VolumeQuotasNegativeTestJSON-1774620537 None] Lock "cinder-d50868c8-da19-4f8f-ab23-c2c550e9737c-delete_volume" released by "delete_volume" :: held 1.926s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:56:51 devstack sudo[87868]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:51 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-dcd7183f-8dcd-4f1f-8826-8bbfcb0e5796 tempest-VolumesSnapshotTestJSON-539243248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c9063d82-911e-40dc-994c-8f69a9f20727 1073741824" returned: 0 in 0.598s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:51 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-dcd7183f-8dcd-4f1f-8826-8bbfcb0e5796 tempest-VolumesSnapshotTestJSON-539243248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c9063d82-911e-40dc-994c-8f69a9f20727 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:51 devstack sudo[87874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c9063d82-911e-40dc-994c-8f69a9f20727
Apr 15 15:56:51 devstack sudo[87874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:52 devstack sudo[87874]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:52 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-dcd7183f-8dcd-4f1f-8826-8bbfcb0e5796 tempest-VolumesSnapshotTestJSON-539243248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c9063d82-911e-40dc-994c-8f69a9f20727" returned: 0 in 0.491s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:52 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-dcd7183f-8dcd-4f1f-8826-8bbfcb0e5796 tempest-VolumesSnapshotTestJSON-539243248 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:56:52 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-dcd7183f-8dcd-4f1f-8826-8bbfcb0e5796 tempest-VolumesSnapshotTestJSON-539243248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:56:52 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-378ca8bb-df7a-4b2b-a533-86c487418af6 tempest-AbsoluteLimitsTests-295855329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.756s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:56:52 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-378ca8bb-df7a-4b2b-a533-86c487418af6 tempest-AbsoluteLimitsTests-295855329 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:56:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1561374040',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6800264e-a553-4586-96b1-e5104fc51142,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6eeb1621de0488f8fb2bdd6a60c8c46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:56:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:56:51Z,use_quota=True,user_id='77eaa749b4ca4edc8503f88d4988ad6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:56:52 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-378ca8bb-df7a-4b2b-a533-86c487418af6 tempest-AbsoluteLimitsTests-295855329 None] Creating volume 6800264e-a553-4586-96b1-e5104fc51142 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:56:52 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-378ca8bb-df7a-4b2b-a533-86c487418af6 tempest-AbsoluteLimitsTests-295855329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:56:52 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-378ca8bb-df7a-4b2b-a533-86c487418af6 tempest-AbsoluteLimitsTests-295855329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:56:52 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-378ca8bb-df7a-4b2b-a533-86c487418af6 tempest-AbsoluteLimitsTests-295855329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:56:52 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-378ca8bb-df7a-4b2b-a533-86c487418af6 tempest-AbsoluteLimitsTests-295855329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:56:52 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-378ca8bb-df7a-4b2b-a533-86c487418af6 tempest-AbsoluteLimitsTests-295855329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:56:52 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-378ca8bb-df7a-4b2b-a533-86c487418af6 tempest-AbsoluteLimitsTests-295855329 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:56:52 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-378ca8bb-df7a-4b2b-a533-86c487418af6 tempest-AbsoluteLimitsTests-295855329 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:56:52 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-378ca8bb-df7a-4b2b-a533-86c487418af6 tempest-AbsoluteLimitsTests-295855329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6800264e-a553-4586-96b1-e5104fc51142 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:52 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-dcd7183f-8dcd-4f1f-8826-8bbfcb0e5796 tempest-VolumesSnapshotTestJSON-539243248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69221579-4d8b-4ced-8caa-e83190c86d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9063d82-911e-40dc-994c-8f69a9f20727', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:56:52 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-dcd7183f-8dcd-4f1f-8826-8bbfcb0e5796 tempest-VolumesSnapshotTestJSON-539243248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c154a59c-5ee1-43de-85d5-5ce8c9605f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:56:52 devstack sudo[87877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6800264e-a553-4586-96b1-e5104fc51142 1073741824
Apr 15 15:56:52 devstack sudo[87877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:52 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-dcd7183f-8dcd-4f1f-8826-8bbfcb0e5796 tempest-VolumesSnapshotTestJSON-539243248 None] Volume volume-c9063d82-911e-40dc-994c-8f69a9f20727 (c9063d82-911e-40dc-994c-8f69a9f20727): created successfully
Apr 15 15:56:52 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-dcd7183f-8dcd-4f1f-8826-8bbfcb0e5796 tempest-VolumesSnapshotTestJSON-539243248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c154a59c-5ee1-43de-85d5-5ce8c9605f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:56:52 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-dcd7183f-8dcd-4f1f-8826-8bbfcb0e5796 tempest-VolumesSnapshotTestJSON-539243248 None] Flow 'volume_create_manager' (b39b8e8e-5b8b-4e21-8b50-d773a37ec76d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:56:52 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-dcd7183f-8dcd-4f1f-8826-8bbfcb0e5796 tempest-VolumesSnapshotTestJSON-539243248 None] Created volume successfully.
Apr 15 15:56:52 devstack sudo[87877]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:52 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-378ca8bb-df7a-4b2b-a533-86c487418af6 tempest-AbsoluteLimitsTests-295855329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6800264e-a553-4586-96b1-e5104fc51142 1073741824" returned: 0 in 0.517s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:52 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-378ca8bb-df7a-4b2b-a533-86c487418af6 tempest-AbsoluteLimitsTests-295855329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6800264e-a553-4586-96b1-e5104fc51142 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:52 devstack sudo[87882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6800264e-a553-4586-96b1-e5104fc51142
Apr 15 15:56:52 devstack sudo[87882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:53 devstack sudo[87882]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:53 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-378ca8bb-df7a-4b2b-a533-86c487418af6 tempest-AbsoluteLimitsTests-295855329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6800264e-a553-4586-96b1-e5104fc51142" returned: 0 in 0.511s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:53 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-378ca8bb-df7a-4b2b-a533-86c487418af6 tempest-AbsoluteLimitsTests-295855329 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:56:53 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-378ca8bb-df7a-4b2b-a533-86c487418af6 tempest-AbsoluteLimitsTests-295855329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:56:53 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-378ca8bb-df7a-4b2b-a533-86c487418af6 tempest-AbsoluteLimitsTests-295855329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e2daa12-ab21-4824-993f-aee28310160c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6800264e-a553-4586-96b1-e5104fc51142', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:56:53 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-378ca8bb-df7a-4b2b-a533-86c487418af6 tempest-AbsoluteLimitsTests-295855329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f3c52e5-5256-41ac-8908-82af64772160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:56:53 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-378ca8bb-df7a-4b2b-a533-86c487418af6 tempest-AbsoluteLimitsTests-295855329 None] Volume volume-6800264e-a553-4586-96b1-e5104fc51142 (6800264e-a553-4586-96b1-e5104fc51142): created successfully
Apr 15 15:56:53 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-378ca8bb-df7a-4b2b-a533-86c487418af6 tempest-AbsoluteLimitsTests-295855329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f3c52e5-5256-41ac-8908-82af64772160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:56:53 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-378ca8bb-df7a-4b2b-a533-86c487418af6 tempest-AbsoluteLimitsTests-295855329 None] Flow 'volume_create_manager' (f94796e1-9039-46c9-9313-1e186b1f3735) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:56:53 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-378ca8bb-df7a-4b2b-a533-86c487418af6 tempest-AbsoluteLimitsTests-295855329 None] Created volume successfully.
Apr 15 15:56:53 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-857aeec4-3508-4d39-ad66-de2c6205ada2 tempest-VolumesSnapshotTestJSON-539243248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:56:53 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-857aeec4-3508-4d39-ad66-de2c6205ada2 tempest-VolumesSnapshotTestJSON-539243248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:56:53 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-857aeec4-3508-4d39-ad66-de2c6205ada2 tempest-VolumesSnapshotTestJSON-539243248 None] Creating offline snapshot 6efc70ff-3c02-4878-bc37-f2beac864007 of volume c9063d82-911e-40dc-994c-8f69a9f20727 {{(pid=82485) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 15:56:53 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5fb9869-62fa-4566-baca-d74e44423fe4]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:56:53 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-857aeec4-3508-4d39-ad66-de2c6205ada2 tempest-VolumesSnapshotTestJSON-539243248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c9063d82-911e-40dc-994c-8f69a9f20727 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:53 devstack sudo[87885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c9063d82-911e-40dc-994c-8f69a9f20727
Apr 15 15:56:53 devstack sudo[87885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:53 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-7759ed9f-f2ec-4e01-a34c-987c478b2559 tempest-AbsoluteLimitsTests-295855329 None] Acquiring lock "cinder-6800264e-a553-4586-96b1-e5104fc51142-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:56:53 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-7759ed9f-f2ec-4e01-a34c-987c478b2559 tempest-AbsoluteLimitsTests-295855329 None] Lock "cinder-6800264e-a553-4586-96b1-e5104fc51142-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:56:53 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-7759ed9f-f2ec-4e01-a34c-987c478b2559 tempest-AbsoluteLimitsTests-295855329 None] Acquiring lock "cinder-quobyte-6800264e-a553-4586-96b1-e5104fc51142" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:56:53 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-7759ed9f-f2ec-4e01-a34c-987c478b2559 tempest-AbsoluteLimitsTests-295855329 None] Lock "cinder-quobyte-6800264e-a553-4586-96b1-e5104fc51142" acquired by "delete_volume" :: waited 0.010s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:56:53 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b6a195-b074-4377-978c-d878e3b2cc0c]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:56:53 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7759ed9f-f2ec-4e01-a34c-987c478b2559 tempest-AbsoluteLimitsTests-295855329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6800264e-a553-4586-96b1-e5104fc51142 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:53 devstack sudo[87887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6800264e-a553-4586-96b1-e5104fc51142
Apr 15 15:56:53 devstack sudo[87887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:53 devstack sudo[87885]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:53 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-857aeec4-3508-4d39-ad66-de2c6205ada2 tempest-VolumesSnapshotTestJSON-539243248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c9063d82-911e-40dc-994c-8f69a9f20727" returned: 0 in 0.521s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:53 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-857aeec4-3508-4d39-ad66-de2c6205ada2 tempest-VolumesSnapshotTestJSON-539243248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c9063d82-911e-40dc-994c-8f69a9f20727,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c9063d82-911e-40dc-994c-8f69a9f20727.6efc70ff-3c02-4878-bc37-f2beac864007 1G {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:53 devstack sudo[87892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c9063d82-911e-40dc-994c-8f69a9f20727,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c9063d82-911e-40dc-994c-8f69a9f20727.6efc70ff-3c02-4878-bc37-f2beac864007 1G
Apr 15 15:56:53 devstack sudo[87892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:54 devstack sudo[87887]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7759ed9f-f2ec-4e01-a34c-987c478b2559 tempest-AbsoluteLimitsTests-295855329 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6800264e-a553-4586-96b1-e5104fc51142" returned: 0 in 0.542s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7759ed9f-f2ec-4e01-a34c-987c478b2559 tempest-AbsoluteLimitsTests-295855329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6800264e-a553-4586-96b1-e5104fc51142 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:54 devstack sudo[87897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6800264e-a553-4586-96b1-e5104fc51142
Apr 15 15:56:54 devstack sudo[87897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:54 devstack sudo[87892]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-857aeec4-3508-4d39-ad66-de2c6205ada2 tempest-VolumesSnapshotTestJSON-539243248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c9063d82-911e-40dc-994c-8f69a9f20727,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c9063d82-911e-40dc-994c-8f69a9f20727.6efc70ff-3c02-4878-bc37-f2beac864007 1G" returned: 0 in 0.520s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-857aeec4-3508-4d39-ad66-de2c6205ada2 tempest-VolumesSnapshotTestJSON-539243248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9063d82-911e-40dc-994c-8f69a9f20727 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c9063d82-911e-40dc-994c-8f69a9f20727.6efc70ff-3c02-4878-bc37-f2beac864007 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:54 devstack sudo[87902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9063d82-911e-40dc-994c-8f69a9f20727 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c9063d82-911e-40dc-994c-8f69a9f20727.6efc70ff-3c02-4878-bc37-f2beac864007
Apr 15 15:56:54 devstack sudo[87902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:54 devstack sudo[87897]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7759ed9f-f2ec-4e01-a34c-987c478b2559 tempest-AbsoluteLimitsTests-295855329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6800264e-a553-4586-96b1-e5104fc51142" returned: 0 in 0.485s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:54 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-7759ed9f-f2ec-4e01-a34c-987c478b2559 tempest-AbsoluteLimitsTests-295855329 None] Lock "cinder-quobyte-6800264e-a553-4586-96b1-e5104fc51142" released by "delete_volume" :: held 1.060s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:56:54 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-7759ed9f-f2ec-4e01-a34c-987c478b2559 tempest-AbsoluteLimitsTests-295855329 None] Created reservations ['99136587-a621-440a-86da-988be579eee8', '400791d5-a966-42a5-bcda-276883e4602a', '8d952695-a284-4123-891b-9ee1cdc52b2f', '5762ae5f-fb5f-43b3-b930-1b01c81b9a5e'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:56:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7759ed9f-f2ec-4e01-a34c-987c478b2559 tempest-AbsoluteLimitsTests-295855329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:56:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7759ed9f-f2ec-4e01-a34c-987c478b2559 tempest-AbsoluteLimitsTests-295855329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:56:54 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-7759ed9f-f2ec-4e01-a34c-987c478b2559 tempest-AbsoluteLimitsTests-295855329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:56:54 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-7759ed9f-f2ec-4e01-a34c-987c478b2559 tempest-AbsoluteLimitsTests-295855329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:56:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7759ed9f-f2ec-4e01-a34c-987c478b2559 tempest-AbsoluteLimitsTests-295855329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:56:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7759ed9f-f2ec-4e01-a34c-987c478b2559 tempest-AbsoluteLimitsTests-295855329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:54 devstack sudo[87909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:56:54 devstack sudo[87909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:54 devstack sudo[87902]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-857aeec4-3508-4d39-ad66-de2c6205ada2 tempest-VolumesSnapshotTestJSON-539243248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9063d82-911e-40dc-994c-8f69a9f20727 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c9063d82-911e-40dc-994c-8f69a9f20727.6efc70ff-3c02-4878-bc37-f2beac864007" returned: 0 in 0.488s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:54 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-857aeec4-3508-4d39-ad66-de2c6205ada2 tempest-VolumesSnapshotTestJSON-539243248 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c9063d82-911e-40dc-994c-8f69a9f20727.6efc70ff-3c02-4878-bc37-f2beac864007 is being set with open permissions: ugo+rw
Apr 15 15:56:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-857aeec4-3508-4d39-ad66-de2c6205ada2 tempest-VolumesSnapshotTestJSON-539243248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c9063d82-911e-40dc-994c-8f69a9f20727.6efc70ff-3c02-4878-bc37-f2beac864007 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:54 devstack sudo[87911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c9063d82-911e-40dc-994c-8f69a9f20727.6efc70ff-3c02-4878-bc37-f2beac864007
Apr 15 15:56:54 devstack sudo[87911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:55 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-295966dc-b303-4694-80b0-374bba205da9 tempest-VolumeRetypeWithoutMigrationTest-1997827928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:56:55 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-295966dc-b303-4694-80b0-374bba205da9 tempest-VolumeRetypeWithoutMigrationTest-1997827928 None] Flow 'volume_create_manager' (cfd57116-9574-4f75-b863-09e38037c5cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:56:55 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-295966dc-b303-4694-80b0-374bba205da9 tempest-VolumeRetypeWithoutMigrationTest-1997827928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2129686e-90ea-41c1-9b38-7727691ec0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:56:55 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-295966dc-b303-4694-80b0-374bba205da9 tempest-VolumeRetypeWithoutMigrationTest-1997827928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2129686e-90ea-41c1-9b38-7727691ec0d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:56:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1744600905',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76cbcb84-1565-4d15-a8e5-32acf6684efe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35747b4d07a44f29ad62775f3c1674b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:56:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:56:55Z,use_quota=True,user_id='2ccf4d44081c451a83f73e3da8211874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52dddb1a-28cd-4a1e-ba4c-1f17a381b8ba),volume_type_id=52dddb1a-28cd-4a1e-ba4c-1f17a381b8ba)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:56:55 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-295966dc-b303-4694-80b0-374bba205da9 tempest-VolumeRetypeWithoutMigrationTest-1997827928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87b0d87a-96cb-4b91-af70-bf06c09fab25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:56:55 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-295966dc-b303-4694-80b0-374bba205da9 tempest-VolumeRetypeWithoutMigrationTest-1997827928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87b0d87a-96cb-4b91-af70-bf06c09fab25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:56:55 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-295966dc-b303-4694-80b0-374bba205da9 tempest-VolumeRetypeWithoutMigrationTest-1997827928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (141ec816-374e-4fd4-b910-977e24ab282c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:56:55 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-295966dc-b303-4694-80b0-374bba205da9 tempest-VolumeRetypeWithoutMigrationTest-1997827928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (141ec816-374e-4fd4-b910-977e24ab282c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76cbcb84-1565-4d15-a8e5-32acf6684efe', 'volume_name': 'volume-76cbcb84-1565-4d15-a8e5-32acf6684efe', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:56:55 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-295966dc-b303-4694-80b0-374bba205da9 tempest-VolumeRetypeWithoutMigrationTest-1997827928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16c05a6a-79ce-4eef-a99f-e1b984442461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:56:55 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-295966dc-b303-4694-80b0-374bba205da9 tempest-VolumeRetypeWithoutMigrationTest-1997827928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16c05a6a-79ce-4eef-a99f-e1b984442461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:56:55 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-295966dc-b303-4694-80b0-374bba205da9 tempest-VolumeRetypeWithoutMigrationTest-1997827928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0961f57b-67b3-4f3c-8c19-da325edc9846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:56:55 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-295966dc-b303-4694-80b0-374bba205da9 tempest-VolumeRetypeWithoutMigrationTest-1997827928 None] Volume 76cbcb84-1565-4d15-a8e5-32acf6684efe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76cbcb84-1565-4d15-a8e5-32acf6684efe', 'volume_size': 1}
Apr 15 15:56:55 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-295966dc-b303-4694-80b0-374bba205da9 tempest-VolumeRetypeWithoutMigrationTest-1997827928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:56:55 devstack sudo[87909]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:55 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7759ed9f-f2ec-4e01-a34c-987c478b2559 tempest-AbsoluteLimitsTests-295855329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.484s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:55 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-7759ed9f-f2ec-4e01-a34c-987c478b2559 tempest-AbsoluteLimitsTests-295855329 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:56:55 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-7759ed9f-f2ec-4e01-a34c-987c478b2559 tempest-AbsoluteLimitsTests-295855329 None] Deleted volume successfully.
Apr 15 15:56:55 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-7759ed9f-f2ec-4e01-a34c-987c478b2559 tempest-AbsoluteLimitsTests-295855329 None] Lock "cinder-6800264e-a553-4586-96b1-e5104fc51142-delete_volume" released by "delete_volume" :: held 1.697s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:56:55 devstack sudo[87911]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:55 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-857aeec4-3508-4d39-ad66-de2c6205ada2 tempest-VolumesSnapshotTestJSON-539243248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c9063d82-911e-40dc-994c-8f69a9f20727.6efc70ff-3c02-4878-bc37-f2beac864007" returned: 0 in 0.477s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:55 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-857aeec4-3508-4d39-ad66-de2c6205ada2 tempest-VolumesSnapshotTestJSON-539243248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c9063d82-911e-40dc-994c-8f69a9f20727.info {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:55 devstack sudo[87917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c9063d82-911e-40dc-994c-8f69a9f20727.info
Apr 15 15:56:55 devstack sudo[87917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:55 devstack sudo[87917]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:55 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-857aeec4-3508-4d39-ad66-de2c6205ada2 tempest-VolumesSnapshotTestJSON-539243248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c9063d82-911e-40dc-994c-8f69a9f20727.info" returned: 0 in 0.439s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:55 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-857aeec4-3508-4d39-ad66-de2c6205ada2 tempest-VolumesSnapshotTestJSON-539243248 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c9063d82-911e-40dc-994c-8f69a9f20727.info is being set with open permissions: ugo+rw
Apr 15 15:56:55 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-857aeec4-3508-4d39-ad66-de2c6205ada2 tempest-VolumesSnapshotTestJSON-539243248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c9063d82-911e-40dc-994c-8f69a9f20727.info {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:55 devstack sudo[87920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c9063d82-911e-40dc-994c-8f69a9f20727.info
Apr 15 15:56:55 devstack sudo[87920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:56 devstack sudo[87920]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:56 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-857aeec4-3508-4d39-ad66-de2c6205ada2 tempest-VolumesSnapshotTestJSON-539243248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c9063d82-911e-40dc-994c-8f69a9f20727.info" returned: 0 in 0.442s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:56 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-857aeec4-3508-4d39-ad66-de2c6205ada2 tempest-VolumesSnapshotTestJSON-539243248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.961s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:56:56 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-295966dc-b303-4694-80b0-374bba205da9 tempest-VolumeRetypeWithoutMigrationTest-1997827928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.076s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:56:56 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-295966dc-b303-4694-80b0-374bba205da9 tempest-VolumeRetypeWithoutMigrationTest-1997827928 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:56:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1744600905',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76cbcb84-1565-4d15-a8e5-32acf6684efe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35747b4d07a44f29ad62775f3c1674b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:56:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:56:55Z,use_quota=True,user_id='2ccf4d44081c451a83f73e3da8211874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52dddb1a-28cd-4a1e-ba4c-1f17a381b8ba),volume_type_id=52dddb1a-28cd-4a1e-ba4c-1f17a381b8ba)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:56:56 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-295966dc-b303-4694-80b0-374bba205da9 tempest-VolumeRetypeWithoutMigrationTest-1997827928 None] Creating volume 76cbcb84-1565-4d15-a8e5-32acf6684efe {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:56:56 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-295966dc-b303-4694-80b0-374bba205da9 tempest-VolumeRetypeWithoutMigrationTest-1997827928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:56:56 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-295966dc-b303-4694-80b0-374bba205da9 tempest-VolumeRetypeWithoutMigrationTest-1997827928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:56:56 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-295966dc-b303-4694-80b0-374bba205da9 tempest-VolumeRetypeWithoutMigrationTest-1997827928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:56:56 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-295966dc-b303-4694-80b0-374bba205da9 tempest-VolumeRetypeWithoutMigrationTest-1997827928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:56:56 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-295966dc-b303-4694-80b0-374bba205da9 tempest-VolumeRetypeWithoutMigrationTest-1997827928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:56:56 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-295966dc-b303-4694-80b0-374bba205da9 tempest-VolumeRetypeWithoutMigrationTest-1997827928 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:56:56 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-295966dc-b303-4694-80b0-374bba205da9 tempest-VolumeRetypeWithoutMigrationTest-1997827928 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:56:56 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-295966dc-b303-4694-80b0-374bba205da9 tempest-VolumeRetypeWithoutMigrationTest-1997827928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-76cbcb84-1565-4d15-a8e5-32acf6684efe 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:56 devstack sudo[87923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-76cbcb84-1565-4d15-a8e5-32acf6684efe 1073741824
Apr 15 15:56:56 devstack sudo[87923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:56 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-857aeec4-3508-4d39-ad66-de2c6205ada2 tempest-VolumesSnapshotTestJSON-539243248 None] Create snapshot completed successfully
Apr 15 15:56:56 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-9355b0cb-6855-4827-8b64-52949004edcf tempest-VolumesSnapshotTestJSON-539243248 None] Acquiring lock "cinder-6efc70ff-3c02-4878-bc37-f2beac864007-delete_snapshot" by "delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:56:56 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-9355b0cb-6855-4827-8b64-52949004edcf tempest-VolumesSnapshotTestJSON-539243248 None] Lock "cinder-6efc70ff-3c02-4878-bc37-f2beac864007-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:56:56 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-9355b0cb-6855-4827-8b64-52949004edcf tempest-VolumesSnapshotTestJSON-539243248 None] Acquiring lock "cinder-quobyte-c9063d82-911e-40dc-994c-8f69a9f20727" by "delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:56:56 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-9355b0cb-6855-4827-8b64-52949004edcf tempest-VolumesSnapshotTestJSON-539243248 None] Lock "cinder-quobyte-c9063d82-911e-40dc-994c-8f69a9f20727" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:56:56 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-9355b0cb-6855-4827-8b64-52949004edcf tempest-VolumesSnapshotTestJSON-539243248 None] Acquiring lock "cinder-quobyte-6efc70ff-3c02-4878-bc37-f2beac864007" by "_delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:56:56 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-9355b0cb-6855-4827-8b64-52949004edcf tempest-VolumesSnapshotTestJSON-539243248 None] Lock "cinder-quobyte-6efc70ff-3c02-4878-bc37-f2beac864007" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:56:56 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-9355b0cb-6855-4827-8b64-52949004edcf tempest-VolumesSnapshotTestJSON-539243248 None] Deleting offline snapshot 6efc70ff-3c02-4878-bc37-f2beac864007 of volume c9063d82-911e-40dc-994c-8f69a9f20727 {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 15:56:56 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-9355b0cb-6855-4827-8b64-52949004edcf tempest-VolumesSnapshotTestJSON-539243248 None] snapshot_file for this snap is: volume-c9063d82-911e-40dc-994c-8f69a9f20727.6efc70ff-3c02-4878-bc37-f2beac864007 {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 15:56:56 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[576983ed-f264-4ad7-857c-c3228ef7bf53]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:56:56 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9355b0cb-6855-4827-8b64-52949004edcf tempest-VolumesSnapshotTestJSON-539243248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c9063d82-911e-40dc-994c-8f69a9f20727.6efc70ff-3c02-4878-bc37-f2beac864007 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:56 devstack sudo[87925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c9063d82-911e-40dc-994c-8f69a9f20727.6efc70ff-3c02-4878-bc37-f2beac864007
Apr 15 15:56:56 devstack sudo[87925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:56 devstack sudo[87923]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:56 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-295966dc-b303-4694-80b0-374bba205da9 tempest-VolumeRetypeWithoutMigrationTest-1997827928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-76cbcb84-1565-4d15-a8e5-32acf6684efe 1073741824" returned: 0 in 0.613s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:56 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-295966dc-b303-4694-80b0-374bba205da9 tempest-VolumeRetypeWithoutMigrationTest-1997827928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-76cbcb84-1565-4d15-a8e5-32acf6684efe {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:56 devstack sudo[87930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-76cbcb84-1565-4d15-a8e5-32acf6684efe
Apr 15 15:56:56 devstack sudo[87930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:57 devstack sudo[87925]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9355b0cb-6855-4827-8b64-52949004edcf tempest-VolumesSnapshotTestJSON-539243248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c9063d82-911e-40dc-994c-8f69a9f20727.6efc70ff-3c02-4878-bc37-f2beac864007" returned: 0 in 0.565s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:57 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-9355b0cb-6855-4827-8b64-52949004edcf tempest-VolumesSnapshotTestJSON-539243248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9063d82-911e-40dc-994c-8f69a9f20727(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82485) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 15:56:57 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d07abde-0f49-439a-a15b-f2bd853b6e8d]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:56:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9355b0cb-6855-4827-8b64-52949004edcf tempest-VolumesSnapshotTestJSON-539243248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c9063d82-911e-40dc-994c-8f69a9f20727 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:57 devstack sudo[87935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c9063d82-911e-40dc-994c-8f69a9f20727
Apr 15 15:56:57 devstack sudo[87935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:57 devstack sudo[87930]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-295966dc-b303-4694-80b0-374bba205da9 tempest-VolumeRetypeWithoutMigrationTest-1997827928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-76cbcb84-1565-4d15-a8e5-32acf6684efe" returned: 0 in 0.473s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:57 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-295966dc-b303-4694-80b0-374bba205da9 tempest-VolumeRetypeWithoutMigrationTest-1997827928 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:56:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-295966dc-b303-4694-80b0-374bba205da9 tempest-VolumeRetypeWithoutMigrationTest-1997827928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:56:57 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-295966dc-b303-4694-80b0-374bba205da9 tempest-VolumeRetypeWithoutMigrationTest-1997827928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0961f57b-67b3-4f3c-8c19-da325edc9846) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76cbcb84-1565-4d15-a8e5-32acf6684efe', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:56:57 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-295966dc-b303-4694-80b0-374bba205da9 tempest-VolumeRetypeWithoutMigrationTest-1997827928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f07ff01b-a9e2-4bf4-9f14-3b1759fa3864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:56:57 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-295966dc-b303-4694-80b0-374bba205da9 tempest-VolumeRetypeWithoutMigrationTest-1997827928 None] Volume volume-76cbcb84-1565-4d15-a8e5-32acf6684efe (76cbcb84-1565-4d15-a8e5-32acf6684efe): created successfully
Apr 15 15:56:57 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-295966dc-b303-4694-80b0-374bba205da9 tempest-VolumeRetypeWithoutMigrationTest-1997827928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f07ff01b-a9e2-4bf4-9f14-3b1759fa3864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:56:57 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-295966dc-b303-4694-80b0-374bba205da9 tempest-VolumeRetypeWithoutMigrationTest-1997827928 None] Flow 'volume_create_manager' (cfd57116-9574-4f75-b863-09e38037c5cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:56:57 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-295966dc-b303-4694-80b0-374bba205da9 tempest-VolumeRetypeWithoutMigrationTest-1997827928 None] Created volume successfully.
Apr 15 15:56:57 devstack sudo[87935]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9355b0cb-6855-4827-8b64-52949004edcf tempest-VolumesSnapshotTestJSON-539243248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c9063d82-911e-40dc-994c-8f69a9f20727" returned: 0 in 0.545s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9355b0cb-6855-4827-8b64-52949004edcf tempest-VolumesSnapshotTestJSON-539243248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c9063d82-911e-40dc-994c-8f69a9f20727.6efc70ff-3c02-4878-bc37-f2beac864007 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:57 devstack sudo[87941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c9063d82-911e-40dc-994c-8f69a9f20727.6efc70ff-3c02-4878-bc37-f2beac864007
Apr 15 15:56:57 devstack sudo[87941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:58 devstack sudo[87941]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9355b0cb-6855-4827-8b64-52949004edcf tempest-VolumesSnapshotTestJSON-539243248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c9063d82-911e-40dc-994c-8f69a9f20727.6efc70ff-3c02-4878-bc37-f2beac864007" returned: 0 in 0.530s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9355b0cb-6855-4827-8b64-52949004edcf tempest-VolumesSnapshotTestJSON-539243248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c9063d82-911e-40dc-994c-8f69a9f20727.6efc70ff-3c02-4878-bc37-f2beac864007 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:58 devstack sudo[87946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c9063d82-911e-40dc-994c-8f69a9f20727.6efc70ff-3c02-4878-bc37-f2beac864007
Apr 15 15:56:58 devstack sudo[87946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-56f785dd-7dde-4ceb-a989-ca56e7df151e tempest-VolumeRetypeWithoutMigrationTest-1997827928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:56:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-56f785dd-7dde-4ceb-a989-ca56e7df151e tempest-VolumeRetypeWithoutMigrationTest-1997827928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:56:58 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-56f785dd-7dde-4ceb-a989-ca56e7df151e tempest-VolumeRetypeWithoutMigrationTest-1997827928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:56:58 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-56f785dd-7dde-4ceb-a989-ca56e7df151e tempest-VolumeRetypeWithoutMigrationTest-1997827928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:56:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-56f785dd-7dde-4ceb-a989-ca56e7df151e tempest-VolumeRetypeWithoutMigrationTest-1997827928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:56:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-56f785dd-7dde-4ceb-a989-ca56e7df151e tempest-VolumeRetypeWithoutMigrationTest-1997827928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:58 devstack sudo[87948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:56:58 devstack sudo[87948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:58 devstack sudo[87946]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9355b0cb-6855-4827-8b64-52949004edcf tempest-VolumesSnapshotTestJSON-539243248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c9063d82-911e-40dc-994c-8f69a9f20727.6efc70ff-3c02-4878-bc37-f2beac864007" returned: 0 in 0.515s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:58 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-9355b0cb-6855-4827-8b64-52949004edcf tempest-VolumesSnapshotTestJSON-539243248 None] Lock "cinder-quobyte-6efc70ff-3c02-4878-bc37-f2beac864007" released by "_delete_snapshot" :: held 2.250s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:56:58 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-9355b0cb-6855-4827-8b64-52949004edcf tempest-VolumesSnapshotTestJSON-539243248 None] Lock "cinder-quobyte-c9063d82-911e-40dc-994c-8f69a9f20727" released by "delete_snapshot" :: held 2.268s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:56:58 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-9355b0cb-6855-4827-8b64-52949004edcf tempest-VolumesSnapshotTestJSON-539243248 None] Created reservations ['0e86c24b-18f6-4c24-8d12-d78675e7daf3', 'fa22a5ef-b9d1-4f87-a899-10c0a1a75e56', 'a8eac9ee-afd4-47a6-ada6-d32ebef3f6ff', '97aacc05-9f88-43fe-af38-0139ef0ce170'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:56:58 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-9355b0cb-6855-4827-8b64-52949004edcf tempest-VolumesSnapshotTestJSON-539243248 None] Delete snapshot completed successfully.
Apr 15 15:56:58 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-9355b0cb-6855-4827-8b64-52949004edcf tempest-VolumesSnapshotTestJSON-539243248 None] Lock "cinder-6efc70ff-3c02-4878-bc37-f2beac864007-delete_snapshot" released by "delete_snapshot" :: held 2.387s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:56:59 devstack sudo[87948]: pam_unix(sudo:session): session closed for user root
Apr 15 15:56:59 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-56f785dd-7dde-4ceb-a989-ca56e7df151e tempest-VolumeRetypeWithoutMigrationTest-1997827928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.468s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:56:59 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-56f785dd-7dde-4ceb-a989-ca56e7df151e tempest-VolumeRetypeWithoutMigrationTest-1997827928 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:56:59 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-56f785dd-7dde-4ceb-a989-ca56e7df151e tempest-VolumeRetypeWithoutMigrationTest-1997827928 None] Retype volume completed successfully.
Apr 15 15:56:59 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-1779e3f2-6772-414a-9ce0-5eed7058908f tempest-VolumeRetypeWithoutMigrationTest-1997827928 None] Acquiring lock "cinder-76cbcb84-1565-4d15-a8e5-32acf6684efe-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:56:59 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-1779e3f2-6772-414a-9ce0-5eed7058908f tempest-VolumeRetypeWithoutMigrationTest-1997827928 None] Lock "cinder-76cbcb84-1565-4d15-a8e5-32acf6684efe-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:56:59 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-1779e3f2-6772-414a-9ce0-5eed7058908f tempest-VolumeRetypeWithoutMigrationTest-1997827928 None] Acquiring lock "cinder-quobyte-76cbcb84-1565-4d15-a8e5-32acf6684efe" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:56:59 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-1779e3f2-6772-414a-9ce0-5eed7058908f tempest-VolumeRetypeWithoutMigrationTest-1997827928 None] Lock "cinder-quobyte-76cbcb84-1565-4d15-a8e5-32acf6684efe" acquired by "delete_volume" :: waited 0.009s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:56:59 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[828dfff7-9545-4b1c-9dd8-d0e59e691710]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:56:59 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-1779e3f2-6772-414a-9ce0-5eed7058908f tempest-VolumeRetypeWithoutMigrationTest-1997827928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-76cbcb84-1565-4d15-a8e5-32acf6684efe {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:56:59 devstack sudo[87952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-76cbcb84-1565-4d15-a8e5-32acf6684efe
Apr 15 15:56:59 devstack sudo[87952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:56:59 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-e90fc223-3ac1-47d7-9dd8-dca4b61e0993 tempest-VolumesSnapshotTestJSON-539243248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:57:00 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-e90fc223-3ac1-47d7-9dd8-dca4b61e0993 tempest-VolumesSnapshotTestJSON-539243248 None] Flow 'volume_create_manager' (b4d01c63-1d08-4c50-b581-7692caf46ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:57:00 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-e90fc223-3ac1-47d7-9dd8-dca4b61e0993 tempest-VolumesSnapshotTestJSON-539243248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e664cf5-8623-44c1-9b15-73277f2b826d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:57:00 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-e90fc223-3ac1-47d7-9dd8-dca4b61e0993 tempest-VolumesSnapshotTestJSON-539243248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e664cf5-8623-44c1-9b15-73277f2b826d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-540486586',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fae3da09-b3e6-48eb-a3d9-fcf469887337,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='684ff22a15b54836b8ad525b331c7ac4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:57:00Z,use_quota=True,user_id='c6701d96ef4a437a9b23c523b99519f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:57:00 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-e90fc223-3ac1-47d7-9dd8-dca4b61e0993 tempest-VolumesSnapshotTestJSON-539243248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (281d22eb-c2a6-4620-9b47-3658fcf2f504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:57:00 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-e90fc223-3ac1-47d7-9dd8-dca4b61e0993 tempest-VolumesSnapshotTestJSON-539243248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (281d22eb-c2a6-4620-9b47-3658fcf2f504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:57:00 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-e90fc223-3ac1-47d7-9dd8-dca4b61e0993 tempest-VolumesSnapshotTestJSON-539243248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20b9959d-7d23-440b-b6c8-6b4f74d6e4cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:57:00 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-e90fc223-3ac1-47d7-9dd8-dca4b61e0993 tempest-VolumesSnapshotTestJSON-539243248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20b9959d-7d23-440b-b6c8-6b4f74d6e4cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fae3da09-b3e6-48eb-a3d9-fcf469887337', 'volume_name': 'volume-fae3da09-b3e6-48eb-a3d9-fcf469887337', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:57:00 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-e90fc223-3ac1-47d7-9dd8-dca4b61e0993 tempest-VolumesSnapshotTestJSON-539243248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d3f887a-5b9b-46d0-a224-7a2baec6739c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:57:00 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-e90fc223-3ac1-47d7-9dd8-dca4b61e0993 tempest-VolumesSnapshotTestJSON-539243248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d3f887a-5b9b-46d0-a224-7a2baec6739c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:57:00 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-e90fc223-3ac1-47d7-9dd8-dca4b61e0993 tempest-VolumesSnapshotTestJSON-539243248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9990fa77-61f7-4da0-8272-060c1539f350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:57:00 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-e90fc223-3ac1-47d7-9dd8-dca4b61e0993 tempest-VolumesSnapshotTestJSON-539243248 None] Volume fae3da09-b3e6-48eb-a3d9-fcf469887337: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fae3da09-b3e6-48eb-a3d9-fcf469887337', 'volume_size': 1}
Apr 15 15:57:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-e90fc223-3ac1-47d7-9dd8-dca4b61e0993 tempest-VolumesSnapshotTestJSON-539243248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:57:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-e90fc223-3ac1-47d7-9dd8-dca4b61e0993 tempest-VolumesSnapshotTestJSON-539243248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:57:00 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-e90fc223-3ac1-47d7-9dd8-dca4b61e0993 tempest-VolumesSnapshotTestJSON-539243248 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-540486586',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fae3da09-b3e6-48eb-a3d9-fcf469887337,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='684ff22a15b54836b8ad525b331c7ac4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:57:00Z,use_quota=True,user_id='c6701d96ef4a437a9b23c523b99519f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:57:00 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-e90fc223-3ac1-47d7-9dd8-dca4b61e0993 tempest-VolumesSnapshotTestJSON-539243248 None] Creating volume fae3da09-b3e6-48eb-a3d9-fcf469887337 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:57:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-e90fc223-3ac1-47d7-9dd8-dca4b61e0993 tempest-VolumesSnapshotTestJSON-539243248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:57:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-e90fc223-3ac1-47d7-9dd8-dca4b61e0993 tempest-VolumesSnapshotTestJSON-539243248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:57:00 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-e90fc223-3ac1-47d7-9dd8-dca4b61e0993 tempest-VolumesSnapshotTestJSON-539243248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:57:00 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-e90fc223-3ac1-47d7-9dd8-dca4b61e0993 tempest-VolumesSnapshotTestJSON-539243248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:57:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-e90fc223-3ac1-47d7-9dd8-dca4b61e0993 tempest-VolumesSnapshotTestJSON-539243248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:57:00 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-e90fc223-3ac1-47d7-9dd8-dca4b61e0993 tempest-VolumesSnapshotTestJSON-539243248 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:57:00 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-e90fc223-3ac1-47d7-9dd8-dca4b61e0993 tempest-VolumesSnapshotTestJSON-539243248 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:57:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-e90fc223-3ac1-47d7-9dd8-dca4b61e0993 tempest-VolumesSnapshotTestJSON-539243248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fae3da09-b3e6-48eb-a3d9-fcf469887337 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:00 devstack sudo[87954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fae3da09-b3e6-48eb-a3d9-fcf469887337 1073741824
Apr 15 15:57:00 devstack sudo[87954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:00 devstack sudo[87952]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-1779e3f2-6772-414a-9ce0-5eed7058908f tempest-VolumeRetypeWithoutMigrationTest-1997827928 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-76cbcb84-1565-4d15-a8e5-32acf6684efe" returned: 0 in 0.557s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-1779e3f2-6772-414a-9ce0-5eed7058908f tempest-VolumeRetypeWithoutMigrationTest-1997827928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-76cbcb84-1565-4d15-a8e5-32acf6684efe {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:00 devstack sudo[87959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-76cbcb84-1565-4d15-a8e5-32acf6684efe
Apr 15 15:57:00 devstack sudo[87959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:00 devstack sudo[87954]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-e90fc223-3ac1-47d7-9dd8-dca4b61e0993 tempest-VolumesSnapshotTestJSON-539243248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fae3da09-b3e6-48eb-a3d9-fcf469887337 1073741824" returned: 0 in 0.545s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-e90fc223-3ac1-47d7-9dd8-dca4b61e0993 tempest-VolumesSnapshotTestJSON-539243248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fae3da09-b3e6-48eb-a3d9-fcf469887337 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:00 devstack sudo[87964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fae3da09-b3e6-48eb-a3d9-fcf469887337
Apr 15 15:57:00 devstack sudo[87964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:00 devstack sudo[87959]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-1779e3f2-6772-414a-9ce0-5eed7058908f tempest-VolumeRetypeWithoutMigrationTest-1997827928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-76cbcb84-1565-4d15-a8e5-32acf6684efe" returned: 0 in 0.463s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:00 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-1779e3f2-6772-414a-9ce0-5eed7058908f tempest-VolumeRetypeWithoutMigrationTest-1997827928 None] Lock "cinder-quobyte-76cbcb84-1565-4d15-a8e5-32acf6684efe" released by "delete_volume" :: held 1.053s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:57:00 devstack cinder-volume[82485]: WARNING cinder.quota [None req-1779e3f2-6772-414a-9ce0-5eed7058908f tempest-VolumeRetypeWithoutMigrationTest-1997827928 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 15 15:57:00 devstack cinder-volume[82485]: WARNING cinder.quota [None req-1779e3f2-6772-414a-9ce0-5eed7058908f tempest-VolumeRetypeWithoutMigrationTest-1997827928 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 15 15:57:00 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-1779e3f2-6772-414a-9ce0-5eed7058908f tempest-VolumeRetypeWithoutMigrationTest-1997827928 None] Created reservations ['350810bc-447f-4c9f-83f4-1218f950f39e', 'eac84088-98a4-4c70-b99c-01c6017e686f', 'f7f224d0-c593-448a-a784-4e10aae75c1e', '4bbd7d97-2da0-4cfa-b65a-1db588aec772'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:57:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-1779e3f2-6772-414a-9ce0-5eed7058908f tempest-VolumeRetypeWithoutMigrationTest-1997827928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:57:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-1779e3f2-6772-414a-9ce0-5eed7058908f tempest-VolumeRetypeWithoutMigrationTest-1997827928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:57:00 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-1779e3f2-6772-414a-9ce0-5eed7058908f tempest-VolumeRetypeWithoutMigrationTest-1997827928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:57:00 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-1779e3f2-6772-414a-9ce0-5eed7058908f tempest-VolumeRetypeWithoutMigrationTest-1997827928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:57:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-1779e3f2-6772-414a-9ce0-5eed7058908f tempest-VolumeRetypeWithoutMigrationTest-1997827928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:57:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-1779e3f2-6772-414a-9ce0-5eed7058908f tempest-VolumeRetypeWithoutMigrationTest-1997827928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:00 devstack sudo[87967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:57:00 devstack sudo[87967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:01 devstack sudo[87964]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:01 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-e90fc223-3ac1-47d7-9dd8-dca4b61e0993 tempest-VolumesSnapshotTestJSON-539243248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fae3da09-b3e6-48eb-a3d9-fcf469887337" returned: 0 in 0.514s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:01 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-e90fc223-3ac1-47d7-9dd8-dca4b61e0993 tempest-VolumesSnapshotTestJSON-539243248 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:57:01 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-e90fc223-3ac1-47d7-9dd8-dca4b61e0993 tempest-VolumesSnapshotTestJSON-539243248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:57:01 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-e90fc223-3ac1-47d7-9dd8-dca4b61e0993 tempest-VolumesSnapshotTestJSON-539243248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9990fa77-61f7-4da0-8272-060c1539f350) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fae3da09-b3e6-48eb-a3d9-fcf469887337', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:57:01 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-e90fc223-3ac1-47d7-9dd8-dca4b61e0993 tempest-VolumesSnapshotTestJSON-539243248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c82d3a3-ed7b-4d69-ae87-582257d49330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:57:01 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-e90fc223-3ac1-47d7-9dd8-dca4b61e0993 tempest-VolumesSnapshotTestJSON-539243248 None] Volume volume-fae3da09-b3e6-48eb-a3d9-fcf469887337 (fae3da09-b3e6-48eb-a3d9-fcf469887337): created successfully
Apr 15 15:57:01 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-e90fc223-3ac1-47d7-9dd8-dca4b61e0993 tempest-VolumesSnapshotTestJSON-539243248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c82d3a3-ed7b-4d69-ae87-582257d49330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:57:01 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-e90fc223-3ac1-47d7-9dd8-dca4b61e0993 tempest-VolumesSnapshotTestJSON-539243248 None] Flow 'volume_create_manager' (b4d01c63-1d08-4c50-b581-7692caf46ede) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:57:01 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-e90fc223-3ac1-47d7-9dd8-dca4b61e0993 tempest-VolumesSnapshotTestJSON-539243248 None] Created volume successfully.
Apr 15 15:57:01 devstack sudo[87967]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:01 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-1779e3f2-6772-414a-9ce0-5eed7058908f tempest-VolumeRetypeWithoutMigrationTest-1997827928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.493s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:01 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-1779e3f2-6772-414a-9ce0-5eed7058908f tempest-VolumeRetypeWithoutMigrationTest-1997827928 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:57:01 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-1779e3f2-6772-414a-9ce0-5eed7058908f tempest-VolumeRetypeWithoutMigrationTest-1997827928 None] Deleted volume successfully.
Apr 15 15:57:01 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-1779e3f2-6772-414a-9ce0-5eed7058908f tempest-VolumeRetypeWithoutMigrationTest-1997827928 None] Lock "cinder-76cbcb84-1565-4d15-a8e5-32acf6684efe-delete_volume" released by "delete_volume" :: held 1.686s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:57:02 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-69a08cc2-0e92-41c4-9356-2ea1199a3240 tempest-VolumesSnapshotTestJSON-539243248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:57:02 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-69a08cc2-0e92-41c4-9356-2ea1199a3240 tempest-VolumesSnapshotTestJSON-539243248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:57:02 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-69a08cc2-0e92-41c4-9356-2ea1199a3240 tempest-VolumesSnapshotTestJSON-539243248 None] Creating offline snapshot 9169ca5e-6683-4a52-9750-f2478379f03f of volume fae3da09-b3e6-48eb-a3d9-fcf469887337 {{(pid=82485) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 15:57:02 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1003b8b-fdb3-4456-a55d-34964bbf168b]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:57:02 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-69a08cc2-0e92-41c4-9356-2ea1199a3240 tempest-VolumesSnapshotTestJSON-539243248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fae3da09-b3e6-48eb-a3d9-fcf469887337 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:02 devstack sudo[87971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fae3da09-b3e6-48eb-a3d9-fcf469887337
Apr 15 15:57:02 devstack sudo[87971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:03 devstack sudo[87971]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:03 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-69a08cc2-0e92-41c4-9356-2ea1199a3240 tempest-VolumesSnapshotTestJSON-539243248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fae3da09-b3e6-48eb-a3d9-fcf469887337" returned: 0 in 0.735s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:03 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-69a08cc2-0e92-41c4-9356-2ea1199a3240 tempest-VolumesSnapshotTestJSON-539243248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fae3da09-b3e6-48eb-a3d9-fcf469887337,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fae3da09-b3e6-48eb-a3d9-fcf469887337.9169ca5e-6683-4a52-9750-f2478379f03f 1G {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:03 devstack sudo[87976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fae3da09-b3e6-48eb-a3d9-fcf469887337,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fae3da09-b3e6-48eb-a3d9-fcf469887337.9169ca5e-6683-4a52-9750-f2478379f03f 1G
Apr 15 15:57:03 devstack sudo[87976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:03 devstack sudo[87976]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:03 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-69a08cc2-0e92-41c4-9356-2ea1199a3240 tempest-VolumesSnapshotTestJSON-539243248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fae3da09-b3e6-48eb-a3d9-fcf469887337,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fae3da09-b3e6-48eb-a3d9-fcf469887337.9169ca5e-6683-4a52-9750-f2478379f03f 1G" returned: 0 in 0.584s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:03 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-69a08cc2-0e92-41c4-9356-2ea1199a3240 tempest-VolumesSnapshotTestJSON-539243248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fae3da09-b3e6-48eb-a3d9-fcf469887337 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fae3da09-b3e6-48eb-a3d9-fcf469887337.9169ca5e-6683-4a52-9750-f2478379f03f {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:03 devstack sudo[87981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fae3da09-b3e6-48eb-a3d9-fcf469887337 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fae3da09-b3e6-48eb-a3d9-fcf469887337.9169ca5e-6683-4a52-9750-f2478379f03f
Apr 15 15:57:03 devstack sudo[87981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:04 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-69a08cc2-0e92-41c4-9356-2ea1199a3240 tempest-VolumesSnapshotTestJSON-539243248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fae3da09-b3e6-48eb-a3d9-fcf469887337 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fae3da09-b3e6-48eb-a3d9-fcf469887337.9169ca5e-6683-4a52-9750-f2478379f03f" returned: 0 in 0.691s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:04 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-69a08cc2-0e92-41c4-9356-2ea1199a3240 tempest-VolumesSnapshotTestJSON-539243248 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fae3da09-b3e6-48eb-a3d9-fcf469887337.9169ca5e-6683-4a52-9750-f2478379f03f is being set with open permissions: ugo+rw
Apr 15 15:57:04 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-69a08cc2-0e92-41c4-9356-2ea1199a3240 tempest-VolumesSnapshotTestJSON-539243248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fae3da09-b3e6-48eb-a3d9-fcf469887337.9169ca5e-6683-4a52-9750-f2478379f03f {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:04 devstack sudo[87981]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:04 devstack sudo[87988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fae3da09-b3e6-48eb-a3d9-fcf469887337.9169ca5e-6683-4a52-9750-f2478379f03f
Apr 15 15:57:04 devstack sudo[87988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:04 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7e6a1e7-e0bf-4d2e-861a-3efb4ee5676c tempest-VolumesActionsTest-680032541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:57:04 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b7e6a1e7-e0bf-4d2e-861a-3efb4ee5676c tempest-VolumesActionsTest-680032541 None] Flow 'volume_create_manager' (e4005f18-772e-4fb5-ba6a-012fea4cca09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:57:04 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b7e6a1e7-e0bf-4d2e-861a-3efb4ee5676c tempest-VolumesActionsTest-680032541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37171a1d-3233-4ed3-9918-fe06670ad671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:57:04 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b7e6a1e7-e0bf-4d2e-861a-3efb4ee5676c tempest-VolumesActionsTest-680032541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37171a1d-3233-4ed3-9918-fe06670ad671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:57:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-949533553',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4e03146-9dc3-44f6-a091-ed0e9c7f4305,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a03f65814af400fa497a00389a2e32b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:57:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:57:05Z,use_quota=True,user_id='3d60bd427dda4b9c9f5f54cabad7e265',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:57:04 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b7e6a1e7-e0bf-4d2e-861a-3efb4ee5676c tempest-VolumesActionsTest-680032541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1406676-28c3-409e-9120-1b9706696d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:57:04 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b7e6a1e7-e0bf-4d2e-861a-3efb4ee5676c tempest-VolumesActionsTest-680032541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1406676-28c3-409e-9120-1b9706696d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:57:04 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b7e6a1e7-e0bf-4d2e-861a-3efb4ee5676c tempest-VolumesActionsTest-680032541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b9909aa-56e3-4d09-81f6-791a942857fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:57:04 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b7e6a1e7-e0bf-4d2e-861a-3efb4ee5676c tempest-VolumesActionsTest-680032541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b9909aa-56e3-4d09-81f6-791a942857fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4e03146-9dc3-44f6-a091-ed0e9c7f4305', 'volume_name': 'volume-f4e03146-9dc3-44f6-a091-ed0e9c7f4305', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:57:04 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b7e6a1e7-e0bf-4d2e-861a-3efb4ee5676c tempest-VolumesActionsTest-680032541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaef36cb-49cb-4956-9c17-7a2730352342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:57:04 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b7e6a1e7-e0bf-4d2e-861a-3efb4ee5676c tempest-VolumesActionsTest-680032541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaef36cb-49cb-4956-9c17-7a2730352342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:57:04 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b7e6a1e7-e0bf-4d2e-861a-3efb4ee5676c tempest-VolumesActionsTest-680032541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f257e939-b8b7-48c9-b78e-6027c6a7d83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:57:04 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-b7e6a1e7-e0bf-4d2e-861a-3efb4ee5676c tempest-VolumesActionsTest-680032541 None] Volume f4e03146-9dc3-44f6-a091-ed0e9c7f4305: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4e03146-9dc3-44f6-a091-ed0e9c7f4305', 'volume_size': 1}
Apr 15 15:57:04 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-b7e6a1e7-e0bf-4d2e-861a-3efb4ee5676c tempest-VolumesActionsTest-680032541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:57:04 devstack sudo[87988]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:04 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-69a08cc2-0e92-41c4-9356-2ea1199a3240 tempest-VolumesSnapshotTestJSON-539243248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fae3da09-b3e6-48eb-a3d9-fcf469887337.9169ca5e-6683-4a52-9750-f2478379f03f" returned: 0 in 0.540s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:04 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-69a08cc2-0e92-41c4-9356-2ea1199a3240 tempest-VolumesSnapshotTestJSON-539243248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fae3da09-b3e6-48eb-a3d9-fcf469887337.info {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:04 devstack sudo[87992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fae3da09-b3e6-48eb-a3d9-fcf469887337.info
Apr 15 15:57:04 devstack sudo[87992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:05 devstack sudo[87992]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:05 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-69a08cc2-0e92-41c4-9356-2ea1199a3240 tempest-VolumesSnapshotTestJSON-539243248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fae3da09-b3e6-48eb-a3d9-fcf469887337.info" returned: 0 in 0.498s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:05 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-69a08cc2-0e92-41c4-9356-2ea1199a3240 tempest-VolumesSnapshotTestJSON-539243248 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fae3da09-b3e6-48eb-a3d9-fcf469887337.info is being set with open permissions: ugo+rw
Apr 15 15:57:05 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-69a08cc2-0e92-41c4-9356-2ea1199a3240 tempest-VolumesSnapshotTestJSON-539243248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fae3da09-b3e6-48eb-a3d9-fcf469887337.info {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:05 devstack sudo[87995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fae3da09-b3e6-48eb-a3d9-fcf469887337.info
Apr 15 15:57:05 devstack sudo[87995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:05 devstack sudo[87995]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:05 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-69a08cc2-0e92-41c4-9356-2ea1199a3240 tempest-VolumesSnapshotTestJSON-539243248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fae3da09-b3e6-48eb-a3d9-fcf469887337.info" returned: 0 in 0.425s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:05 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-69a08cc2-0e92-41c4-9356-2ea1199a3240 tempest-VolumesSnapshotTestJSON-539243248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.550s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:57:05 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-b7e6a1e7-e0bf-4d2e-861a-3efb4ee5676c tempest-VolumesActionsTest-680032541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.139s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:57:05 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-b7e6a1e7-e0bf-4d2e-861a-3efb4ee5676c tempest-VolumesActionsTest-680032541 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:57:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-949533553',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4e03146-9dc3-44f6-a091-ed0e9c7f4305,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a03f65814af400fa497a00389a2e32b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:57:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:57:05Z,use_quota=True,user_id='3d60bd427dda4b9c9f5f54cabad7e265',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:57:05 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-b7e6a1e7-e0bf-4d2e-861a-3efb4ee5676c tempest-VolumesActionsTest-680032541 None] Creating volume f4e03146-9dc3-44f6-a091-ed0e9c7f4305 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:57:05 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-b7e6a1e7-e0bf-4d2e-861a-3efb4ee5676c tempest-VolumesActionsTest-680032541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:57:05 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-b7e6a1e7-e0bf-4d2e-861a-3efb4ee5676c tempest-VolumesActionsTest-680032541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:57:05 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-b7e6a1e7-e0bf-4d2e-861a-3efb4ee5676c tempest-VolumesActionsTest-680032541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:57:05 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-b7e6a1e7-e0bf-4d2e-861a-3efb4ee5676c tempest-VolumesActionsTest-680032541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:57:05 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-b7e6a1e7-e0bf-4d2e-861a-3efb4ee5676c tempest-VolumesActionsTest-680032541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:57:05 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-b7e6a1e7-e0bf-4d2e-861a-3efb4ee5676c tempest-VolumesActionsTest-680032541 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:57:05 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-b7e6a1e7-e0bf-4d2e-861a-3efb4ee5676c tempest-VolumesActionsTest-680032541 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:57:05 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b7e6a1e7-e0bf-4d2e-861a-3efb4ee5676c tempest-VolumesActionsTest-680032541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f4e03146-9dc3-44f6-a091-ed0e9c7f4305 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:05 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-69a08cc2-0e92-41c4-9356-2ea1199a3240 tempest-VolumesSnapshotTestJSON-539243248 None] Create snapshot completed successfully
Apr 15 15:57:05 devstack sudo[87998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f4e03146-9dc3-44f6-a091-ed0e9c7f4305 1073741824
Apr 15 15:57:05 devstack sudo[87998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:06 devstack sudo[87998]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:06 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b7e6a1e7-e0bf-4d2e-861a-3efb4ee5676c tempest-VolumesActionsTest-680032541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f4e03146-9dc3-44f6-a091-ed0e9c7f4305 1073741824" returned: 0 in 0.527s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:06 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b7e6a1e7-e0bf-4d2e-861a-3efb4ee5676c tempest-VolumesActionsTest-680032541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f4e03146-9dc3-44f6-a091-ed0e9c7f4305 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:06 devstack sudo[88003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f4e03146-9dc3-44f6-a091-ed0e9c7f4305
Apr 15 15:57:06 devstack sudo[88003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:06 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-aff90fc5-3f9d-40ac-88d0-c7e686cb57e3 tempest-VolumesSnapshotTestJSON-539243248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:57:06 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-aff90fc5-3f9d-40ac-88d0-c7e686cb57e3 tempest-VolumesSnapshotTestJSON-539243248 None] Flow 'volume_create_manager' (f88d5512-1929-4be4-ad6f-28e7dd9f82c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:57:06 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-aff90fc5-3f9d-40ac-88d0-c7e686cb57e3 tempest-VolumesSnapshotTestJSON-539243248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2c1f936-95ee-414c-be34-59526176e554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:57:06 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-aff90fc5-3f9d-40ac-88d0-c7e686cb57e3 tempest-VolumesSnapshotTestJSON-539243248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2c1f936-95ee-414c-be34-59526176e554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:57:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1448433170',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daa2dd13-88fa-4774-a7fa-1a966c495fc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='684ff22a15b54836b8ad525b331c7ac4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:57:07Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=9169ca5e-6683-4a52-9750-f2478379f03f,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:57:07Z,use_quota=True,user_id='c6701d96ef4a437a9b23c523b99519f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:57:06 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-aff90fc5-3f9d-40ac-88d0-c7e686cb57e3 tempest-VolumesSnapshotTestJSON-539243248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bba30b0-0975-498f-b811-f68142144f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:57:06 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-aff90fc5-3f9d-40ac-88d0-c7e686cb57e3 tempest-VolumesSnapshotTestJSON-539243248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bba30b0-0975-498f-b811-f68142144f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:57:06 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-aff90fc5-3f9d-40ac-88d0-c7e686cb57e3 tempest-VolumesSnapshotTestJSON-539243248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c74803b-7c98-454a-ab9c-27eb8d3992a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:57:06 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-aff90fc5-3f9d-40ac-88d0-c7e686cb57e3 tempest-VolumesSnapshotTestJSON-539243248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c74803b-7c98-454a-ab9c-27eb8d3992a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'daa2dd13-88fa-4774-a7fa-1a966c495fc4', 'volume_name': 'volume-daa2dd13-88fa-4774-a7fa-1a966c495fc4', 'volume_size': 2, 'snapshot_id': '9169ca5e-6683-4a52-9750-f2478379f03f'}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:57:06 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-aff90fc5-3f9d-40ac-88d0-c7e686cb57e3 tempest-VolumesSnapshotTestJSON-539243248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (177d4d82-1a8c-4978-9ceb-2ab9ee871139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:57:06 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-aff90fc5-3f9d-40ac-88d0-c7e686cb57e3 tempest-VolumesSnapshotTestJSON-539243248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (177d4d82-1a8c-4978-9ceb-2ab9ee871139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:57:06 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-aff90fc5-3f9d-40ac-88d0-c7e686cb57e3 tempest-VolumesSnapshotTestJSON-539243248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e069e51-5941-47a0-9d55-df3e61c38bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:57:06 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-aff90fc5-3f9d-40ac-88d0-c7e686cb57e3 tempest-VolumesSnapshotTestJSON-539243248 None] Volume daa2dd13-88fa-4774-a7fa-1a966c495fc4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-daa2dd13-88fa-4774-a7fa-1a966c495fc4', 'volume_size': 2, 'snapshot_id': '9169ca5e-6683-4a52-9750-f2478379f03f'}
Apr 15 15:57:06 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-aff90fc5-3f9d-40ac-88d0-c7e686cb57e3 tempest-VolumesSnapshotTestJSON-539243248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:57:06 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b97db88-6af3-4f6c-9ba8-8e2c7f55a4cb tempest-VolumesServicesTestJSON-481232803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:57:06 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-3b97db88-6af3-4f6c-9ba8-8e2c7f55a4cb tempest-VolumesServicesTestJSON-481232803 None] Flow 'volume_create_manager' (6d060c11-80c7-4132-936d-704f36e45bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:57:06 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-3b97db88-6af3-4f6c-9ba8-8e2c7f55a4cb tempest-VolumesServicesTestJSON-481232803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fd14269-bb3d-4842-9553-0db70bb4ca97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:57:06 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-3b97db88-6af3-4f6c-9ba8-8e2c7f55a4cb tempest-VolumesServicesTestJSON-481232803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fd14269-bb3d-4842-9553-0db70bb4ca97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:57:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-32355565',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b76294f1-58b3-4518-8b19-d31967cac673,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d596c3088faa4d749a7f714cdeb22f50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:57:07Z,use_quota=True,user_id='2665c730c8074ac69839cb1156e3678c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:57:06 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-3b97db88-6af3-4f6c-9ba8-8e2c7f55a4cb tempest-VolumesServicesTestJSON-481232803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c4f3042-0684-4df9-b67c-a13bbd0c2781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:57:06 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-3b97db88-6af3-4f6c-9ba8-8e2c7f55a4cb tempest-VolumesServicesTestJSON-481232803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c4f3042-0684-4df9-b67c-a13bbd0c2781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:57:06 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-3b97db88-6af3-4f6c-9ba8-8e2c7f55a4cb tempest-VolumesServicesTestJSON-481232803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa72441d-43dd-447f-a761-963ca9868c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:57:06 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-3b97db88-6af3-4f6c-9ba8-8e2c7f55a4cb tempest-VolumesServicesTestJSON-481232803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa72441d-43dd-447f-a761-963ca9868c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b76294f1-58b3-4518-8b19-d31967cac673', 'volume_name': 'volume-b76294f1-58b3-4518-8b19-d31967cac673', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:57:06 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-3b97db88-6af3-4f6c-9ba8-8e2c7f55a4cb tempest-VolumesServicesTestJSON-481232803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb58ccc8-3d7f-4f4c-89e8-534755e8e0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:57:06 devstack sudo[88003]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:06 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-3b97db88-6af3-4f6c-9ba8-8e2c7f55a4cb tempest-VolumesServicesTestJSON-481232803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb58ccc8-3d7f-4f4c-89e8-534755e8e0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:57:06 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-3b97db88-6af3-4f6c-9ba8-8e2c7f55a4cb tempest-VolumesServicesTestJSON-481232803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (610d8c4f-1e44-4bd7-8085-10f8c3135ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:57:06 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-3b97db88-6af3-4f6c-9ba8-8e2c7f55a4cb tempest-VolumesServicesTestJSON-481232803 None] Volume b76294f1-58b3-4518-8b19-d31967cac673: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b76294f1-58b3-4518-8b19-d31967cac673', 'volume_size': 1}
Apr 15 15:57:06 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-3b97db88-6af3-4f6c-9ba8-8e2c7f55a4cb tempest-VolumesServicesTestJSON-481232803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:57:06 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b7e6a1e7-e0bf-4d2e-861a-3efb4ee5676c tempest-VolumesActionsTest-680032541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f4e03146-9dc3-44f6-a091-ed0e9c7f4305" returned: 0 in 0.484s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:06 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-b7e6a1e7-e0bf-4d2e-861a-3efb4ee5676c tempest-VolumesActionsTest-680032541 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:57:06 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-b7e6a1e7-e0bf-4d2e-861a-3efb4ee5676c tempest-VolumesActionsTest-680032541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:57:06 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-aff90fc5-3f9d-40ac-88d0-c7e686cb57e3 tempest-VolumesSnapshotTestJSON-539243248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.069s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:57:06 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-aff90fc5-3f9d-40ac-88d0-c7e686cb57e3 tempest-VolumesSnapshotTestJSON-539243248 None] Acquiring lock "cinder-quobyte-9169ca5e-6683-4a52-9750-f2478379f03f-daa2dd13-88fa-4774-a7fa-1a966c495fc4" by "_create_volume_from_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:57:06 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b7e6a1e7-e0bf-4d2e-861a-3efb4ee5676c tempest-VolumesActionsTest-680032541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f257e939-b8b7-48c9-b78e-6027c6a7d83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4e03146-9dc3-44f6-a091-ed0e9c7f4305', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:57:06 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b7e6a1e7-e0bf-4d2e-861a-3efb4ee5676c tempest-VolumesActionsTest-680032541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c42c36b5-449b-4674-a907-1dc050e0154e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:57:06 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-b7e6a1e7-e0bf-4d2e-861a-3efb4ee5676c tempest-VolumesActionsTest-680032541 None] Volume volume-f4e03146-9dc3-44f6-a091-ed0e9c7f4305 (f4e03146-9dc3-44f6-a091-ed0e9c7f4305): created successfully
Apr 15 15:57:06 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b7e6a1e7-e0bf-4d2e-861a-3efb4ee5676c tempest-VolumesActionsTest-680032541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c42c36b5-449b-4674-a907-1dc050e0154e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:57:06 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b7e6a1e7-e0bf-4d2e-861a-3efb4ee5676c tempest-VolumesActionsTest-680032541 None] Flow 'volume_create_manager' (e4005f18-772e-4fb5-ba6a-012fea4cca09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:57:06 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-aff90fc5-3f9d-40ac-88d0-c7e686cb57e3 tempest-VolumesSnapshotTestJSON-539243248 None] Lock "cinder-quobyte-9169ca5e-6683-4a52-9750-f2478379f03f-daa2dd13-88fa-4774-a7fa-1a966c495fc4" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:57:06 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-aff90fc5-3f9d-40ac-88d0-c7e686cb57e3 tempest-VolumesSnapshotTestJSON-539243248 None] Creating volume daa2dd13-88fa-4774-a7fa-1a966c495fc4 from snapshot 9169ca5e-6683-4a52-9750-f2478379f03f {{(pid=82485) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 15 15:57:06 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-aff90fc5-3f9d-40ac-88d0-c7e686cb57e3 tempest-VolumesSnapshotTestJSON-539243248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:57:06 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-aff90fc5-3f9d-40ac-88d0-c7e686cb57e3 tempest-VolumesSnapshotTestJSON-539243248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:57:06 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-aff90fc5-3f9d-40ac-88d0-c7e686cb57e3 tempest-VolumesSnapshotTestJSON-539243248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:57:06 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-aff90fc5-3f9d-40ac-88d0-c7e686cb57e3 tempest-VolumesSnapshotTestJSON-539243248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:57:06 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-aff90fc5-3f9d-40ac-88d0-c7e686cb57e3 tempest-VolumesSnapshotTestJSON-539243248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:57:06 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-aff90fc5-3f9d-40ac-88d0-c7e686cb57e3 tempest-VolumesSnapshotTestJSON-539243248 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:57:06 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-aff90fc5-3f9d-40ac-88d0-c7e686cb57e3 tempest-VolumesSnapshotTestJSON-539243248 None] Acquiring lock "cinder-quobyte-daa2dd13-88fa-4774-a7fa-1a966c495fc4" by "_copy_volume_from_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:57:06 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-b7e6a1e7-e0bf-4d2e-861a-3efb4ee5676c tempest-VolumesActionsTest-680032541 None] Created volume successfully.
Apr 15 15:57:06 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-aff90fc5-3f9d-40ac-88d0-c7e686cb57e3 tempest-VolumesSnapshotTestJSON-539243248 None] Lock "cinder-quobyte-daa2dd13-88fa-4774-a7fa-1a966c495fc4" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:57:06 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-aff90fc5-3f9d-40ac-88d0-c7e686cb57e3 tempest-VolumesSnapshotTestJSON-539243248 None] snapshot: 9169ca5e-6683-4a52-9750-f2478379f03f, volume: daa2dd13-88fa-4774-a7fa-1a966c495fc4,  {{(pid=82485) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 15 15:57:06 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-aff90fc5-3f9d-40ac-88d0-c7e686cb57e3 tempest-VolumesSnapshotTestJSON-539243248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:57:06 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-aff90fc5-3f9d-40ac-88d0-c7e686cb57e3 tempest-VolumesSnapshotTestJSON-539243248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:57:06 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-aff90fc5-3f9d-40ac-88d0-c7e686cb57e3 tempest-VolumesSnapshotTestJSON-539243248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:57:06 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-aff90fc5-3f9d-40ac-88d0-c7e686cb57e3 tempest-VolumesSnapshotTestJSON-539243248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:57:06 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-aff90fc5-3f9d-40ac-88d0-c7e686cb57e3 tempest-VolumesSnapshotTestJSON-539243248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:57:06 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1e6e56-303b-4068-9d2b-07024f8e299e]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:57:06 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-aff90fc5-3f9d-40ac-88d0-c7e686cb57e3 tempest-VolumesSnapshotTestJSON-539243248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fae3da09-b3e6-48eb-a3d9-fcf469887337.9169ca5e-6683-4a52-9750-f2478379f03f {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:06 devstack sudo[88006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fae3da09-b3e6-48eb-a3d9-fcf469887337.9169ca5e-6683-4a52-9750-f2478379f03f
Apr 15 15:57:06 devstack sudo[88006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:07 devstack sudo[88006]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:07 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-aff90fc5-3f9d-40ac-88d0-c7e686cb57e3 tempest-VolumesSnapshotTestJSON-539243248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fae3da09-b3e6-48eb-a3d9-fcf469887337.9169ca5e-6683-4a52-9750-f2478379f03f" returned: 0 in 0.467s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:07 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-aff90fc5-3f9d-40ac-88d0-c7e686cb57e3 tempest-VolumesSnapshotTestJSON-539243248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fae3da09-b3e6-48eb-a3d9-fcf469887337(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82485) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 15:57:07 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-aff90fc5-3f9d-40ac-88d0-c7e686cb57e3 tempest-VolumesSnapshotTestJSON-539243248 None] will copy from snapshot at /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fae3da09-b3e6-48eb-a3d9-fcf469887337 {{(pid=82485) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 15 15:57:07 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-aff90fc5-3f9d-40ac-88d0-c7e686cb57e3 tempest-VolumesSnapshotTestJSON-539243248 None] Creating direct copy from snapshot {{(pid=82485) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 15 15:57:07 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb79dcf6-6a4b-41d0-976c-240740141862]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:57:07 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-aff90fc5-3f9d-40ac-88d0-c7e686cb57e3 tempest-VolumesSnapshotTestJSON-539243248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fae3da09-b3e6-48eb-a3d9-fcf469887337 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:07 devstack sudo[88011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fae3da09-b3e6-48eb-a3d9-fcf469887337
Apr 15 15:57:07 devstack sudo[88011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:07 devstack sudo[88011]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:07 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-aff90fc5-3f9d-40ac-88d0-c7e686cb57e3 tempest-VolumesSnapshotTestJSON-539243248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fae3da09-b3e6-48eb-a3d9-fcf469887337" returned: 0 in 0.491s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:07 devstack cinder-volume[82485]: DEBUG cinder.utils [None req-aff90fc5-3f9d-40ac-88d0-c7e686cb57e3 tempest-VolumesSnapshotTestJSON-539243248 None] Path /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-daa2dd13-88fa-4774-a7fa-1a966c495fc4 not found in is_blk_device check {{(pid=82485) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 15 15:57:07 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-aff90fc5-3f9d-40ac-88d0-c7e686cb57e3 tempest-VolumesSnapshotTestJSON-539243248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fae3da09-b3e6-48eb-a3d9-fcf469887337 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-daa2dd13-88fa-4774-a7fa-1a966c495fc4 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:07 devstack sudo[88016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fae3da09-b3e6-48eb-a3d9-fcf469887337 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-daa2dd13-88fa-4774-a7fa-1a966c495fc4
Apr 15 15:57:07 devstack sudo[88016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:09 devstack sudo[88016]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:09 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-aff90fc5-3f9d-40ac-88d0-c7e686cb57e3 tempest-VolumesSnapshotTestJSON-539243248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fae3da09-b3e6-48eb-a3d9-fcf469887337 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-daa2dd13-88fa-4774-a7fa-1a966c495fc4" returned: 0 in 2.063s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:09 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc3633a-71d0-47b2-91c1-be2c220148fb]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:57:09 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-aff90fc5-3f9d-40ac-88d0-c7e686cb57e3 tempest-VolumesSnapshotTestJSON-539243248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fae3da09-b3e6-48eb-a3d9-fcf469887337 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:10 devstack sudo[88033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fae3da09-b3e6-48eb-a3d9-fcf469887337
Apr 15 15:57:10 devstack sudo[88033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:10 devstack sudo[88033]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-aff90fc5-3f9d-40ac-88d0-c7e686cb57e3 tempest-VolumesSnapshotTestJSON-539243248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fae3da09-b3e6-48eb-a3d9-fcf469887337" returned: 0 in 0.585s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:10 devstack cinder-volume[82485]: DEBUG cinder.image.image_utils [None req-aff90fc5-3f9d-40ac-88d0-c7e686cb57e3 tempest-VolumesSnapshotTestJSON-539243248 None] Image conversion details: src /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fae3da09-b3e6-48eb-a3d9-fcf469887337, size 1024.00 MB, duration 2.06 sec, destination /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-daa2dd13-88fa-4774-a7fa-1a966c495fc4 {{(pid=82485) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 15:57:10 devstack cinder-volume[82485]: INFO cinder.image.image_utils [None req-aff90fc5-3f9d-40ac-88d0-c7e686cb57e3 tempest-VolumesSnapshotTestJSON-539243248 None] Converted 1024.00 MB image at 496.03 MB/s
Apr 15 15:57:10 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-aff90fc5-3f9d-40ac-88d0-c7e686cb57e3 tempest-VolumesSnapshotTestJSON-539243248 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-daa2dd13-88fa-4774-a7fa-1a966c495fc4 is being set with open permissions: ugo+rw
Apr 15 15:57:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-aff90fc5-3f9d-40ac-88d0-c7e686cb57e3 tempest-VolumesSnapshotTestJSON-539243248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-daa2dd13-88fa-4774-a7fa-1a966c495fc4 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:10 devstack sudo[88038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-daa2dd13-88fa-4774-a7fa-1a966c495fc4
Apr 15 15:57:10 devstack sudo[88038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:10 devstack sudo[88038]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-aff90fc5-3f9d-40ac-88d0-c7e686cb57e3 tempest-VolumesSnapshotTestJSON-539243248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-daa2dd13-88fa-4774-a7fa-1a966c495fc4" returned: 0 in 0.437s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:10 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-aff90fc5-3f9d-40ac-88d0-c7e686cb57e3 tempest-VolumesSnapshotTestJSON-539243248 None] Lock "cinder-quobyte-daa2dd13-88fa-4774-a7fa-1a966c495fc4" released by "_copy_volume_from_snapshot" :: held 4.097s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:57:10 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-aff90fc5-3f9d-40ac-88d0-c7e686cb57e3 tempest-VolumesSnapshotTestJSON-539243248 None] Lock "cinder-quobyte-9169ca5e-6683-4a52-9750-f2478379f03f-daa2dd13-88fa-4774-a7fa-1a966c495fc4" released by "_create_volume_from_snapshot" :: held 4.116s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:57:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-aff90fc5-3f9d-40ac-88d0-c7e686cb57e3 tempest-VolumesSnapshotTestJSON-539243248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.147s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:57:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-3b97db88-6af3-4f6c-9ba8-8e2c7f55a4cb tempest-VolumesServicesTestJSON-481232803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.156s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:57:10 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-3b97db88-6af3-4f6c-9ba8-8e2c7f55a4cb tempest-VolumesServicesTestJSON-481232803 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:57:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-32355565',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b76294f1-58b3-4518-8b19-d31967cac673,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d596c3088faa4d749a7f714cdeb22f50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:57:07Z,use_quota=True,user_id='2665c730c8074ac69839cb1156e3678c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:57:10 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-3b97db88-6af3-4f6c-9ba8-8e2c7f55a4cb tempest-VolumesServicesTestJSON-481232803 None] Creating volume b76294f1-58b3-4518-8b19-d31967cac673 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:57:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-3b97db88-6af3-4f6c-9ba8-8e2c7f55a4cb tempest-VolumesServicesTestJSON-481232803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:57:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-3b97db88-6af3-4f6c-9ba8-8e2c7f55a4cb tempest-VolumesServicesTestJSON-481232803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:57:10 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-3b97db88-6af3-4f6c-9ba8-8e2c7f55a4cb tempest-VolumesServicesTestJSON-481232803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:57:11 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-3b97db88-6af3-4f6c-9ba8-8e2c7f55a4cb tempest-VolumesServicesTestJSON-481232803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:57:11 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-3b97db88-6af3-4f6c-9ba8-8e2c7f55a4cb tempest-VolumesServicesTestJSON-481232803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:57:11 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-3b97db88-6af3-4f6c-9ba8-8e2c7f55a4cb tempest-VolumesServicesTestJSON-481232803 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:57:11 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-3b97db88-6af3-4f6c-9ba8-8e2c7f55a4cb tempest-VolumesServicesTestJSON-481232803 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:57:11 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3b97db88-6af3-4f6c-9ba8-8e2c7f55a4cb tempest-VolumesServicesTestJSON-481232803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b76294f1-58b3-4518-8b19-d31967cac673 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:11 devstack sudo[88041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b76294f1-58b3-4518-8b19-d31967cac673 1073741824
Apr 15 15:57:11 devstack sudo[88041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:11 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-aff90fc5-3f9d-40ac-88d0-c7e686cb57e3 tempest-VolumesSnapshotTestJSON-539243248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e069e51-5941-47a0-9d55-df3e61c38bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daa2dd13-88fa-4774-a7fa-1a966c495fc4', 'volume_size': 2, 'snapshot_id': '9169ca5e-6683-4a52-9750-f2478379f03f'}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:57:11 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-aff90fc5-3f9d-40ac-88d0-c7e686cb57e3 tempest-VolumesSnapshotTestJSON-539243248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26fdc750-b638-4476-933e-966da78a6e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:57:11 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-aff90fc5-3f9d-40ac-88d0-c7e686cb57e3 tempest-VolumesSnapshotTestJSON-539243248 None] Volume volume-daa2dd13-88fa-4774-a7fa-1a966c495fc4 (daa2dd13-88fa-4774-a7fa-1a966c495fc4): created successfully
Apr 15 15:57:11 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-aff90fc5-3f9d-40ac-88d0-c7e686cb57e3 tempest-VolumesSnapshotTestJSON-539243248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26fdc750-b638-4476-933e-966da78a6e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:57:11 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-aff90fc5-3f9d-40ac-88d0-c7e686cb57e3 tempest-VolumesSnapshotTestJSON-539243248 None] Flow 'volume_create_manager' (f88d5512-1929-4be4-ad6f-28e7dd9f82c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:57:11 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-aff90fc5-3f9d-40ac-88d0-c7e686cb57e3 tempest-VolumesSnapshotTestJSON-539243248 None] Created volume successfully.
Apr 15 15:57:11 devstack sudo[88041]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:11 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3b97db88-6af3-4f6c-9ba8-8e2c7f55a4cb tempest-VolumesServicesTestJSON-481232803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b76294f1-58b3-4518-8b19-d31967cac673 1073741824" returned: 0 in 0.488s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:11 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3b97db88-6af3-4f6c-9ba8-8e2c7f55a4cb tempest-VolumesServicesTestJSON-481232803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b76294f1-58b3-4518-8b19-d31967cac673 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:11 devstack sudo[88046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b76294f1-58b3-4518-8b19-d31967cac673
Apr 15 15:57:11 devstack sudo[88046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:11 devstack sudo[88046]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:11 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3b97db88-6af3-4f6c-9ba8-8e2c7f55a4cb tempest-VolumesServicesTestJSON-481232803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b76294f1-58b3-4518-8b19-d31967cac673" returned: 0 in 0.424s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:11 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-3b97db88-6af3-4f6c-9ba8-8e2c7f55a4cb tempest-VolumesServicesTestJSON-481232803 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:57:11 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-3b97db88-6af3-4f6c-9ba8-8e2c7f55a4cb tempest-VolumesServicesTestJSON-481232803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:57:11 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-3b97db88-6af3-4f6c-9ba8-8e2c7f55a4cb tempest-VolumesServicesTestJSON-481232803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (610d8c4f-1e44-4bd7-8085-10f8c3135ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b76294f1-58b3-4518-8b19-d31967cac673', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:57:11 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-3b97db88-6af3-4f6c-9ba8-8e2c7f55a4cb tempest-VolumesServicesTestJSON-481232803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4747557-1bd1-44cf-a175-85656bfa10e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:57:11 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-3b97db88-6af3-4f6c-9ba8-8e2c7f55a4cb tempest-VolumesServicesTestJSON-481232803 None] Volume volume-b76294f1-58b3-4518-8b19-d31967cac673 (b76294f1-58b3-4518-8b19-d31967cac673): created successfully
Apr 15 15:57:11 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-3b97db88-6af3-4f6c-9ba8-8e2c7f55a4cb tempest-VolumesServicesTestJSON-481232803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4747557-1bd1-44cf-a175-85656bfa10e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:57:11 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-3b97db88-6af3-4f6c-9ba8-8e2c7f55a4cb tempest-VolumesServicesTestJSON-481232803 None] Flow 'volume_create_manager' (6d060c11-80c7-4132-936d-704f36e45bed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:57:11 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-3b97db88-6af3-4f6c-9ba8-8e2c7f55a4cb tempest-VolumesServicesTestJSON-481232803 None] Created volume successfully.
Apr 15 15:57:12 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-babcb5c1-7d69-4ff6-add8-cfff69d659d7 tempest-VolumesSnapshotTestJSON-539243248 None] Acquiring lock "cinder-daa2dd13-88fa-4774-a7fa-1a966c495fc4-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:57:12 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-babcb5c1-7d69-4ff6-add8-cfff69d659d7 tempest-VolumesSnapshotTestJSON-539243248 None] Lock "cinder-daa2dd13-88fa-4774-a7fa-1a966c495fc4-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:57:12 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-babcb5c1-7d69-4ff6-add8-cfff69d659d7 tempest-VolumesSnapshotTestJSON-539243248 None] Acquiring lock "cinder-quobyte-daa2dd13-88fa-4774-a7fa-1a966c495fc4" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:57:12 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-18afd04f-90b7-4282-9e38-cbec362b6b43 tempest-VolumesServicesTestJSON-481232803 None] Acquiring lock "cinder-b76294f1-58b3-4518-8b19-d31967cac673-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:57:12 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-babcb5c1-7d69-4ff6-add8-cfff69d659d7 tempest-VolumesSnapshotTestJSON-539243248 None] Lock "cinder-quobyte-daa2dd13-88fa-4774-a7fa-1a966c495fc4" acquired by "delete_volume" :: waited 0.013s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:57:12 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-18afd04f-90b7-4282-9e38-cbec362b6b43 tempest-VolumesServicesTestJSON-481232803 None] Lock "cinder-b76294f1-58b3-4518-8b19-d31967cac673-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:57:12 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c2e6384-5809-4294-ba53-362463d670c9]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:57:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-babcb5c1-7d69-4ff6-add8-cfff69d659d7 tempest-VolumesSnapshotTestJSON-539243248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-daa2dd13-88fa-4774-a7fa-1a966c495fc4 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:12 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-18afd04f-90b7-4282-9e38-cbec362b6b43 tempest-VolumesServicesTestJSON-481232803 None] Acquiring lock "cinder-quobyte-b76294f1-58b3-4518-8b19-d31967cac673" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:57:12 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-18afd04f-90b7-4282-9e38-cbec362b6b43 tempest-VolumesServicesTestJSON-481232803 None] Lock "cinder-quobyte-b76294f1-58b3-4518-8b19-d31967cac673" acquired by "delete_volume" :: waited 0.008s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:57:12 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c832fdc-d6b7-4a92-8846-fb6cfbfc248b]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:57:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-18afd04f-90b7-4282-9e38-cbec362b6b43 tempest-VolumesServicesTestJSON-481232803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b76294f1-58b3-4518-8b19-d31967cac673 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:12 devstack sudo[88049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-daa2dd13-88fa-4774-a7fa-1a966c495fc4
Apr 15 15:57:12 devstack sudo[88049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:12 devstack sudo[88050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b76294f1-58b3-4518-8b19-d31967cac673
Apr 15 15:57:12 devstack sudo[88050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:12 devstack sudo[88049]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-babcb5c1-7d69-4ff6-add8-cfff69d659d7 tempest-VolumesSnapshotTestJSON-539243248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-daa2dd13-88fa-4774-a7fa-1a966c495fc4" returned: 0 in 0.479s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-babcb5c1-7d69-4ff6-add8-cfff69d659d7 tempest-VolumesSnapshotTestJSON-539243248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-daa2dd13-88fa-4774-a7fa-1a966c495fc4 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:12 devstack sudo[88059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-daa2dd13-88fa-4774-a7fa-1a966c495fc4
Apr 15 15:57:12 devstack sudo[88059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:12 devstack sudo[88050]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-18afd04f-90b7-4282-9e38-cbec362b6b43 tempest-VolumesServicesTestJSON-481232803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b76294f1-58b3-4518-8b19-d31967cac673" returned: 0 in 0.475s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-18afd04f-90b7-4282-9e38-cbec362b6b43 tempest-VolumesServicesTestJSON-481232803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b76294f1-58b3-4518-8b19-d31967cac673 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:12 devstack sudo[88061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b76294f1-58b3-4518-8b19-d31967cac673
Apr 15 15:57:12 devstack sudo[88061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:13 devstack sudo[88059]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:13 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-babcb5c1-7d69-4ff6-add8-cfff69d659d7 tempest-VolumesSnapshotTestJSON-539243248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-daa2dd13-88fa-4774-a7fa-1a966c495fc4" returned: 0 in 0.429s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:13 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-babcb5c1-7d69-4ff6-add8-cfff69d659d7 tempest-VolumesSnapshotTestJSON-539243248 None] Lock "cinder-quobyte-daa2dd13-88fa-4774-a7fa-1a966c495fc4" released by "delete_volume" :: held 0.940s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:57:13 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-babcb5c1-7d69-4ff6-add8-cfff69d659d7 tempest-VolumesSnapshotTestJSON-539243248 None] Created reservations ['fa9129d2-756d-48d1-851b-4b0743620418', 'a84eb8e0-b482-4ca8-a3b9-f66dc1d378e3', 'e1ff2e51-64a0-4850-b52f-5e2f6cb14b50', 'b155a7a0-fd55-482c-9146-ea62519b3481'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:57:13 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-babcb5c1-7d69-4ff6-add8-cfff69d659d7 tempest-VolumesSnapshotTestJSON-539243248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:57:13 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-babcb5c1-7d69-4ff6-add8-cfff69d659d7 tempest-VolumesSnapshotTestJSON-539243248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:57:13 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-babcb5c1-7d69-4ff6-add8-cfff69d659d7 tempest-VolumesSnapshotTestJSON-539243248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:57:13 devstack sudo[88061]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:13 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-babcb5c1-7d69-4ff6-add8-cfff69d659d7 tempest-VolumesSnapshotTestJSON-539243248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:57:13 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-babcb5c1-7d69-4ff6-add8-cfff69d659d7 tempest-VolumesSnapshotTestJSON-539243248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:57:13 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-babcb5c1-7d69-4ff6-add8-cfff69d659d7 tempest-VolumesSnapshotTestJSON-539243248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:13 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-18afd04f-90b7-4282-9e38-cbec362b6b43 tempest-VolumesServicesTestJSON-481232803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b76294f1-58b3-4518-8b19-d31967cac673" returned: 0 in 0.496s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:13 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-18afd04f-90b7-4282-9e38-cbec362b6b43 tempest-VolumesServicesTestJSON-481232803 None] Lock "cinder-quobyte-b76294f1-58b3-4518-8b19-d31967cac673" released by "delete_volume" :: held 0.999s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:57:13 devstack sudo[88066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:57:13 devstack sudo[88066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:13 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-18afd04f-90b7-4282-9e38-cbec362b6b43 tempest-VolumesServicesTestJSON-481232803 None] Created reservations ['698b1a63-167f-44f8-8007-c3dc133e5c19', '47119747-d75d-4ec2-9c85-b41b59bd7a2e', 'cbd4eb16-92fc-45bb-9225-f4f42daf5878', '2bf1be67-59cc-48df-801d-903bf25fba1c'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:57:13 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-58f44b22-750d-462d-91ab-c20488a7c9c6 tempest-VolumesSnapshotTestJSON-539243248 None] Acquiring lock "cinder-9169ca5e-6683-4a52-9750-f2478379f03f-delete_snapshot" by "delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:57:13 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-58f44b22-750d-462d-91ab-c20488a7c9c6 tempest-VolumesSnapshotTestJSON-539243248 None] Lock "cinder-9169ca5e-6683-4a52-9750-f2478379f03f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:57:13 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-58f44b22-750d-462d-91ab-c20488a7c9c6 tempest-VolumesSnapshotTestJSON-539243248 None] Acquiring lock "cinder-quobyte-fae3da09-b3e6-48eb-a3d9-fcf469887337" by "delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:57:13 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-58f44b22-750d-462d-91ab-c20488a7c9c6 tempest-VolumesSnapshotTestJSON-539243248 None] Lock "cinder-quobyte-fae3da09-b3e6-48eb-a3d9-fcf469887337" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:57:13 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-58f44b22-750d-462d-91ab-c20488a7c9c6 tempest-VolumesSnapshotTestJSON-539243248 None] Acquiring lock "cinder-quobyte-9169ca5e-6683-4a52-9750-f2478379f03f" by "_delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:57:13 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-18afd04f-90b7-4282-9e38-cbec362b6b43 tempest-VolumesServicesTestJSON-481232803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:57:13 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-18afd04f-90b7-4282-9e38-cbec362b6b43 tempest-VolumesServicesTestJSON-481232803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:57:13 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-18afd04f-90b7-4282-9e38-cbec362b6b43 tempest-VolumesServicesTestJSON-481232803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:57:13 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-18afd04f-90b7-4282-9e38-cbec362b6b43 tempest-VolumesServicesTestJSON-481232803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:57:13 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-18afd04f-90b7-4282-9e38-cbec362b6b43 tempest-VolumesServicesTestJSON-481232803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:57:13 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-18afd04f-90b7-4282-9e38-cbec362b6b43 tempest-VolumesServicesTestJSON-481232803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:13 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-58f44b22-750d-462d-91ab-c20488a7c9c6 tempest-VolumesSnapshotTestJSON-539243248 None] Lock "cinder-quobyte-9169ca5e-6683-4a52-9750-f2478379f03f" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:57:13 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-58f44b22-750d-462d-91ab-c20488a7c9c6 tempest-VolumesSnapshotTestJSON-539243248 None] Deleting offline snapshot 9169ca5e-6683-4a52-9750-f2478379f03f of volume fae3da09-b3e6-48eb-a3d9-fcf469887337 {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 15:57:13 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-58f44b22-750d-462d-91ab-c20488a7c9c6 tempest-VolumesSnapshotTestJSON-539243248 None] snapshot_file for this snap is: volume-fae3da09-b3e6-48eb-a3d9-fcf469887337.9169ca5e-6683-4a52-9750-f2478379f03f {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 15:57:13 devstack sudo[88068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:57:13 devstack sudo[88068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:13 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[88cf2aae-2d48-497b-b413-63b51e24b9b8]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:57:13 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-58f44b22-750d-462d-91ab-c20488a7c9c6 tempest-VolumesSnapshotTestJSON-539243248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fae3da09-b3e6-48eb-a3d9-fcf469887337.9169ca5e-6683-4a52-9750-f2478379f03f {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:13 devstack sudo[88070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fae3da09-b3e6-48eb-a3d9-fcf469887337.9169ca5e-6683-4a52-9750-f2478379f03f
Apr 15 15:57:13 devstack sudo[88070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:13 devstack sudo[88066]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:13 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-babcb5c1-7d69-4ff6-add8-cfff69d659d7 tempest-VolumesSnapshotTestJSON-539243248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.466s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:13 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-babcb5c1-7d69-4ff6-add8-cfff69d659d7 tempest-VolumesSnapshotTestJSON-539243248 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:57:13 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-babcb5c1-7d69-4ff6-add8-cfff69d659d7 tempest-VolumesSnapshotTestJSON-539243248 None] Deleted volume successfully.
Apr 15 15:57:13 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-babcb5c1-7d69-4ff6-add8-cfff69d659d7 tempest-VolumesSnapshotTestJSON-539243248 None] Lock "cinder-daa2dd13-88fa-4774-a7fa-1a966c495fc4-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:57:13 devstack sudo[88068]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:13 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-18afd04f-90b7-4282-9e38-cbec362b6b43 tempest-VolumesServicesTestJSON-481232803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.510s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:13 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-18afd04f-90b7-4282-9e38-cbec362b6b43 tempest-VolumesServicesTestJSON-481232803 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:57:13 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-18afd04f-90b7-4282-9e38-cbec362b6b43 tempest-VolumesServicesTestJSON-481232803 None] Deleted volume successfully.
Apr 15 15:57:13 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-18afd04f-90b7-4282-9e38-cbec362b6b43 tempest-VolumesServicesTestJSON-481232803 None] Lock "cinder-b76294f1-58b3-4518-8b19-d31967cac673-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:57:13 devstack sudo[88070]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:13 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-58f44b22-750d-462d-91ab-c20488a7c9c6 tempest-VolumesSnapshotTestJSON-539243248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fae3da09-b3e6-48eb-a3d9-fcf469887337.9169ca5e-6683-4a52-9750-f2478379f03f" returned: 0 in 0.589s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:13 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-58f44b22-750d-462d-91ab-c20488a7c9c6 tempest-VolumesSnapshotTestJSON-539243248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fae3da09-b3e6-48eb-a3d9-fcf469887337(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82485) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 15:57:14 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9493f15-a0e6-490e-8a1d-92b6fbd2e22d]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:57:14 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-58f44b22-750d-462d-91ab-c20488a7c9c6 tempest-VolumesSnapshotTestJSON-539243248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fae3da09-b3e6-48eb-a3d9-fcf469887337 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:14 devstack sudo[88077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fae3da09-b3e6-48eb-a3d9-fcf469887337
Apr 15 15:57:14 devstack sudo[88077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:14 devstack sudo[88077]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:14 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-58f44b22-750d-462d-91ab-c20488a7c9c6 tempest-VolumesSnapshotTestJSON-539243248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fae3da09-b3e6-48eb-a3d9-fcf469887337" returned: 0 in 0.610s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:14 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-58f44b22-750d-462d-91ab-c20488a7c9c6 tempest-VolumesSnapshotTestJSON-539243248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fae3da09-b3e6-48eb-a3d9-fcf469887337.9169ca5e-6683-4a52-9750-f2478379f03f {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:14 devstack sudo[88083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fae3da09-b3e6-48eb-a3d9-fcf469887337.9169ca5e-6683-4a52-9750-f2478379f03f
Apr 15 15:57:14 devstack sudo[88083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:15 devstack sudo[88083]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:15 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-58f44b22-750d-462d-91ab-c20488a7c9c6 tempest-VolumesSnapshotTestJSON-539243248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fae3da09-b3e6-48eb-a3d9-fcf469887337.9169ca5e-6683-4a52-9750-f2478379f03f" returned: 0 in 0.637s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:15 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-58f44b22-750d-462d-91ab-c20488a7c9c6 tempest-VolumesSnapshotTestJSON-539243248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fae3da09-b3e6-48eb-a3d9-fcf469887337.9169ca5e-6683-4a52-9750-f2478379f03f {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:15 devstack sudo[88089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fae3da09-b3e6-48eb-a3d9-fcf469887337.9169ca5e-6683-4a52-9750-f2478379f03f
Apr 15 15:57:15 devstack sudo[88089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:15 devstack sudo[88089]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:15 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-58f44b22-750d-462d-91ab-c20488a7c9c6 tempest-VolumesSnapshotTestJSON-539243248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fae3da09-b3e6-48eb-a3d9-fcf469887337.9169ca5e-6683-4a52-9750-f2478379f03f" returned: 0 in 0.589s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:15 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-58f44b22-750d-462d-91ab-c20488a7c9c6 tempest-VolumesSnapshotTestJSON-539243248 None] Lock "cinder-quobyte-9169ca5e-6683-4a52-9750-f2478379f03f" released by "_delete_snapshot" :: held 2.492s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:57:15 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-58f44b22-750d-462d-91ab-c20488a7c9c6 tempest-VolumesSnapshotTestJSON-539243248 None] Lock "cinder-quobyte-fae3da09-b3e6-48eb-a3d9-fcf469887337" released by "delete_snapshot" :: held 2.523s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:57:15 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-58f44b22-750d-462d-91ab-c20488a7c9c6 tempest-VolumesSnapshotTestJSON-539243248 None] Created reservations ['68a8bb20-4e06-4833-89b2-e8bd24285b11', '0d144711-bed2-4f0a-becf-9da71a8b0ad1', '69729157-ef9c-4b04-aa91-28f528f09fb5', '4e35b302-5f4a-4e6b-8e0b-8c4044d9c125'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:57:15 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-58f44b22-750d-462d-91ab-c20488a7c9c6 tempest-VolumesSnapshotTestJSON-539243248 None] Delete snapshot completed successfully.
Apr 15 15:57:15 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-58f44b22-750d-462d-91ab-c20488a7c9c6 tempest-VolumesSnapshotTestJSON-539243248 None] Lock "cinder-9169ca5e-6683-4a52-9750-f2478379f03f-delete_snapshot" released by "delete_snapshot" :: held 2.623s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:57:16 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-01fa1f14-9c40-4b02-a20f-bb8b3cfa0403 tempest-VolumesSnapshotTestJSON-539243248 None] Acquiring lock "cinder-fae3da09-b3e6-48eb-a3d9-fcf469887337-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:57:16 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-01fa1f14-9c40-4b02-a20f-bb8b3cfa0403 tempest-VolumesSnapshotTestJSON-539243248 None] Lock "cinder-fae3da09-b3e6-48eb-a3d9-fcf469887337-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:57:16 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-01fa1f14-9c40-4b02-a20f-bb8b3cfa0403 tempest-VolumesSnapshotTestJSON-539243248 None] Acquiring lock "cinder-quobyte-fae3da09-b3e6-48eb-a3d9-fcf469887337" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:57:16 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-01fa1f14-9c40-4b02-a20f-bb8b3cfa0403 tempest-VolumesSnapshotTestJSON-539243248 None] Lock "cinder-quobyte-fae3da09-b3e6-48eb-a3d9-fcf469887337" acquired by "delete_volume" :: waited 0.009s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:57:16 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[2393018c-91d3-4e84-9844-f30695538750]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:57:16 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-01fa1f14-9c40-4b02-a20f-bb8b3cfa0403 tempest-VolumesSnapshotTestJSON-539243248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fae3da09-b3e6-48eb-a3d9-fcf469887337 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:16 devstack sudo[88107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fae3da09-b3e6-48eb-a3d9-fcf469887337
Apr 15 15:57:16 devstack sudo[88107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:17 devstack sudo[88107]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:17 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-01fa1f14-9c40-4b02-a20f-bb8b3cfa0403 tempest-VolumesSnapshotTestJSON-539243248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fae3da09-b3e6-48eb-a3d9-fcf469887337" returned: 0 in 0.592s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:17 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-01fa1f14-9c40-4b02-a20f-bb8b3cfa0403 tempest-VolumesSnapshotTestJSON-539243248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fae3da09-b3e6-48eb-a3d9-fcf469887337 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:17 devstack sudo[88112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fae3da09-b3e6-48eb-a3d9-fcf469887337
Apr 15 15:57:17 devstack sudo[88112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:17 devstack sudo[88112]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:17 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-01fa1f14-9c40-4b02-a20f-bb8b3cfa0403 tempest-VolumesSnapshotTestJSON-539243248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fae3da09-b3e6-48eb-a3d9-fcf469887337" returned: 0 in 0.513s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:17 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-01fa1f14-9c40-4b02-a20f-bb8b3cfa0403 tempest-VolumesSnapshotTestJSON-539243248 None] Lock "cinder-quobyte-fae3da09-b3e6-48eb-a3d9-fcf469887337" released by "delete_volume" :: held 1.152s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:57:17 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-01fa1f14-9c40-4b02-a20f-bb8b3cfa0403 tempest-VolumesSnapshotTestJSON-539243248 None] Created reservations ['8030d7d2-ddf3-41d9-952a-8af313bbec1d', '0a61f72a-d66e-451d-a00b-c1f1b1c0da88', '2b03dc24-16f6-4523-8043-53e2873d37df', '50dd9aae-7bce-4f3e-9ae1-8cb1000d752e'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:57:17 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-01fa1f14-9c40-4b02-a20f-bb8b3cfa0403 tempest-VolumesSnapshotTestJSON-539243248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:57:17 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-01fa1f14-9c40-4b02-a20f-bb8b3cfa0403 tempest-VolumesSnapshotTestJSON-539243248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:57:17 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-01fa1f14-9c40-4b02-a20f-bb8b3cfa0403 tempest-VolumesSnapshotTestJSON-539243248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:57:17 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-01fa1f14-9c40-4b02-a20f-bb8b3cfa0403 tempest-VolumesSnapshotTestJSON-539243248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:57:17 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-01fa1f14-9c40-4b02-a20f-bb8b3cfa0403 tempest-VolumesSnapshotTestJSON-539243248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:57:17 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-01fa1f14-9c40-4b02-a20f-bb8b3cfa0403 tempest-VolumesSnapshotTestJSON-539243248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:17 devstack sudo[88115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:57:17 devstack sudo[88115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:18 devstack sudo[88115]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-01fa1f14-9c40-4b02-a20f-bb8b3cfa0403 tempest-VolumesSnapshotTestJSON-539243248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.454s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:18 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-01fa1f14-9c40-4b02-a20f-bb8b3cfa0403 tempest-VolumesSnapshotTestJSON-539243248 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:57:18 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-01fa1f14-9c40-4b02-a20f-bb8b3cfa0403 tempest-VolumesSnapshotTestJSON-539243248 None] Deleted volume successfully.
Apr 15 15:57:18 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-01fa1f14-9c40-4b02-a20f-bb8b3cfa0403 tempest-VolumesSnapshotTestJSON-539243248 None] Lock "cinder-fae3da09-b3e6-48eb-a3d9-fcf469887337-delete_volume" released by "delete_volume" :: held 1.830s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:57:19 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a8e7ebd-1916-47eb-9be0-a9806d392a6e tempest-VolumesSnapshotTestJSON-539243248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:57:19 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-5a8e7ebd-1916-47eb-9be0-a9806d392a6e tempest-VolumesSnapshotTestJSON-539243248 None] Flow 'volume_create_manager' (fb37edb2-f0b7-4f7d-bd8a-98f1e27ff980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:57:19 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-5a8e7ebd-1916-47eb-9be0-a9806d392a6e tempest-VolumesSnapshotTestJSON-539243248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7604bd9c-0ba8-448f-bbb8-0e1c00ef8855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:57:19 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-5a8e7ebd-1916-47eb-9be0-a9806d392a6e tempest-VolumesSnapshotTestJSON-539243248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7604bd9c-0ba8-448f-bbb8-0e1c00ef8855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:57:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-632179660',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05c1a25e-3512-437c-96a1-6ade18a54285,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='684ff22a15b54836b8ad525b331c7ac4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:57:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:57:19Z,use_quota=True,user_id='c6701d96ef4a437a9b23c523b99519f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:57:19 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-5a8e7ebd-1916-47eb-9be0-a9806d392a6e tempest-VolumesSnapshotTestJSON-539243248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e1305f8-b6ea-46de-96d9-a1ee7d23f65c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:57:19 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-5a8e7ebd-1916-47eb-9be0-a9806d392a6e tempest-VolumesSnapshotTestJSON-539243248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e1305f8-b6ea-46de-96d9-a1ee7d23f65c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:57:19 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-5a8e7ebd-1916-47eb-9be0-a9806d392a6e tempest-VolumesSnapshotTestJSON-539243248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31c8a684-3fe2-47f6-9d6a-af87f1a962f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:57:19 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-5a8e7ebd-1916-47eb-9be0-a9806d392a6e tempest-VolumesSnapshotTestJSON-539243248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31c8a684-3fe2-47f6-9d6a-af87f1a962f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05c1a25e-3512-437c-96a1-6ade18a54285', 'volume_name': 'volume-05c1a25e-3512-437c-96a1-6ade18a54285', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:57:19 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-5a8e7ebd-1916-47eb-9be0-a9806d392a6e tempest-VolumesSnapshotTestJSON-539243248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (359a5c90-881a-4acc-aba3-98d7adfd70e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:57:19 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-5a8e7ebd-1916-47eb-9be0-a9806d392a6e tempest-VolumesSnapshotTestJSON-539243248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (359a5c90-881a-4acc-aba3-98d7adfd70e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:57:19 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-5a8e7ebd-1916-47eb-9be0-a9806d392a6e tempest-VolumesSnapshotTestJSON-539243248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3c118b4-6ebb-4b45-9c10-b8a437f8f2dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:57:19 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-5a8e7ebd-1916-47eb-9be0-a9806d392a6e tempest-VolumesSnapshotTestJSON-539243248 None] Volume 05c1a25e-3512-437c-96a1-6ade18a54285: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05c1a25e-3512-437c-96a1-6ade18a54285', 'volume_size': 1}
Apr 15 15:57:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-5a8e7ebd-1916-47eb-9be0-a9806d392a6e tempest-VolumesSnapshotTestJSON-539243248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:57:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-5a8e7ebd-1916-47eb-9be0-a9806d392a6e tempest-VolumesSnapshotTestJSON-539243248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:57:19 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-5a8e7ebd-1916-47eb-9be0-a9806d392a6e tempest-VolumesSnapshotTestJSON-539243248 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:57:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-632179660',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05c1a25e-3512-437c-96a1-6ade18a54285,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='684ff22a15b54836b8ad525b331c7ac4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:57:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:57:19Z,use_quota=True,user_id='c6701d96ef4a437a9b23c523b99519f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:57:19 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-5a8e7ebd-1916-47eb-9be0-a9806d392a6e tempest-VolumesSnapshotTestJSON-539243248 None] Creating volume 05c1a25e-3512-437c-96a1-6ade18a54285 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:57:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-5a8e7ebd-1916-47eb-9be0-a9806d392a6e tempest-VolumesSnapshotTestJSON-539243248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:57:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-5a8e7ebd-1916-47eb-9be0-a9806d392a6e tempest-VolumesSnapshotTestJSON-539243248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:57:19 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-5a8e7ebd-1916-47eb-9be0-a9806d392a6e tempest-VolumesSnapshotTestJSON-539243248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:57:19 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-5a8e7ebd-1916-47eb-9be0-a9806d392a6e tempest-VolumesSnapshotTestJSON-539243248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:57:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-5a8e7ebd-1916-47eb-9be0-a9806d392a6e tempest-VolumesSnapshotTestJSON-539243248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:57:19 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-5a8e7ebd-1916-47eb-9be0-a9806d392a6e tempest-VolumesSnapshotTestJSON-539243248 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:57:19 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-5a8e7ebd-1916-47eb-9be0-a9806d392a6e tempest-VolumesSnapshotTestJSON-539243248 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:57:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-5a8e7ebd-1916-47eb-9be0-a9806d392a6e tempest-VolumesSnapshotTestJSON-539243248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-05c1a25e-3512-437c-96a1-6ade18a54285 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:19 devstack sudo[88121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-05c1a25e-3512-437c-96a1-6ade18a54285 1073741824
Apr 15 15:57:19 devstack sudo[88121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:19 devstack sudo[88121]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-5a8e7ebd-1916-47eb-9be0-a9806d392a6e tempest-VolumesSnapshotTestJSON-539243248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-05c1a25e-3512-437c-96a1-6ade18a54285 1073741824" returned: 0 in 0.616s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-5a8e7ebd-1916-47eb-9be0-a9806d392a6e tempest-VolumesSnapshotTestJSON-539243248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-05c1a25e-3512-437c-96a1-6ade18a54285 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:19 devstack sudo[88126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-05c1a25e-3512-437c-96a1-6ade18a54285
Apr 15 15:57:19 devstack sudo[88126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:20 devstack sudo[88126]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:20 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-5a8e7ebd-1916-47eb-9be0-a9806d392a6e tempest-VolumesSnapshotTestJSON-539243248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-05c1a25e-3512-437c-96a1-6ade18a54285" returned: 0 in 0.707s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:20 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-5a8e7ebd-1916-47eb-9be0-a9806d392a6e tempest-VolumesSnapshotTestJSON-539243248 None] <== create_volume: return (1353ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:57:20 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-5a8e7ebd-1916-47eb-9be0-a9806d392a6e tempest-VolumesSnapshotTestJSON-539243248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.356s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:57:20 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-5a8e7ebd-1916-47eb-9be0-a9806d392a6e tempest-VolumesSnapshotTestJSON-539243248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3c118b4-6ebb-4b45-9c10-b8a437f8f2dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05c1a25e-3512-437c-96a1-6ade18a54285', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:57:20 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-5a8e7ebd-1916-47eb-9be0-a9806d392a6e tempest-VolumesSnapshotTestJSON-539243248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f9343a8-f04f-455a-8c7e-f5eea00b19fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:57:20 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-5a8e7ebd-1916-47eb-9be0-a9806d392a6e tempest-VolumesSnapshotTestJSON-539243248 None] Volume volume-05c1a25e-3512-437c-96a1-6ade18a54285 (05c1a25e-3512-437c-96a1-6ade18a54285): created successfully
Apr 15 15:57:20 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-5a8e7ebd-1916-47eb-9be0-a9806d392a6e tempest-VolumesSnapshotTestJSON-539243248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f9343a8-f04f-455a-8c7e-f5eea00b19fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:57:20 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-5a8e7ebd-1916-47eb-9be0-a9806d392a6e tempest-VolumesSnapshotTestJSON-539243248 None] Flow 'volume_create_manager' (fb37edb2-f0b7-4f7d-bd8a-98f1e27ff980) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:57:20 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-5a8e7ebd-1916-47eb-9be0-a9806d392a6e tempest-VolumesSnapshotTestJSON-539243248 None] Created volume successfully.
Apr 15 15:57:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-97eaf0ea-c26c-439c-8c7e-1accf9090d9a tempest-VolumesSnapshotTestJSON-539243248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:57:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-97eaf0ea-c26c-439c-8c7e-1accf9090d9a tempest-VolumesSnapshotTestJSON-539243248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:57:21 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-97eaf0ea-c26c-439c-8c7e-1accf9090d9a tempest-VolumesSnapshotTestJSON-539243248 None] Creating offline snapshot 488a7506-f97b-4686-a5cf-eb7af3cdbfc9 of volume 05c1a25e-3512-437c-96a1-6ade18a54285 {{(pid=82485) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 15:57:21 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef80c34-0a9e-43a5-b524-5d5e80cc9330]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:57:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-97eaf0ea-c26c-439c-8c7e-1accf9090d9a tempest-VolumesSnapshotTestJSON-539243248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-05c1a25e-3512-437c-96a1-6ade18a54285 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:21 devstack sudo[88158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-05c1a25e-3512-437c-96a1-6ade18a54285
Apr 15 15:57:21 devstack sudo[88158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:22 devstack sudo[88158]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:22 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-97eaf0ea-c26c-439c-8c7e-1accf9090d9a tempest-VolumesSnapshotTestJSON-539243248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-05c1a25e-3512-437c-96a1-6ade18a54285" returned: 0 in 0.718s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:22 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-97eaf0ea-c26c-439c-8c7e-1accf9090d9a tempest-VolumesSnapshotTestJSON-539243248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-05c1a25e-3512-437c-96a1-6ade18a54285,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-05c1a25e-3512-437c-96a1-6ade18a54285.488a7506-f97b-4686-a5cf-eb7af3cdbfc9 1G {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:22 devstack sudo[88163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-05c1a25e-3512-437c-96a1-6ade18a54285,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-05c1a25e-3512-437c-96a1-6ade18a54285.488a7506-f97b-4686-a5cf-eb7af3cdbfc9 1G
Apr 15 15:57:22 devstack sudo[88163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:22 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-4f858b4b-5ce0-48a1-9be7-52f8b7b4da94 tempest-VolumesActionsTest-680032541 None] Acquiring lock "cinder-f4e03146-9dc3-44f6-a091-ed0e9c7f4305" by "attach_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:57:22 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-4f858b4b-5ce0-48a1-9be7-52f8b7b4da94 tempest-VolumesActionsTest-680032541 None] Lock "cinder-f4e03146-9dc3-44f6-a091-ed0e9c7f4305" acquired by "attach_volume" :: waited 0.016s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:57:22 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-4f858b4b-5ce0-48a1-9be7-52f8b7b4da94 tempest-VolumesActionsTest-680032541 None] Attaching volume f4e03146-9dc3-44f6-a091-ed0e9c7f4305 to instance c07ad314-b7fa-4496-a54e-917992c21240 at mountpoint /dev/vdb on host None.
Apr 15 15:57:22 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-4f858b4b-5ce0-48a1-9be7-52f8b7b4da94 tempest-VolumesActionsTest-680032541 None] Attach volume completed successfully.
Apr 15 15:57:22 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-4f858b4b-5ce0-48a1-9be7-52f8b7b4da94 tempest-VolumesActionsTest-680032541 None] Lock "cinder-f4e03146-9dc3-44f6-a091-ed0e9c7f4305" released by "attach_volume" :: held 0.152s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:57:22 devstack sudo[88163]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:22 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-97eaf0ea-c26c-439c-8c7e-1accf9090d9a tempest-VolumesSnapshotTestJSON-539243248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-05c1a25e-3512-437c-96a1-6ade18a54285,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-05c1a25e-3512-437c-96a1-6ade18a54285.488a7506-f97b-4686-a5cf-eb7af3cdbfc9 1G" returned: 0 in 0.866s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:22 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-97eaf0ea-c26c-439c-8c7e-1accf9090d9a tempest-VolumesSnapshotTestJSON-539243248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05c1a25e-3512-437c-96a1-6ade18a54285 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-05c1a25e-3512-437c-96a1-6ade18a54285.488a7506-f97b-4686-a5cf-eb7af3cdbfc9 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:23 devstack sudo[88168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05c1a25e-3512-437c-96a1-6ade18a54285 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-05c1a25e-3512-437c-96a1-6ade18a54285.488a7506-f97b-4686-a5cf-eb7af3cdbfc9
Apr 15 15:57:23 devstack sudo[88168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:23 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-2aaf92ae-341a-4886-b5f7-7916aded91f8 tempest-VolumesActionsTest-680032541 None] Acquiring lock "cinder-f4e03146-9dc3-44f6-a091-ed0e9c7f4305-detach_volume" by "detach_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:57:23 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-2aaf92ae-341a-4886-b5f7-7916aded91f8 tempest-VolumesActionsTest-680032541 None] Lock "cinder-f4e03146-9dc3-44f6-a091-ed0e9c7f4305-detach_volume" acquired by "detach_volume" :: waited 0.012s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:57:23 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-2aaf92ae-341a-4886-b5f7-7916aded91f8 tempest-VolumesActionsTest-680032541 None] Detaching volume f4e03146-9dc3-44f6-a091-ed0e9c7f4305 from instance c07ad314-b7fa-4496-a54e-917992c21240.
Apr 15 15:57:23 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-2aaf92ae-341a-4886-b5f7-7916aded91f8 tempest-VolumesActionsTest-680032541 None] Detach volume completed successfully.
Apr 15 15:57:23 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-2aaf92ae-341a-4886-b5f7-7916aded91f8 tempest-VolumesActionsTest-680032541 None] Lock "cinder-f4e03146-9dc3-44f6-a091-ed0e9c7f4305-detach_volume" released by "detach_volume" :: held 0.074s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:57:23 devstack sudo[88168]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:23 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-97eaf0ea-c26c-439c-8c7e-1accf9090d9a tempest-VolumesSnapshotTestJSON-539243248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05c1a25e-3512-437c-96a1-6ade18a54285 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-05c1a25e-3512-437c-96a1-6ade18a54285.488a7506-f97b-4686-a5cf-eb7af3cdbfc9" returned: 0 in 0.686s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:23 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-97eaf0ea-c26c-439c-8c7e-1accf9090d9a tempest-VolumesSnapshotTestJSON-539243248 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-05c1a25e-3512-437c-96a1-6ade18a54285.488a7506-f97b-4686-a5cf-eb7af3cdbfc9 is being set with open permissions: ugo+rw
Apr 15 15:57:23 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-97eaf0ea-c26c-439c-8c7e-1accf9090d9a tempest-VolumesSnapshotTestJSON-539243248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-05c1a25e-3512-437c-96a1-6ade18a54285.488a7506-f97b-4686-a5cf-eb7af3cdbfc9 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:23 devstack sudo[88173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-05c1a25e-3512-437c-96a1-6ade18a54285.488a7506-f97b-4686-a5cf-eb7af3cdbfc9
Apr 15 15:57:23 devstack sudo[88173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:24 devstack sudo[88173]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:24 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-97eaf0ea-c26c-439c-8c7e-1accf9090d9a tempest-VolumesSnapshotTestJSON-539243248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-05c1a25e-3512-437c-96a1-6ade18a54285.488a7506-f97b-4686-a5cf-eb7af3cdbfc9" returned: 0 in 0.532s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:24 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-97eaf0ea-c26c-439c-8c7e-1accf9090d9a tempest-VolumesSnapshotTestJSON-539243248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-05c1a25e-3512-437c-96a1-6ade18a54285.info {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:24 devstack sudo[88177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-05c1a25e-3512-437c-96a1-6ade18a54285.info
Apr 15 15:57:24 devstack sudo[88177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:24 devstack sudo[88177]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:24 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-97eaf0ea-c26c-439c-8c7e-1accf9090d9a tempest-VolumesSnapshotTestJSON-539243248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-05c1a25e-3512-437c-96a1-6ade18a54285.info" returned: 0 in 0.482s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:24 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-97eaf0ea-c26c-439c-8c7e-1accf9090d9a tempest-VolumesSnapshotTestJSON-539243248 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-05c1a25e-3512-437c-96a1-6ade18a54285.info is being set with open permissions: ugo+rw
Apr 15 15:57:24 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-97eaf0ea-c26c-439c-8c7e-1accf9090d9a tempest-VolumesSnapshotTestJSON-539243248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-05c1a25e-3512-437c-96a1-6ade18a54285.info {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:24 devstack sudo[88181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-05c1a25e-3512-437c-96a1-6ade18a54285.info
Apr 15 15:57:24 devstack sudo[88181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:25 devstack sudo[88181]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:25 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-97eaf0ea-c26c-439c-8c7e-1accf9090d9a tempest-VolumesSnapshotTestJSON-539243248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-05c1a25e-3512-437c-96a1-6ade18a54285.info" returned: 0 in 0.434s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:25 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-97eaf0ea-c26c-439c-8c7e-1accf9090d9a tempest-VolumesSnapshotTestJSON-539243248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.797s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:57:25 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-97eaf0ea-c26c-439c-8c7e-1accf9090d9a tempest-VolumesSnapshotTestJSON-539243248 None] Create snapshot completed successfully
Apr 15 15:57:25 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-11ecde99-a28f-43dc-b837-d1864b55190c tempest-VolumesSnapshotTestJSON-539243248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:57:25 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-11ecde99-a28f-43dc-b837-d1864b55190c tempest-VolumesSnapshotTestJSON-539243248 None] Flow 'volume_create_manager' (451c1d5a-2f37-47e9-aa2b-80dc73acb3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:57:25 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-11ecde99-a28f-43dc-b837-d1864b55190c tempest-VolumesSnapshotTestJSON-539243248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0907c468-ac39-4885-bc07-377c4b17d7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:57:25 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-11ecde99-a28f-43dc-b837-d1864b55190c tempest-VolumesSnapshotTestJSON-539243248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0907c468-ac39-4885-bc07-377c4b17d7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:57:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1063278207',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=add11ba5-26ad-4c44-a521-61bba9669365,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='684ff22a15b54836b8ad525b331c7ac4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:57:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=488a7506-f97b-4686-a5cf-eb7af3cdbfc9,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:57:26Z,use_quota=True,user_id='c6701d96ef4a437a9b23c523b99519f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:57:25 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-11ecde99-a28f-43dc-b837-d1864b55190c tempest-VolumesSnapshotTestJSON-539243248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88b1ee60-b830-4420-a38a-46ee430b8cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:57:25 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-11ecde99-a28f-43dc-b837-d1864b55190c tempest-VolumesSnapshotTestJSON-539243248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88b1ee60-b830-4420-a38a-46ee430b8cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:57:25 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-11ecde99-a28f-43dc-b837-d1864b55190c tempest-VolumesSnapshotTestJSON-539243248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eefaa10d-cb8a-4ef9-afcb-357a8a92deb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:57:25 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-11ecde99-a28f-43dc-b837-d1864b55190c tempest-VolumesSnapshotTestJSON-539243248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eefaa10d-cb8a-4ef9-afcb-357a8a92deb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'add11ba5-26ad-4c44-a521-61bba9669365', 'volume_name': 'volume-add11ba5-26ad-4c44-a521-61bba9669365', 'volume_size': 1, 'snapshot_id': '488a7506-f97b-4686-a5cf-eb7af3cdbfc9'}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:57:25 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-11ecde99-a28f-43dc-b837-d1864b55190c tempest-VolumesSnapshotTestJSON-539243248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c30b52ef-7a00-4d5b-81e0-c4579ef75968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:57:25 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-11ecde99-a28f-43dc-b837-d1864b55190c tempest-VolumesSnapshotTestJSON-539243248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c30b52ef-7a00-4d5b-81e0-c4579ef75968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:57:25 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-11ecde99-a28f-43dc-b837-d1864b55190c tempest-VolumesSnapshotTestJSON-539243248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc9d6e82-a62a-4d7d-8ddb-7f1edf427cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:57:25 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-11ecde99-a28f-43dc-b837-d1864b55190c tempest-VolumesSnapshotTestJSON-539243248 None] Volume add11ba5-26ad-4c44-a521-61bba9669365: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-add11ba5-26ad-4c44-a521-61bba9669365', 'volume_size': 1, 'snapshot_id': '488a7506-f97b-4686-a5cf-eb7af3cdbfc9'}
Apr 15 15:57:25 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-11ecde99-a28f-43dc-b837-d1864b55190c tempest-VolumesSnapshotTestJSON-539243248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:57:25 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-11ecde99-a28f-43dc-b837-d1864b55190c tempest-VolumesSnapshotTestJSON-539243248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:57:25 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-11ecde99-a28f-43dc-b837-d1864b55190c tempest-VolumesSnapshotTestJSON-539243248 None] Acquiring lock "cinder-quobyte-488a7506-f97b-4686-a5cf-eb7af3cdbfc9-add11ba5-26ad-4c44-a521-61bba9669365" by "_create_volume_from_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:57:25 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-11ecde99-a28f-43dc-b837-d1864b55190c tempest-VolumesSnapshotTestJSON-539243248 None] Lock "cinder-quobyte-488a7506-f97b-4686-a5cf-eb7af3cdbfc9-add11ba5-26ad-4c44-a521-61bba9669365" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:57:25 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-11ecde99-a28f-43dc-b837-d1864b55190c tempest-VolumesSnapshotTestJSON-539243248 None] Creating volume add11ba5-26ad-4c44-a521-61bba9669365 from snapshot 488a7506-f97b-4686-a5cf-eb7af3cdbfc9 {{(pid=82485) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 15 15:57:25 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-11ecde99-a28f-43dc-b837-d1864b55190c tempest-VolumesSnapshotTestJSON-539243248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:57:25 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-11ecde99-a28f-43dc-b837-d1864b55190c tempest-VolumesSnapshotTestJSON-539243248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:57:25 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-11ecde99-a28f-43dc-b837-d1864b55190c tempest-VolumesSnapshotTestJSON-539243248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:57:25 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-11ecde99-a28f-43dc-b837-d1864b55190c tempest-VolumesSnapshotTestJSON-539243248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:57:25 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-11ecde99-a28f-43dc-b837-d1864b55190c tempest-VolumesSnapshotTestJSON-539243248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:57:25 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-11ecde99-a28f-43dc-b837-d1864b55190c tempest-VolumesSnapshotTestJSON-539243248 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:57:25 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-11ecde99-a28f-43dc-b837-d1864b55190c tempest-VolumesSnapshotTestJSON-539243248 None] Acquiring lock "cinder-quobyte-add11ba5-26ad-4c44-a521-61bba9669365" by "_copy_volume_from_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:57:25 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-11ecde99-a28f-43dc-b837-d1864b55190c tempest-VolumesSnapshotTestJSON-539243248 None] Lock "cinder-quobyte-add11ba5-26ad-4c44-a521-61bba9669365" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:57:25 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-11ecde99-a28f-43dc-b837-d1864b55190c tempest-VolumesSnapshotTestJSON-539243248 None] snapshot: 488a7506-f97b-4686-a5cf-eb7af3cdbfc9, volume: add11ba5-26ad-4c44-a521-61bba9669365,  {{(pid=82485) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 15 15:57:25 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-11ecde99-a28f-43dc-b837-d1864b55190c tempest-VolumesSnapshotTestJSON-539243248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:57:25 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-11ecde99-a28f-43dc-b837-d1864b55190c tempest-VolumesSnapshotTestJSON-539243248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:57:25 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-11ecde99-a28f-43dc-b837-d1864b55190c tempest-VolumesSnapshotTestJSON-539243248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:57:25 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-11ecde99-a28f-43dc-b837-d1864b55190c tempest-VolumesSnapshotTestJSON-539243248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:57:25 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-11ecde99-a28f-43dc-b837-d1864b55190c tempest-VolumesSnapshotTestJSON-539243248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:57:26 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d5af8c-3c4b-4395-a552-ec694b2e55a8]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:57:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-11ecde99-a28f-43dc-b837-d1864b55190c tempest-VolumesSnapshotTestJSON-539243248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-05c1a25e-3512-437c-96a1-6ade18a54285.488a7506-f97b-4686-a5cf-eb7af3cdbfc9 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:26 devstack sudo[88208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-05c1a25e-3512-437c-96a1-6ade18a54285.488a7506-f97b-4686-a5cf-eb7af3cdbfc9
Apr 15 15:57:26 devstack sudo[88208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:26 devstack sudo[88208]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-11ecde99-a28f-43dc-b837-d1864b55190c tempest-VolumesSnapshotTestJSON-539243248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-05c1a25e-3512-437c-96a1-6ade18a54285.488a7506-f97b-4686-a5cf-eb7af3cdbfc9" returned: 0 in 0.518s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:26 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-11ecde99-a28f-43dc-b837-d1864b55190c tempest-VolumesSnapshotTestJSON-539243248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05c1a25e-3512-437c-96a1-6ade18a54285(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82485) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 15:57:26 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-11ecde99-a28f-43dc-b837-d1864b55190c tempest-VolumesSnapshotTestJSON-539243248 None] will copy from snapshot at /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-05c1a25e-3512-437c-96a1-6ade18a54285 {{(pid=82485) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 15 15:57:26 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-11ecde99-a28f-43dc-b837-d1864b55190c tempest-VolumesSnapshotTestJSON-539243248 None] Creating direct copy from snapshot {{(pid=82485) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 15 15:57:26 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f2a2fa-baf4-44df-89a2-07ba5f91708a]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:57:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-11ecde99-a28f-43dc-b837-d1864b55190c tempest-VolumesSnapshotTestJSON-539243248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-05c1a25e-3512-437c-96a1-6ade18a54285 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:26 devstack sudo[88214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-05c1a25e-3512-437c-96a1-6ade18a54285
Apr 15 15:57:26 devstack sudo[88214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:27 devstack sudo[88214]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:27 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-11ecde99-a28f-43dc-b837-d1864b55190c tempest-VolumesSnapshotTestJSON-539243248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-05c1a25e-3512-437c-96a1-6ade18a54285" returned: 0 in 0.529s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:27 devstack cinder-volume[82485]: DEBUG cinder.utils [None req-11ecde99-a28f-43dc-b837-d1864b55190c tempest-VolumesSnapshotTestJSON-539243248 None] Path /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-add11ba5-26ad-4c44-a521-61bba9669365 not found in is_blk_device check {{(pid=82485) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 15 15:57:27 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-11ecde99-a28f-43dc-b837-d1864b55190c tempest-VolumesSnapshotTestJSON-539243248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-05c1a25e-3512-437c-96a1-6ade18a54285 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-add11ba5-26ad-4c44-a521-61bba9669365 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:27 devstack sudo[88221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-05c1a25e-3512-437c-96a1-6ade18a54285 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-add11ba5-26ad-4c44-a521-61bba9669365
Apr 15 15:57:27 devstack sudo[88221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:29 devstack sudo[88221]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:29 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-11ecde99-a28f-43dc-b837-d1864b55190c tempest-VolumesSnapshotTestJSON-539243248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-05c1a25e-3512-437c-96a1-6ade18a54285 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-add11ba5-26ad-4c44-a521-61bba9669365" returned: 0 in 2.435s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:29 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[b405a265-7c18-430e-81e3-a39660e4f67d]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:57:29 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-11ecde99-a28f-43dc-b837-d1864b55190c tempest-VolumesSnapshotTestJSON-539243248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-05c1a25e-3512-437c-96a1-6ade18a54285 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:29 devstack sudo[88233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-05c1a25e-3512-437c-96a1-6ade18a54285
Apr 15 15:57:29 devstack sudo[88233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:30 devstack sudo[88233]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:30 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-11ecde99-a28f-43dc-b837-d1864b55190c tempest-VolumesSnapshotTestJSON-539243248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-05c1a25e-3512-437c-96a1-6ade18a54285" returned: 0 in 0.734s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:30 devstack cinder-volume[82485]: DEBUG cinder.image.image_utils [None req-11ecde99-a28f-43dc-b837-d1864b55190c tempest-VolumesSnapshotTestJSON-539243248 None] Image conversion details: src /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-05c1a25e-3512-437c-96a1-6ade18a54285, size 1024.00 MB, duration 2.44 sec, destination /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-add11ba5-26ad-4c44-a521-61bba9669365 {{(pid=82485) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 15:57:30 devstack cinder-volume[82485]: INFO cinder.image.image_utils [None req-11ecde99-a28f-43dc-b837-d1864b55190c tempest-VolumesSnapshotTestJSON-539243248 None] Converted 1024.00 MB image at 420.35 MB/s
Apr 15 15:57:30 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-11ecde99-a28f-43dc-b837-d1864b55190c tempest-VolumesSnapshotTestJSON-539243248 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-add11ba5-26ad-4c44-a521-61bba9669365 is being set with open permissions: ugo+rw
Apr 15 15:57:30 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-11ecde99-a28f-43dc-b837-d1864b55190c tempest-VolumesSnapshotTestJSON-539243248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-add11ba5-26ad-4c44-a521-61bba9669365 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:30 devstack sudo[88238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-add11ba5-26ad-4c44-a521-61bba9669365
Apr 15 15:57:30 devstack sudo[88238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:30 devstack sudo[88238]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:30 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-11ecde99-a28f-43dc-b837-d1864b55190c tempest-VolumesSnapshotTestJSON-539243248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-add11ba5-26ad-4c44-a521-61bba9669365" returned: 0 in 0.531s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:30 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-11ecde99-a28f-43dc-b837-d1864b55190c tempest-VolumesSnapshotTestJSON-539243248 None] Lock "cinder-quobyte-add11ba5-26ad-4c44-a521-61bba9669365" released by "_copy_volume_from_snapshot" :: held 4.816s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:57:30 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-11ecde99-a28f-43dc-b837-d1864b55190c tempest-VolumesSnapshotTestJSON-539243248 None] Lock "cinder-quobyte-488a7506-f97b-4686-a5cf-eb7af3cdbfc9-add11ba5-26ad-4c44-a521-61bba9669365" released by "_create_volume_from_snapshot" :: held 4.837s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:57:30 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-11ecde99-a28f-43dc-b837-d1864b55190c tempest-VolumesSnapshotTestJSON-539243248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.847s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:57:30 devstack cinder-volume[82485]: DEBUG dbcounter [-] [82485] Writing DB stats cinder:UPDATE=120,cinder:SELECT=123,cinder:INSERT=36,cinder:DELETE=8 {{(pid=82485) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 15:57:30 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-11ecde99-a28f-43dc-b837-d1864b55190c tempest-VolumesSnapshotTestJSON-539243248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc9d6e82-a62a-4d7d-8ddb-7f1edf427cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-add11ba5-26ad-4c44-a521-61bba9669365', 'volume_size': 1, 'snapshot_id': '488a7506-f97b-4686-a5cf-eb7af3cdbfc9'}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:57:30 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-11ecde99-a28f-43dc-b837-d1864b55190c tempest-VolumesSnapshotTestJSON-539243248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05c0eeb3-0d55-405e-9117-915826ebee05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:57:30 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-11ecde99-a28f-43dc-b837-d1864b55190c tempest-VolumesSnapshotTestJSON-539243248 None] Volume volume-add11ba5-26ad-4c44-a521-61bba9669365 (add11ba5-26ad-4c44-a521-61bba9669365): created successfully
Apr 15 15:57:30 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-11ecde99-a28f-43dc-b837-d1864b55190c tempest-VolumesSnapshotTestJSON-539243248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05c0eeb3-0d55-405e-9117-915826ebee05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:57:30 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-11ecde99-a28f-43dc-b837-d1864b55190c tempest-VolumesSnapshotTestJSON-539243248 None] Flow 'volume_create_manager' (451c1d5a-2f37-47e9-aa2b-80dc73acb3d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:57:30 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-11ecde99-a28f-43dc-b837-d1864b55190c tempest-VolumesSnapshotTestJSON-539243248 None] Created volume successfully.
Apr 15 15:57:31 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-7be14a32-525e-436d-81f3-6e761cd471f0 tempest-VolumesSnapshotTestJSON-539243248 None] Acquiring lock "cinder-add11ba5-26ad-4c44-a521-61bba9669365-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:57:31 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-7be14a32-525e-436d-81f3-6e761cd471f0 tempest-VolumesSnapshotTestJSON-539243248 None] Lock "cinder-add11ba5-26ad-4c44-a521-61bba9669365-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:57:31 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-7be14a32-525e-436d-81f3-6e761cd471f0 tempest-VolumesSnapshotTestJSON-539243248 None] Acquiring lock "cinder-quobyte-add11ba5-26ad-4c44-a521-61bba9669365" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:57:31 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-7be14a32-525e-436d-81f3-6e761cd471f0 tempest-VolumesSnapshotTestJSON-539243248 None] Lock "cinder-quobyte-add11ba5-26ad-4c44-a521-61bba9669365" acquired by "delete_volume" :: waited 0.009s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:57:31 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[41feb45f-abe2-40b6-8144-de3652db81f3]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:57:31 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7be14a32-525e-436d-81f3-6e761cd471f0 tempest-VolumesSnapshotTestJSON-539243248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-add11ba5-26ad-4c44-a521-61bba9669365 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:31 devstack sudo[88246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-add11ba5-26ad-4c44-a521-61bba9669365
Apr 15 15:57:31 devstack sudo[88246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:32 devstack sudo[88246]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:32 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7be14a32-525e-436d-81f3-6e761cd471f0 tempest-VolumesSnapshotTestJSON-539243248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-add11ba5-26ad-4c44-a521-61bba9669365" returned: 0 in 0.558s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:32 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7be14a32-525e-436d-81f3-6e761cd471f0 tempest-VolumesSnapshotTestJSON-539243248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-add11ba5-26ad-4c44-a521-61bba9669365 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:32 devstack sudo[88252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-add11ba5-26ad-4c44-a521-61bba9669365
Apr 15 15:57:32 devstack sudo[88252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:32 devstack sudo[88252]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:32 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7be14a32-525e-436d-81f3-6e761cd471f0 tempest-VolumesSnapshotTestJSON-539243248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-add11ba5-26ad-4c44-a521-61bba9669365" returned: 0 in 0.545s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:32 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-7be14a32-525e-436d-81f3-6e761cd471f0 tempest-VolumesSnapshotTestJSON-539243248 None] Lock "cinder-quobyte-add11ba5-26ad-4c44-a521-61bba9669365" released by "delete_volume" :: held 1.129s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:57:32 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-7be14a32-525e-436d-81f3-6e761cd471f0 tempest-VolumesSnapshotTestJSON-539243248 None] Created reservations ['9538101d-95aa-4b1b-99bb-1f264d7ecb19', 'd0eaf6c9-e2fb-468b-81a6-3104145fa31b', '62d61a24-8422-4720-a101-f918c48e1c33', '5ce55d48-7e43-46f7-8c1a-935b3bf13a8e'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:57:32 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7be14a32-525e-436d-81f3-6e761cd471f0 tempest-VolumesSnapshotTestJSON-539243248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:57:32 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7be14a32-525e-436d-81f3-6e761cd471f0 tempest-VolumesSnapshotTestJSON-539243248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:57:32 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-7be14a32-525e-436d-81f3-6e761cd471f0 tempest-VolumesSnapshotTestJSON-539243248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:57:32 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-7be14a32-525e-436d-81f3-6e761cd471f0 tempest-VolumesSnapshotTestJSON-539243248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:57:32 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7be14a32-525e-436d-81f3-6e761cd471f0 tempest-VolumesSnapshotTestJSON-539243248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:57:32 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7be14a32-525e-436d-81f3-6e761cd471f0 tempest-VolumesSnapshotTestJSON-539243248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:32 devstack sudo[88255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:57:32 devstack sudo[88255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:33 devstack sudo[88255]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:33 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7be14a32-525e-436d-81f3-6e761cd471f0 tempest-VolumesSnapshotTestJSON-539243248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.617s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:33 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-7be14a32-525e-436d-81f3-6e761cd471f0 tempest-VolumesSnapshotTestJSON-539243248 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:57:33 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-7be14a32-525e-436d-81f3-6e761cd471f0 tempest-VolumesSnapshotTestJSON-539243248 None] Deleted volume successfully.
Apr 15 15:57:33 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-7be14a32-525e-436d-81f3-6e761cd471f0 tempest-VolumesSnapshotTestJSON-539243248 None] Lock "cinder-add11ba5-26ad-4c44-a521-61bba9669365-delete_volume" released by "delete_volume" :: held 1.993s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:57:33 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-43961bad-b756-4a8f-aba2-6f92cee09c30 tempest-VolumesSnapshotTestJSON-539243248 None] Acquiring lock "cinder-488a7506-f97b-4686-a5cf-eb7af3cdbfc9-delete_snapshot" by "delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:57:33 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-43961bad-b756-4a8f-aba2-6f92cee09c30 tempest-VolumesSnapshotTestJSON-539243248 None] Lock "cinder-488a7506-f97b-4686-a5cf-eb7af3cdbfc9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:57:33 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-43961bad-b756-4a8f-aba2-6f92cee09c30 tempest-VolumesSnapshotTestJSON-539243248 None] Acquiring lock "cinder-quobyte-05c1a25e-3512-437c-96a1-6ade18a54285" by "delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:57:33 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-43961bad-b756-4a8f-aba2-6f92cee09c30 tempest-VolumesSnapshotTestJSON-539243248 None] Lock "cinder-quobyte-05c1a25e-3512-437c-96a1-6ade18a54285" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:57:33 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-43961bad-b756-4a8f-aba2-6f92cee09c30 tempest-VolumesSnapshotTestJSON-539243248 None] Acquiring lock "cinder-quobyte-488a7506-f97b-4686-a5cf-eb7af3cdbfc9" by "_delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:57:33 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-43961bad-b756-4a8f-aba2-6f92cee09c30 tempest-VolumesSnapshotTestJSON-539243248 None] Lock "cinder-quobyte-488a7506-f97b-4686-a5cf-eb7af3cdbfc9" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:57:33 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-43961bad-b756-4a8f-aba2-6f92cee09c30 tempest-VolumesSnapshotTestJSON-539243248 None] Deleting offline snapshot 488a7506-f97b-4686-a5cf-eb7af3cdbfc9 of volume 05c1a25e-3512-437c-96a1-6ade18a54285 {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 15:57:33 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-43961bad-b756-4a8f-aba2-6f92cee09c30 tempest-VolumesSnapshotTestJSON-539243248 None] snapshot_file for this snap is: volume-05c1a25e-3512-437c-96a1-6ade18a54285.488a7506-f97b-4686-a5cf-eb7af3cdbfc9 {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 15:57:33 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8d22c8-1494-407b-96a0-5a7855df1f0f]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:57:33 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-43961bad-b756-4a8f-aba2-6f92cee09c30 tempest-VolumesSnapshotTestJSON-539243248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-05c1a25e-3512-437c-96a1-6ade18a54285.488a7506-f97b-4686-a5cf-eb7af3cdbfc9 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:33 devstack sudo[88261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-05c1a25e-3512-437c-96a1-6ade18a54285.488a7506-f97b-4686-a5cf-eb7af3cdbfc9
Apr 15 15:57:33 devstack sudo[88261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:34 devstack sudo[88261]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:34 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-43961bad-b756-4a8f-aba2-6f92cee09c30 tempest-VolumesSnapshotTestJSON-539243248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-05c1a25e-3512-437c-96a1-6ade18a54285.488a7506-f97b-4686-a5cf-eb7af3cdbfc9" returned: 0 in 0.515s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:34 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-43961bad-b756-4a8f-aba2-6f92cee09c30 tempest-VolumesSnapshotTestJSON-539243248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05c1a25e-3512-437c-96a1-6ade18a54285(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82485) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 15:57:34 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2bffd8-ea71-4f4e-8f94-908d200e14a5]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:57:34 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-43961bad-b756-4a8f-aba2-6f92cee09c30 tempest-VolumesSnapshotTestJSON-539243248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-05c1a25e-3512-437c-96a1-6ade18a54285 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:34 devstack sudo[88267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-05c1a25e-3512-437c-96a1-6ade18a54285
Apr 15 15:57:34 devstack sudo[88267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:34 devstack sudo[88267]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:34 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-43961bad-b756-4a8f-aba2-6f92cee09c30 tempest-VolumesSnapshotTestJSON-539243248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-05c1a25e-3512-437c-96a1-6ade18a54285" returned: 0 in 0.514s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:34 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-43961bad-b756-4a8f-aba2-6f92cee09c30 tempest-VolumesSnapshotTestJSON-539243248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-05c1a25e-3512-437c-96a1-6ade18a54285.488a7506-f97b-4686-a5cf-eb7af3cdbfc9 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:34 devstack sudo[88273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-05c1a25e-3512-437c-96a1-6ade18a54285.488a7506-f97b-4686-a5cf-eb7af3cdbfc9
Apr 15 15:57:34 devstack sudo[88273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:35 devstack sudo[88273]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:35 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-43961bad-b756-4a8f-aba2-6f92cee09c30 tempest-VolumesSnapshotTestJSON-539243248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-05c1a25e-3512-437c-96a1-6ade18a54285.488a7506-f97b-4686-a5cf-eb7af3cdbfc9" returned: 0 in 0.503s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:35 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-43961bad-b756-4a8f-aba2-6f92cee09c30 tempest-VolumesSnapshotTestJSON-539243248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-05c1a25e-3512-437c-96a1-6ade18a54285.488a7506-f97b-4686-a5cf-eb7af3cdbfc9 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:35 devstack sudo[88284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-05c1a25e-3512-437c-96a1-6ade18a54285.488a7506-f97b-4686-a5cf-eb7af3cdbfc9
Apr 15 15:57:35 devstack sudo[88284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:35 devstack sudo[88284]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:35 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-43961bad-b756-4a8f-aba2-6f92cee09c30 tempest-VolumesSnapshotTestJSON-539243248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-05c1a25e-3512-437c-96a1-6ade18a54285.488a7506-f97b-4686-a5cf-eb7af3cdbfc9" returned: 0 in 0.429s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:35 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-43961bad-b756-4a8f-aba2-6f92cee09c30 tempest-VolumesSnapshotTestJSON-539243248 None] Lock "cinder-quobyte-488a7506-f97b-4686-a5cf-eb7af3cdbfc9" released by "_delete_snapshot" :: held 2.054s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:57:35 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-43961bad-b756-4a8f-aba2-6f92cee09c30 tempest-VolumesSnapshotTestJSON-539243248 None] Lock "cinder-quobyte-05c1a25e-3512-437c-96a1-6ade18a54285" released by "delete_snapshot" :: held 2.069s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:57:35 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-43961bad-b756-4a8f-aba2-6f92cee09c30 tempest-VolumesSnapshotTestJSON-539243248 None] Created reservations ['31d42d7d-2891-4815-8a0f-feebc6193c5f', '3cee7809-c953-4d53-9052-44949ffd204c', '0a03fdbf-a9a7-473d-af9b-59870f5f8c2d', '97cdde82-78d1-4291-a951-1baa5ff306e9'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:57:35 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-43961bad-b756-4a8f-aba2-6f92cee09c30 tempest-VolumesSnapshotTestJSON-539243248 None] Delete snapshot completed successfully.
Apr 15 15:57:35 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-43961bad-b756-4a8f-aba2-6f92cee09c30 tempest-VolumesSnapshotTestJSON-539243248 None] Lock "cinder-488a7506-f97b-4686-a5cf-eb7af3cdbfc9-delete_snapshot" released by "delete_snapshot" :: held 2.158s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:57:36 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-9672286a-46c6-490c-b9a1-53a3b37f4f55 tempest-VolumesSnapshotTestJSON-539243248 None] Acquiring lock "cinder-05c1a25e-3512-437c-96a1-6ade18a54285-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:57:36 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-9672286a-46c6-490c-b9a1-53a3b37f4f55 tempest-VolumesSnapshotTestJSON-539243248 None] Lock "cinder-05c1a25e-3512-437c-96a1-6ade18a54285-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:57:36 devstack cinder-volume[82485]: DEBUG dbcounter [-] [82485] Writing DB stats cinder:UPDATE=165,cinder:INSERT=29,cinder:SELECT=119,cinder:DELETE=15 {{(pid=82485) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 15:57:36 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-9672286a-46c6-490c-b9a1-53a3b37f4f55 tempest-VolumesSnapshotTestJSON-539243248 None] Acquiring lock "cinder-quobyte-05c1a25e-3512-437c-96a1-6ade18a54285" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:57:36 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-9672286a-46c6-490c-b9a1-53a3b37f4f55 tempest-VolumesSnapshotTestJSON-539243248 None] Lock "cinder-quobyte-05c1a25e-3512-437c-96a1-6ade18a54285" acquired by "delete_volume" :: waited 0.020s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:57:36 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13390fd-bd87-48ec-b4cc-e646ab07dc80]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:57:36 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9672286a-46c6-490c-b9a1-53a3b37f4f55 tempest-VolumesSnapshotTestJSON-539243248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-05c1a25e-3512-437c-96a1-6ade18a54285 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:36 devstack sudo[88287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-05c1a25e-3512-437c-96a1-6ade18a54285
Apr 15 15:57:36 devstack sudo[88287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:37 devstack sudo[88287]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:37 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9672286a-46c6-490c-b9a1-53a3b37f4f55 tempest-VolumesSnapshotTestJSON-539243248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-05c1a25e-3512-437c-96a1-6ade18a54285" returned: 0 in 0.560s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:37 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9672286a-46c6-490c-b9a1-53a3b37f4f55 tempest-VolumesSnapshotTestJSON-539243248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-05c1a25e-3512-437c-96a1-6ade18a54285 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:37 devstack sudo[88306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-05c1a25e-3512-437c-96a1-6ade18a54285
Apr 15 15:57:37 devstack sudo[88306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:37 devstack sudo[88306]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:37 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9672286a-46c6-490c-b9a1-53a3b37f4f55 tempest-VolumesSnapshotTestJSON-539243248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-05c1a25e-3512-437c-96a1-6ade18a54285" returned: 0 in 0.474s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:37 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-9672286a-46c6-490c-b9a1-53a3b37f4f55 tempest-VolumesSnapshotTestJSON-539243248 None] Lock "cinder-quobyte-05c1a25e-3512-437c-96a1-6ade18a54285" released by "delete_volume" :: held 1.081s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:57:37 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-9672286a-46c6-490c-b9a1-53a3b37f4f55 tempest-VolumesSnapshotTestJSON-539243248 None] Created reservations ['fb716708-0c4f-4511-9c93-694ba3530214', '4064ecf2-c0fd-4e00-8ffa-8f06c9022c13', '6538ead1-e1cd-400f-bbbc-d49aaeab94d1', '942c4ef5-8972-4793-8191-babbfeb62682'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:57:38 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-9672286a-46c6-490c-b9a1-53a3b37f4f55 tempest-VolumesSnapshotTestJSON-539243248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:57:38 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-9672286a-46c6-490c-b9a1-53a3b37f4f55 tempest-VolumesSnapshotTestJSON-539243248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:57:38 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-9672286a-46c6-490c-b9a1-53a3b37f4f55 tempest-VolumesSnapshotTestJSON-539243248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:57:38 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-9672286a-46c6-490c-b9a1-53a3b37f4f55 tempest-VolumesSnapshotTestJSON-539243248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:57:38 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-9672286a-46c6-490c-b9a1-53a3b37f4f55 tempest-VolumesSnapshotTestJSON-539243248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:57:38 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9672286a-46c6-490c-b9a1-53a3b37f4f55 tempest-VolumesSnapshotTestJSON-539243248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:38 devstack sudo[88311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:57:38 devstack sudo[88311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:38 devstack sudo[88311]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:38 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9672286a-46c6-490c-b9a1-53a3b37f4f55 tempest-VolumesSnapshotTestJSON-539243248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.490s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:38 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-9672286a-46c6-490c-b9a1-53a3b37f4f55 tempest-VolumesSnapshotTestJSON-539243248 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:57:38 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-9672286a-46c6-490c-b9a1-53a3b37f4f55 tempest-VolumesSnapshotTestJSON-539243248 None] Deleted volume successfully.
Apr 15 15:57:38 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-9672286a-46c6-490c-b9a1-53a3b37f4f55 tempest-VolumesSnapshotTestJSON-539243248 None] Lock "cinder-05c1a25e-3512-437c-96a1-6ade18a54285-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:57:39 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-2a16a541-25b2-457c-9eba-1a499b44c031 tempest-VolumesSnapshotTestJSON-539243248 None] Acquiring lock "cinder-c9063d82-911e-40dc-994c-8f69a9f20727-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:57:39 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-2a16a541-25b2-457c-9eba-1a499b44c031 tempest-VolumesSnapshotTestJSON-539243248 None] Lock "cinder-c9063d82-911e-40dc-994c-8f69a9f20727-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:57:39 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-2a16a541-25b2-457c-9eba-1a499b44c031 tempest-VolumesSnapshotTestJSON-539243248 None] Acquiring lock "cinder-quobyte-c9063d82-911e-40dc-994c-8f69a9f20727" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:57:39 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-2a16a541-25b2-457c-9eba-1a499b44c031 tempest-VolumesSnapshotTestJSON-539243248 None] Lock "cinder-quobyte-c9063d82-911e-40dc-994c-8f69a9f20727" acquired by "delete_volume" :: waited 0.007s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:57:39 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3dcf121-ad60-44ef-8aa7-09132a23a905]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:57:39 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-2a16a541-25b2-457c-9eba-1a499b44c031 tempest-VolumesSnapshotTestJSON-539243248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c9063d82-911e-40dc-994c-8f69a9f20727 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:39 devstack sudo[88315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c9063d82-911e-40dc-994c-8f69a9f20727
Apr 15 15:57:39 devstack sudo[88315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:39 devstack sudo[88315]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:39 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-2a16a541-25b2-457c-9eba-1a499b44c031 tempest-VolumesSnapshotTestJSON-539243248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c9063d82-911e-40dc-994c-8f69a9f20727" returned: 0 in 0.500s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:39 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-2a16a541-25b2-457c-9eba-1a499b44c031 tempest-VolumesSnapshotTestJSON-539243248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c9063d82-911e-40dc-994c-8f69a9f20727 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:39 devstack sudo[88320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c9063d82-911e-40dc-994c-8f69a9f20727
Apr 15 15:57:39 devstack sudo[88320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:40 devstack sudo[88320]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:40 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-2a16a541-25b2-457c-9eba-1a499b44c031 tempest-VolumesSnapshotTestJSON-539243248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c9063d82-911e-40dc-994c-8f69a9f20727" returned: 0 in 0.463s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:40 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-2a16a541-25b2-457c-9eba-1a499b44c031 tempest-VolumesSnapshotTestJSON-539243248 None] Lock "cinder-quobyte-c9063d82-911e-40dc-994c-8f69a9f20727" released by "delete_volume" :: held 0.996s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:57:40 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-2a16a541-25b2-457c-9eba-1a499b44c031 tempest-VolumesSnapshotTestJSON-539243248 None] Created reservations ['30581c2b-a3ee-4e87-8395-1f68356891b8', '63ed8e35-0156-4cce-a45d-48df0ae19c1d', '04dad27e-ba74-48c5-8ee8-32e6695a49fc', 'd12c2def-e426-4a79-8745-efaf99493cce'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:57:40 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-2a16a541-25b2-457c-9eba-1a499b44c031 tempest-VolumesSnapshotTestJSON-539243248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:57:40 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-2a16a541-25b2-457c-9eba-1a499b44c031 tempest-VolumesSnapshotTestJSON-539243248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:57:40 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-2a16a541-25b2-457c-9eba-1a499b44c031 tempest-VolumesSnapshotTestJSON-539243248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:57:40 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-2a16a541-25b2-457c-9eba-1a499b44c031 tempest-VolumesSnapshotTestJSON-539243248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:57:40 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-2a16a541-25b2-457c-9eba-1a499b44c031 tempest-VolumesSnapshotTestJSON-539243248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:57:40 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-2a16a541-25b2-457c-9eba-1a499b44c031 tempest-VolumesSnapshotTestJSON-539243248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:40 devstack sudo[88338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:57:40 devstack sudo[88338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:40 devstack sudo[88338]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:40 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-2a16a541-25b2-457c-9eba-1a499b44c031 tempest-VolumesSnapshotTestJSON-539243248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.419s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:40 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-2a16a541-25b2-457c-9eba-1a499b44c031 tempest-VolumesSnapshotTestJSON-539243248 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:57:40 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-2a16a541-25b2-457c-9eba-1a499b44c031 tempest-VolumesSnapshotTestJSON-539243248 None] Deleted volume successfully.
Apr 15 15:57:40 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-2a16a541-25b2-457c-9eba-1a499b44c031 tempest-VolumesSnapshotTestJSON-539243248 None] Lock "cinder-c9063d82-911e-40dc-994c-8f69a9f20727-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:57:44 devstack cinder-volume[82485]: DEBUG oslo_service.periodic_task [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82485) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 15 15:57:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:57:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:57:44 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:57:44 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:57:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:57:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:44 devstack sudo[88433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:57:44 devstack sudo[88433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:45 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-ae1385e1-1e2c-45f1-881b-daa69c9dbf61 tempest-VolumesActionsTest-680032541 None] Acquiring lock "cinder-f4e03146-9dc3-44f6-a091-ed0e9c7f4305" by "attach_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:57:45 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-ae1385e1-1e2c-45f1-881b-daa69c9dbf61 tempest-VolumesActionsTest-680032541 None] Lock "cinder-f4e03146-9dc3-44f6-a091-ed0e9c7f4305" acquired by "attach_volume" :: waited 0.025s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:57:45 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-ae1385e1-1e2c-45f1-881b-daa69c9dbf61 tempest-VolumesActionsTest-680032541 None] Attaching volume f4e03146-9dc3-44f6-a091-ed0e9c7f4305 to instance 5cdf14d7-9a0f-4748-bc6b-13c9d8201750 at mountpoint /dev/vdb on host None.
Apr 15 15:57:45 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-ae1385e1-1e2c-45f1-881b-daa69c9dbf61 tempest-VolumesActionsTest-680032541 None] Attach volume completed successfully.
Apr 15 15:57:45 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-ae1385e1-1e2c-45f1-881b-daa69c9dbf61 tempest-VolumesActionsTest-680032541 None] Lock "cinder-f4e03146-9dc3-44f6-a091-ed0e9c7f4305" released by "attach_volume" :: held 0.174s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:57:45 devstack sudo[88433]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:45 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 1.065s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:45 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:57:45 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-55888246-c761-4c80-8bcb-2e72713d296a tempest-VolumesActionsTest-680032541 None] Acquiring lock "cinder-f4e03146-9dc3-44f6-a091-ed0e9c7f4305-detach_volume" by "detach_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:57:45 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-55888246-c761-4c80-8bcb-2e72713d296a tempest-VolumesActionsTest-680032541 None] Lock "cinder-f4e03146-9dc3-44f6-a091-ed0e9c7f4305-detach_volume" acquired by "detach_volume" :: waited 0.011s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:57:45 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-55888246-c761-4c80-8bcb-2e72713d296a tempest-VolumesActionsTest-680032541 None] Detaching volume f4e03146-9dc3-44f6-a091-ed0e9c7f4305 from instance 5cdf14d7-9a0f-4748-bc6b-13c9d8201750.
Apr 15 15:57:45 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-55888246-c761-4c80-8bcb-2e72713d296a tempest-VolumesActionsTest-680032541 None] Detach volume completed successfully.
Apr 15 15:57:45 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-55888246-c761-4c80-8bcb-2e72713d296a tempest-VolumesActionsTest-680032541 None] Lock "cinder-f4e03146-9dc3-44f6-a091-ed0e9c7f4305-detach_volume" released by "detach_volume" :: held 0.050s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:57:47 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-cea1c3d0-efc8-47ba-af94-76e3bd8ec2b9 tempest-VolumesSnapshotListTestJSON-408696757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:57:47 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-cea1c3d0-efc8-47ba-af94-76e3bd8ec2b9 tempest-VolumesSnapshotListTestJSON-408696757 None] Flow 'volume_create_manager' (036fe6f0-c3c7-4b47-a011-99553c9c38f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:57:47 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-cea1c3d0-efc8-47ba-af94-76e3bd8ec2b9 tempest-VolumesSnapshotListTestJSON-408696757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cea6e8fb-87a7-412d-865f-511201049b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:57:47 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-cea1c3d0-efc8-47ba-af94-76e3bd8ec2b9 tempest-VolumesSnapshotListTestJSON-408696757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cea6e8fb-87a7-412d-865f-511201049b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:57:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-664907954',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53093f60-603e-4351-9be9-798d0c4b1ed1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb49fff20de24424b4901589b873c30a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:57:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:57:47Z,use_quota=True,user_id='0c73acefdf604531ae3a76c570ed4d5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:57:47 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-cea1c3d0-efc8-47ba-af94-76e3bd8ec2b9 tempest-VolumesSnapshotListTestJSON-408696757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (574742e1-c870-4c4e-8942-8f4e4bc1b51f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:57:47 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-cea1c3d0-efc8-47ba-af94-76e3bd8ec2b9 tempest-VolumesSnapshotListTestJSON-408696757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (574742e1-c870-4c4e-8942-8f4e4bc1b51f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:57:47 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-cea1c3d0-efc8-47ba-af94-76e3bd8ec2b9 tempest-VolumesSnapshotListTestJSON-408696757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b95cb36-abf9-423a-a084-56f3f0c60464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:57:47 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-cea1c3d0-efc8-47ba-af94-76e3bd8ec2b9 tempest-VolumesSnapshotListTestJSON-408696757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b95cb36-abf9-423a-a084-56f3f0c60464) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53093f60-603e-4351-9be9-798d0c4b1ed1', 'volume_name': 'volume-53093f60-603e-4351-9be9-798d0c4b1ed1', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:57:47 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-cea1c3d0-efc8-47ba-af94-76e3bd8ec2b9 tempest-VolumesSnapshotListTestJSON-408696757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81526718-3992-4cf7-9d28-09f1ac37552d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:57:47 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-cea1c3d0-efc8-47ba-af94-76e3bd8ec2b9 tempest-VolumesSnapshotListTestJSON-408696757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81526718-3992-4cf7-9d28-09f1ac37552d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:57:47 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-cea1c3d0-efc8-47ba-af94-76e3bd8ec2b9 tempest-VolumesSnapshotListTestJSON-408696757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9a9fb22-cd02-41e2-b533-b50efa70ad5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:57:47 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-cea1c3d0-efc8-47ba-af94-76e3bd8ec2b9 tempest-VolumesSnapshotListTestJSON-408696757 None] Volume 53093f60-603e-4351-9be9-798d0c4b1ed1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53093f60-603e-4351-9be9-798d0c4b1ed1', 'volume_size': 1}
Apr 15 15:57:47 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-cea1c3d0-efc8-47ba-af94-76e3bd8ec2b9 tempest-VolumesSnapshotListTestJSON-408696757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:57:47 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-cea1c3d0-efc8-47ba-af94-76e3bd8ec2b9 tempest-VolumesSnapshotListTestJSON-408696757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:57:47 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-cea1c3d0-efc8-47ba-af94-76e3bd8ec2b9 tempest-VolumesSnapshotListTestJSON-408696757 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:57:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-664907954',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53093f60-603e-4351-9be9-798d0c4b1ed1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb49fff20de24424b4901589b873c30a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:57:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:57:47Z,use_quota=True,user_id='0c73acefdf604531ae3a76c570ed4d5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:57:47 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-cea1c3d0-efc8-47ba-af94-76e3bd8ec2b9 tempest-VolumesSnapshotListTestJSON-408696757 None] Creating volume 53093f60-603e-4351-9be9-798d0c4b1ed1 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:57:47 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-cea1c3d0-efc8-47ba-af94-76e3bd8ec2b9 tempest-VolumesSnapshotListTestJSON-408696757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:57:47 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-cea1c3d0-efc8-47ba-af94-76e3bd8ec2b9 tempest-VolumesSnapshotListTestJSON-408696757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:57:47 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-cea1c3d0-efc8-47ba-af94-76e3bd8ec2b9 tempest-VolumesSnapshotListTestJSON-408696757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:57:47 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-cea1c3d0-efc8-47ba-af94-76e3bd8ec2b9 tempest-VolumesSnapshotListTestJSON-408696757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:57:47 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-cea1c3d0-efc8-47ba-af94-76e3bd8ec2b9 tempest-VolumesSnapshotListTestJSON-408696757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:57:47 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-cea1c3d0-efc8-47ba-af94-76e3bd8ec2b9 tempest-VolumesSnapshotListTestJSON-408696757 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:57:47 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-cea1c3d0-efc8-47ba-af94-76e3bd8ec2b9 tempest-VolumesSnapshotListTestJSON-408696757 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:57:47 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-cea1c3d0-efc8-47ba-af94-76e3bd8ec2b9 tempest-VolumesSnapshotListTestJSON-408696757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:47 devstack sudo[88441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1 1073741824
Apr 15 15:57:47 devstack sudo[88441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:47 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cd5f0bc-efed-4584-9e39-d3117df4c71c tempest-VolumesActionsTest-1371964133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:57:47 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-1cd5f0bc-efed-4584-9e39-d3117df4c71c tempest-VolumesActionsTest-1371964133 None] Flow 'volume_create_manager' (602cb379-a9bd-4de5-bab1-473e685736ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:57:47 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-1cd5f0bc-efed-4584-9e39-d3117df4c71c tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77e89e28-8f2d-4183-8469-d70017fd9a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:57:47 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-1cd5f0bc-efed-4584-9e39-d3117df4c71c tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77e89e28-8f2d-4183-8469-d70017fd9a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:57:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-805561121',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b0db66a-78d9-4b3b-ae9e-572afead4852,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed231ba239684efe9c626e77361b1165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:57:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:57:47Z,use_quota=True,user_id='3b9306ef6f824ad8a0aafabf4de5ee26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:57:47 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-1cd5f0bc-efed-4584-9e39-d3117df4c71c tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eea3428-caaa-468b-8258-a77f5cac8edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:57:47 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-1cd5f0bc-efed-4584-9e39-d3117df4c71c tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eea3428-caaa-468b-8258-a77f5cac8edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:57:47 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-1cd5f0bc-efed-4584-9e39-d3117df4c71c tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96ebe66a-12ea-48e6-888c-e6ac7df7bb7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:57:47 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-1cd5f0bc-efed-4584-9e39-d3117df4c71c tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96ebe66a-12ea-48e6-888c-e6ac7df7bb7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b0db66a-78d9-4b3b-ae9e-572afead4852', 'volume_name': 'volume-1b0db66a-78d9-4b3b-ae9e-572afead4852', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:57:47 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-1cd5f0bc-efed-4584-9e39-d3117df4c71c tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cdf7b1f-b7b1-4c89-ad37-aef119d81ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:57:47 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-1cd5f0bc-efed-4584-9e39-d3117df4c71c tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cdf7b1f-b7b1-4c89-ad37-aef119d81ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:57:47 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-1cd5f0bc-efed-4584-9e39-d3117df4c71c tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19d48cd5-1714-487b-9b6c-7b11634e3f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:57:47 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-1cd5f0bc-efed-4584-9e39-d3117df4c71c tempest-VolumesActionsTest-1371964133 None] Volume 1b0db66a-78d9-4b3b-ae9e-572afead4852: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b0db66a-78d9-4b3b-ae9e-572afead4852', 'volume_size': 1}
Apr 15 15:57:47 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-1cd5f0bc-efed-4584-9e39-d3117df4c71c tempest-VolumesActionsTest-1371964133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:57:47 devstack sudo[88441]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:47 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-cea1c3d0-efc8-47ba-af94-76e3bd8ec2b9 tempest-VolumesSnapshotListTestJSON-408696757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1 1073741824" returned: 0 in 0.621s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:47 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-cea1c3d0-efc8-47ba-af94-76e3bd8ec2b9 tempest-VolumesSnapshotListTestJSON-408696757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:47 devstack sudo[88467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1
Apr 15 15:57:47 devstack sudo[88467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:48 devstack sudo[88467]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:48 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-cea1c3d0-efc8-47ba-af94-76e3bd8ec2b9 tempest-VolumesSnapshotListTestJSON-408696757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1" returned: 0 in 0.543s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:48 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-cea1c3d0-efc8-47ba-af94-76e3bd8ec2b9 tempest-VolumesSnapshotListTestJSON-408696757 None] <== create_volume: return (1199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:57:48 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-cea1c3d0-efc8-47ba-af94-76e3bd8ec2b9 tempest-VolumesSnapshotListTestJSON-408696757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.202s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:57:48 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-1cd5f0bc-efed-4584-9e39-d3117df4c71c tempest-VolumesActionsTest-1371964133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.100s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:57:48 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-1cd5f0bc-efed-4584-9e39-d3117df4c71c tempest-VolumesActionsTest-1371964133 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:57:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-805561121',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b0db66a-78d9-4b3b-ae9e-572afead4852,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed231ba239684efe9c626e77361b1165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:57:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:57:47Z,use_quota=True,user_id='3b9306ef6f824ad8a0aafabf4de5ee26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:57:48 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-1cd5f0bc-efed-4584-9e39-d3117df4c71c tempest-VolumesActionsTest-1371964133 None] Creating volume 1b0db66a-78d9-4b3b-ae9e-572afead4852 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:57:48 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-1cd5f0bc-efed-4584-9e39-d3117df4c71c tempest-VolumesActionsTest-1371964133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:57:48 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-1cd5f0bc-efed-4584-9e39-d3117df4c71c tempest-VolumesActionsTest-1371964133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:57:48 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-1cd5f0bc-efed-4584-9e39-d3117df4c71c tempest-VolumesActionsTest-1371964133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:57:48 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-1cd5f0bc-efed-4584-9e39-d3117df4c71c tempest-VolumesActionsTest-1371964133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:57:48 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-1cd5f0bc-efed-4584-9e39-d3117df4c71c tempest-VolumesActionsTest-1371964133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:57:48 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-1cd5f0bc-efed-4584-9e39-d3117df4c71c tempest-VolumesActionsTest-1371964133 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:57:48 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-1cd5f0bc-efed-4584-9e39-d3117df4c71c tempest-VolumesActionsTest-1371964133 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:57:48 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-1cd5f0bc-efed-4584-9e39-d3117df4c71c tempest-VolumesActionsTest-1371964133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1b0db66a-78d9-4b3b-ae9e-572afead4852 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:48 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-cea1c3d0-efc8-47ba-af94-76e3bd8ec2b9 tempest-VolumesSnapshotListTestJSON-408696757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9a9fb22-cd02-41e2-b533-b50efa70ad5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53093f60-603e-4351-9be9-798d0c4b1ed1', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:57:48 devstack sudo[88471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1b0db66a-78d9-4b3b-ae9e-572afead4852 1073741824
Apr 15 15:57:48 devstack sudo[88471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:48 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-cea1c3d0-efc8-47ba-af94-76e3bd8ec2b9 tempest-VolumesSnapshotListTestJSON-408696757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bde7fcd8-977d-4b73-9b36-f9fe1ace3dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:57:48 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-cea1c3d0-efc8-47ba-af94-76e3bd8ec2b9 tempest-VolumesSnapshotListTestJSON-408696757 None] Volume volume-53093f60-603e-4351-9be9-798d0c4b1ed1 (53093f60-603e-4351-9be9-798d0c4b1ed1): created successfully
Apr 15 15:57:48 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-cea1c3d0-efc8-47ba-af94-76e3bd8ec2b9 tempest-VolumesSnapshotListTestJSON-408696757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bde7fcd8-977d-4b73-9b36-f9fe1ace3dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:57:48 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-cea1c3d0-efc8-47ba-af94-76e3bd8ec2b9 tempest-VolumesSnapshotListTestJSON-408696757 None] Flow 'volume_create_manager' (036fe6f0-c3c7-4b47-a011-99553c9c38f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:57:48 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-cea1c3d0-efc8-47ba-af94-76e3bd8ec2b9 tempest-VolumesSnapshotListTestJSON-408696757 None] Created volume successfully.
Apr 15 15:57:49 devstack sudo[88471]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:49 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-1cd5f0bc-efed-4584-9e39-d3117df4c71c tempest-VolumesActionsTest-1371964133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1b0db66a-78d9-4b3b-ae9e-572afead4852 1073741824" returned: 0 in 0.553s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:49 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-1cd5f0bc-efed-4584-9e39-d3117df4c71c tempest-VolumesActionsTest-1371964133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1b0db66a-78d9-4b3b-ae9e-572afead4852 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:49 devstack sudo[88477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1b0db66a-78d9-4b3b-ae9e-572afead4852
Apr 15 15:57:49 devstack sudo[88477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:49 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-18207933-8a87-402f-99d8-a5010edba448 tempest-VolumesSnapshotListTestJSON-408696757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:57:49 devstack sudo[88477]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:49 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-1cd5f0bc-efed-4584-9e39-d3117df4c71c tempest-VolumesActionsTest-1371964133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1b0db66a-78d9-4b3b-ae9e-572afead4852" returned: 0 in 0.588s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:49 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-1cd5f0bc-efed-4584-9e39-d3117df4c71c tempest-VolumesActionsTest-1371964133 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:57:49 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-1cd5f0bc-efed-4584-9e39-d3117df4c71c tempest-VolumesActionsTest-1371964133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:57:49 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-18207933-8a87-402f-99d8-a5010edba448 tempest-VolumesSnapshotListTestJSON-408696757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.149s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:57:49 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-1cd5f0bc-efed-4584-9e39-d3117df4c71c tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19d48cd5-1714-487b-9b6c-7b11634e3f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b0db66a-78d9-4b3b-ae9e-572afead4852', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:57:49 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-1cd5f0bc-efed-4584-9e39-d3117df4c71c tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e11833e8-067e-48c9-ba1b-2fc0309a1ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:57:49 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-18207933-8a87-402f-99d8-a5010edba448 tempest-VolumesSnapshotListTestJSON-408696757 None] Creating offline snapshot 396c3f29-5375-47d3-9be8-f9a799f17f9d of volume 53093f60-603e-4351-9be9-798d0c4b1ed1 {{(pid=82485) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 15:57:49 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e59f760-498a-4b66-b84e-7756d9ada40d]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:57:49 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-18207933-8a87-402f-99d8-a5010edba448 tempest-VolumesSnapshotListTestJSON-408696757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:49 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-1cd5f0bc-efed-4584-9e39-d3117df4c71c tempest-VolumesActionsTest-1371964133 None] Volume volume-1b0db66a-78d9-4b3b-ae9e-572afead4852 (1b0db66a-78d9-4b3b-ae9e-572afead4852): created successfully
Apr 15 15:57:49 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-1cd5f0bc-efed-4584-9e39-d3117df4c71c tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e11833e8-067e-48c9-ba1b-2fc0309a1ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:57:49 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-1cd5f0bc-efed-4584-9e39-d3117df4c71c tempest-VolumesActionsTest-1371964133 None] Flow 'volume_create_manager' (602cb379-a9bd-4de5-bab1-473e685736ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:57:49 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-1cd5f0bc-efed-4584-9e39-d3117df4c71c tempest-VolumesActionsTest-1371964133 None] Created volume successfully.
Apr 15 15:57:49 devstack sudo[88481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1
Apr 15 15:57:49 devstack sudo[88481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:50 devstack sudo[88481]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:50 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-18207933-8a87-402f-99d8-a5010edba448 tempest-VolumesSnapshotListTestJSON-408696757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1" returned: 0 in 0.489s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:50 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-18207933-8a87-402f-99d8-a5010edba448 tempest-VolumesSnapshotListTestJSON-408696757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.396c3f29-5375-47d3-9be8-f9a799f17f9d 1G {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:50 devstack sudo[88486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.396c3f29-5375-47d3-9be8-f9a799f17f9d 1G
Apr 15 15:57:50 devstack sudo[88486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:50 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-b5b5c31c-fdab-4b2b-a7a8-12e6efb9077e tempest-VolumesActionsTest-1371964133 None] Acquiring lock "cinder-1b0db66a-78d9-4b3b-ae9e-572afead4852" by "attach_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:57:50 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-b5b5c31c-fdab-4b2b-a7a8-12e6efb9077e tempest-VolumesActionsTest-1371964133 None] Lock "cinder-1b0db66a-78d9-4b3b-ae9e-572afead4852" acquired by "attach_volume" :: waited 0.016s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:57:50 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-b5b5c31c-fdab-4b2b-a7a8-12e6efb9077e tempest-VolumesActionsTest-1371964133 None] Attaching volume 1b0db66a-78d9-4b3b-ae9e-572afead4852 to instance e48d4668-0b55-43aa-80d0-c3e523ebd53b at mountpoint /dev/vdb on host None.
Apr 15 15:57:50 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-b5b5c31c-fdab-4b2b-a7a8-12e6efb9077e tempest-VolumesActionsTest-1371964133 None] Attach volume completed successfully.
Apr 15 15:57:50 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-b5b5c31c-fdab-4b2b-a7a8-12e6efb9077e tempest-VolumesActionsTest-1371964133 None] Lock "cinder-1b0db66a-78d9-4b3b-ae9e-572afead4852" released by "attach_volume" :: held 0.077s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:57:50 devstack sudo[88486]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:50 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-18207933-8a87-402f-99d8-a5010edba448 tempest-VolumesSnapshotListTestJSON-408696757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.396c3f29-5375-47d3-9be8-f9a799f17f9d 1G" returned: 0 in 0.558s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:50 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-18207933-8a87-402f-99d8-a5010edba448 tempest-VolumesSnapshotListTestJSON-408696757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53093f60-603e-4351-9be9-798d0c4b1ed1 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.396c3f29-5375-47d3-9be8-f9a799f17f9d {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:50 devstack sudo[88491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53093f60-603e-4351-9be9-798d0c4b1ed1 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.396c3f29-5375-47d3-9be8-f9a799f17f9d
Apr 15 15:57:50 devstack sudo[88491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:51 devstack sudo[88491]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:51 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-18207933-8a87-402f-99d8-a5010edba448 tempest-VolumesSnapshotListTestJSON-408696757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53093f60-603e-4351-9be9-798d0c4b1ed1 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.396c3f29-5375-47d3-9be8-f9a799f17f9d" returned: 0 in 0.490s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:51 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-18207933-8a87-402f-99d8-a5010edba448 tempest-VolumesSnapshotListTestJSON-408696757 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.396c3f29-5375-47d3-9be8-f9a799f17f9d is being set with open permissions: ugo+rw
Apr 15 15:57:51 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-18207933-8a87-402f-99d8-a5010edba448 tempest-VolumesSnapshotListTestJSON-408696757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.396c3f29-5375-47d3-9be8-f9a799f17f9d {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:51 devstack sudo[88496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.396c3f29-5375-47d3-9be8-f9a799f17f9d
Apr 15 15:57:51 devstack sudo[88496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:51 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-ad361e79-6b3d-4fb6-a301-66bb9726c6a7 tempest-VolumesActionsTest-902023646 None] Terminate volume connection completed successfully.
Apr 15 15:57:51 devstack sudo[88496]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:51 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-18207933-8a87-402f-99d8-a5010edba448 tempest-VolumesSnapshotListTestJSON-408696757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.396c3f29-5375-47d3-9be8-f9a799f17f9d" returned: 0 in 0.497s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:51 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-18207933-8a87-402f-99d8-a5010edba448 tempest-VolumesSnapshotListTestJSON-408696757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.info {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:51 devstack sudo[88499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.info
Apr 15 15:57:51 devstack sudo[88499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:51 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-ad361e79-6b3d-4fb6-a301-66bb9726c6a7 tempest-VolumesActionsTest-902023646 None] Acquiring lock "cinder-1b0db66a-78d9-4b3b-ae9e-572afead4852-detach_volume" by "detach_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:57:51 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-ad361e79-6b3d-4fb6-a301-66bb9726c6a7 tempest-VolumesActionsTest-902023646 None] Lock "cinder-1b0db66a-78d9-4b3b-ae9e-572afead4852-detach_volume" acquired by "detach_volume" :: waited 0.011s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:57:51 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-ad361e79-6b3d-4fb6-a301-66bb9726c6a7 tempest-VolumesActionsTest-902023646 None] Detaching volume 1b0db66a-78d9-4b3b-ae9e-572afead4852 from instance e48d4668-0b55-43aa-80d0-c3e523ebd53b.
Apr 15 15:57:51 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-ad361e79-6b3d-4fb6-a301-66bb9726c6a7 tempest-VolumesActionsTest-902023646 None] Detach volume completed successfully.
Apr 15 15:57:51 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-ad361e79-6b3d-4fb6-a301-66bb9726c6a7 tempest-VolumesActionsTest-902023646 None] Lock "cinder-1b0db66a-78d9-4b3b-ae9e-572afead4852-detach_volume" released by "detach_volume" :: held 0.058s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:57:52 devstack sudo[88499]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:52 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-18207933-8a87-402f-99d8-a5010edba448 tempest-VolumesSnapshotListTestJSON-408696757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.info" returned: 0 in 0.476s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:52 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-18207933-8a87-402f-99d8-a5010edba448 tempest-VolumesSnapshotListTestJSON-408696757 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.info is being set with open permissions: ugo+rw
Apr 15 15:57:52 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-18207933-8a87-402f-99d8-a5010edba448 tempest-VolumesSnapshotListTestJSON-408696757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.info {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:52 devstack sudo[88502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.info
Apr 15 15:57:52 devstack sudo[88502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:52 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-779f034b-dd64-47ed-8d3b-ab996abdbae0 tempest-VolumesActionsTest-1371964133 None] Acquiring lock "cinder-1b0db66a-78d9-4b3b-ae9e-572afead4852-detach_volume" by "detach_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:57:52 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-779f034b-dd64-47ed-8d3b-ab996abdbae0 tempest-VolumesActionsTest-1371964133 None] Lock "cinder-1b0db66a-78d9-4b3b-ae9e-572afead4852-detach_volume" acquired by "detach_volume" :: waited 0.008s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:57:52 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-779f034b-dd64-47ed-8d3b-ab996abdbae0 tempest-VolumesActionsTest-1371964133 None] Volume detach called, but volume not attached.
Apr 15 15:57:52 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-779f034b-dd64-47ed-8d3b-ab996abdbae0 tempest-VolumesActionsTest-1371964133 None] Lock "cinder-1b0db66a-78d9-4b3b-ae9e-572afead4852-detach_volume" released by "detach_volume" :: held 0.014s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:57:52 devstack sudo[88502]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:52 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-18207933-8a87-402f-99d8-a5010edba448 tempest-VolumesSnapshotListTestJSON-408696757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.info" returned: 0 in 0.469s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:52 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-18207933-8a87-402f-99d8-a5010edba448 tempest-VolumesSnapshotListTestJSON-408696757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.047s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:57:52 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-18207933-8a87-402f-99d8-a5010edba448 tempest-VolumesSnapshotListTestJSON-408696757 None] Create snapshot completed successfully
Apr 15 15:57:53 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-27219c2f-3fcb-4f05-b5eb-d260db5e0450 tempest-VolumesActionsTest-1371964133 None] Acquiring lock "cinder-1b0db66a-78d9-4b3b-ae9e-572afead4852-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:57:53 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-27219c2f-3fcb-4f05-b5eb-d260db5e0450 tempest-VolumesActionsTest-1371964133 None] Lock "cinder-1b0db66a-78d9-4b3b-ae9e-572afead4852-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:57:53 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-27219c2f-3fcb-4f05-b5eb-d260db5e0450 tempest-VolumesActionsTest-1371964133 None] Acquiring lock "cinder-quobyte-1b0db66a-78d9-4b3b-ae9e-572afead4852" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:57:53 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-27219c2f-3fcb-4f05-b5eb-d260db5e0450 tempest-VolumesActionsTest-1371964133 None] Lock "cinder-quobyte-1b0db66a-78d9-4b3b-ae9e-572afead4852" acquired by "delete_volume" :: waited 0.009s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:57:53 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[764a7216-4824-41ee-abd6-3c5e939636e0]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:57:53 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-27219c2f-3fcb-4f05-b5eb-d260db5e0450 tempest-VolumesActionsTest-1371964133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1b0db66a-78d9-4b3b-ae9e-572afead4852 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:53 devstack sudo[88505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1b0db66a-78d9-4b3b-ae9e-572afead4852
Apr 15 15:57:53 devstack sudo[88505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:53 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-b6ed17ad-9164-477d-be2f-0d648634ab1f tempest-VolumesActionsTest-680032541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:57:53 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-b6ed17ad-9164-477d-be2f-0d648634ab1f tempest-VolumesActionsTest-680032541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:57:53 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4488387-ad09-4d8a-ae41-8d120e66d8b1]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:57:53 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b6ed17ad-9164-477d-be2f-0d648634ab1f tempest-VolumesActionsTest-680032541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f4e03146-9dc3-44f6-a091-ed0e9c7f4305 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:53 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-12fc70ef-467a-4edd-89b7-f23518964ada tempest-VolumesSnapshotListTestJSON-408696757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:57:53 devstack sudo[88505]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:53 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-27219c2f-3fcb-4f05-b5eb-d260db5e0450 tempest-VolumesActionsTest-1371964133 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1b0db66a-78d9-4b3b-ae9e-572afead4852" returned: 0 in 0.636s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:53 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-27219c2f-3fcb-4f05-b5eb-d260db5e0450 tempest-VolumesActionsTest-1371964133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1b0db66a-78d9-4b3b-ae9e-572afead4852 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:53 devstack sudo[88510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f4e03146-9dc3-44f6-a091-ed0e9c7f4305
Apr 15 15:57:53 devstack sudo[88510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:53 devstack sudo[88511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1b0db66a-78d9-4b3b-ae9e-572afead4852
Apr 15 15:57:53 devstack sudo[88511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:54 devstack sudo[88511]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-27219c2f-3fcb-4f05-b5eb-d260db5e0450 tempest-VolumesActionsTest-1371964133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1b0db66a-78d9-4b3b-ae9e-572afead4852" returned: 0 in 0.413s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:54 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-27219c2f-3fcb-4f05-b5eb-d260db5e0450 tempest-VolumesActionsTest-1371964133 None] Lock "cinder-quobyte-1b0db66a-78d9-4b3b-ae9e-572afead4852" released by "delete_volume" :: held 1.090s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:57:54 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-27219c2f-3fcb-4f05-b5eb-d260db5e0450 tempest-VolumesActionsTest-1371964133 None] Created reservations ['585c2068-24c4-4ebb-a6b7-5cb4e4da5f37', 'a4620bba-1606-4470-b6a2-bf9cc7bc2a6b', '8f92b922-78f3-4b0d-9627-02f71705ce22', '24558d9f-64d5-4188-a617-fd1b7fa95f8f'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:57:54 devstack sudo[88510]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b6ed17ad-9164-477d-be2f-0d648634ab1f tempest-VolumesActionsTest-680032541 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f4e03146-9dc3-44f6-a091-ed0e9c7f4305" returned: 0 in 0.561s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:54 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1dbb99a-2433-49cb-b703-2b375b9a54c3]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:57:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b6ed17ad-9164-477d-be2f-0d648634ab1f tempest-VolumesActionsTest-680032541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f4e03146-9dc3-44f6-a091-ed0e9c7f4305 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-27219c2f-3fcb-4f05-b5eb-d260db5e0450 tempest-VolumesActionsTest-1371964133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:57:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-27219c2f-3fcb-4f05-b5eb-d260db5e0450 tempest-VolumesActionsTest-1371964133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:57:54 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-27219c2f-3fcb-4f05-b5eb-d260db5e0450 tempest-VolumesActionsTest-1371964133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:57:54 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-27219c2f-3fcb-4f05-b5eb-d260db5e0450 tempest-VolumesActionsTest-1371964133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:57:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-27219c2f-3fcb-4f05-b5eb-d260db5e0450 tempest-VolumesActionsTest-1371964133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:57:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-27219c2f-3fcb-4f05-b5eb-d260db5e0450 tempest-VolumesActionsTest-1371964133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:54 devstack sudo[88519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:57:54 devstack sudo[88519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:54 devstack sudo[88518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f4e03146-9dc3-44f6-a091-ed0e9c7f4305
Apr 15 15:57:54 devstack sudo[88518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:54 devstack sudo[88518]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b6ed17ad-9164-477d-be2f-0d648634ab1f tempest-VolumesActionsTest-680032541 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f4e03146-9dc3-44f6-a091-ed0e9c7f4305" returned: 0 in 0.503s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b6ed17ad-9164-477d-be2f-0d648634ab1f tempest-VolumesActionsTest-680032541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f4e03146-9dc3-44f6-a091-ed0e9c7f4305 /opt/stack/data/cinder/conversion/f4e03146-9dc3-44f6-a091-ed0e9c7f4305.temp_image.2d936518-f3d6-4bee-b01c-44c77d68e69casnfq0i_.img {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:54 devstack sudo[88527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f4e03146-9dc3-44f6-a091-ed0e9c7f4305 /opt/stack/data/cinder/conversion/f4e03146-9dc3-44f6-a091-ed0e9c7f4305.temp_image.2d936518-f3d6-4bee-b01c-44c77d68e69casnfq0i_.img
Apr 15 15:57:54 devstack sudo[88527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:54 devstack sudo[88519]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-27219c2f-3fcb-4f05-b5eb-d260db5e0450 tempest-VolumesActionsTest-1371964133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.521s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:54 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-27219c2f-3fcb-4f05-b5eb-d260db5e0450 tempest-VolumesActionsTest-1371964133 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:57:54 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-27219c2f-3fcb-4f05-b5eb-d260db5e0450 tempest-VolumesActionsTest-1371964133 None] Deleted volume successfully.
Apr 15 15:57:54 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-27219c2f-3fcb-4f05-b5eb-d260db5e0450 tempest-VolumesActionsTest-1371964133 None] Lock "cinder-1b0db66a-78d9-4b3b-ae9e-572afead4852-delete_volume" released by "delete_volume" :: held 1.793s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:57:57 devstack sudo[88527]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b6ed17ad-9164-477d-be2f-0d648634ab1f tempest-VolumesActionsTest-680032541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f4e03146-9dc3-44f6-a091-ed0e9c7f4305 /opt/stack/data/cinder/conversion/f4e03146-9dc3-44f6-a091-ed0e9c7f4305.temp_image.2d936518-f3d6-4bee-b01c-44c77d68e69casnfq0i_.img" returned: 0 in 2.511s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:57 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[214158c7-3ce3-4140-baab-21fcc2b7f0a5]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:57:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b6ed17ad-9164-477d-be2f-0d648634ab1f tempest-VolumesActionsTest-680032541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f4e03146-9dc3-44f6-a091-ed0e9c7f4305 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:57:57 devstack sudo[88571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f4e03146-9dc3-44f6-a091-ed0e9c7f4305
Apr 15 15:57:57 devstack sudo[88571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:57:58 devstack sudo[88571]: pam_unix(sudo:session): session closed for user root
Apr 15 15:57:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b6ed17ad-9164-477d-be2f-0d648634ab1f tempest-VolumesActionsTest-680032541 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f4e03146-9dc3-44f6-a091-ed0e9c7f4305" returned: 0 in 0.592s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:57:58 devstack cinder-volume[82485]: DEBUG cinder.image.image_utils [None req-b6ed17ad-9164-477d-be2f-0d648634ab1f tempest-VolumesActionsTest-680032541 None] Image conversion details: src /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f4e03146-9dc3-44f6-a091-ed0e9c7f4305, size 1024.00 MB, duration 2.51 sec, destination /opt/stack/data/cinder/conversion/f4e03146-9dc3-44f6-a091-ed0e9c7f4305.temp_image.2d936518-f3d6-4bee-b01c-44c77d68e69casnfq0i_.img {{(pid=82485) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 15:57:58 devstack cinder-volume[82485]: INFO cinder.image.image_utils [None req-b6ed17ad-9164-477d-be2f-0d648634ab1f tempest-VolumesActionsTest-680032541 None] Converted 1024.00 MB image at 407.60 MB/s
Apr 15 15:57:58 devstack cinder-volume[82485]: DEBUG cinder.image.image_utils [None req-b6ed17ad-9164-477d-be2f-0d648634ab1f tempest-VolumesActionsTest-680032541 None] 2d936518-f3d6-4bee-b01c-44c77d68e69c was raw, no need to convert to raw {{(pid=82485) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}}
Apr 15 15:58:02 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ecbfedd-a5f6-4f2c-8133-4952d36aab10 tempest-VolumesActionsTest-1371964133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:58:02 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-6ecbfedd-a5f6-4f2c-8133-4952d36aab10 tempest-VolumesActionsTest-1371964133 None] Flow 'volume_create_manager' (797936fe-94c5-40b5-9117-138079241791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:58:02 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-6ecbfedd-a5f6-4f2c-8133-4952d36aab10 tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45d9a35e-9d19-43cb-9774-7d4e9cc8257e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:02 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-6ecbfedd-a5f6-4f2c-8133-4952d36aab10 tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45d9a35e-9d19-43cb-9774-7d4e9cc8257e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-471945904',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bec81de1-94fc-4894-b434-db3915f0bdfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed231ba239684efe9c626e77361b1165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:58:02Z,use_quota=True,user_id='3b9306ef6f824ad8a0aafabf4de5ee26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:02 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-6ecbfedd-a5f6-4f2c-8133-4952d36aab10 tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba53887f-7505-4365-888d-17901abec382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:02 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-6ecbfedd-a5f6-4f2c-8133-4952d36aab10 tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba53887f-7505-4365-888d-17901abec382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:02 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-6ecbfedd-a5f6-4f2c-8133-4952d36aab10 tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcf59a4a-4d2e-4083-80bb-74bdef58d3f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:02 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-6ecbfedd-a5f6-4f2c-8133-4952d36aab10 tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcf59a4a-4d2e-4083-80bb-74bdef58d3f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bec81de1-94fc-4894-b434-db3915f0bdfc', 'volume_name': 'volume-bec81de1-94fc-4894-b434-db3915f0bdfc', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:02 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-6ecbfedd-a5f6-4f2c-8133-4952d36aab10 tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35d49e0b-52dc-45f2-be51-dce17be76952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:02 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-6ecbfedd-a5f6-4f2c-8133-4952d36aab10 tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35d49e0b-52dc-45f2-be51-dce17be76952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:02 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-6ecbfedd-a5f6-4f2c-8133-4952d36aab10 tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbef81f3-0cc2-4e7d-9b68-80cdf1d8d8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:02 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-6ecbfedd-a5f6-4f2c-8133-4952d36aab10 tempest-VolumesActionsTest-1371964133 None] Volume bec81de1-94fc-4894-b434-db3915f0bdfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bec81de1-94fc-4894-b434-db3915f0bdfc', 'volume_size': 1}
Apr 15 15:58:02 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-6ecbfedd-a5f6-4f2c-8133-4952d36aab10 tempest-VolumesActionsTest-1371964133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:58:07 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-b6ed17ad-9164-477d-be2f-0d648634ab1f tempest-VolumesActionsTest-680032541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.773s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:58:07 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b6ed17ad-9164-477d-be2f-0d648634ab1f tempest-VolumesActionsTest-680032541 None] Uploaded volume to glance image-id: 2d936518-f3d6-4bee-b01c-44c77d68e69c. {{(pid=82485) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 15 15:58:07 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-12fc70ef-467a-4edd-89b7-f23518964ada tempest-VolumesSnapshotListTestJSON-408696757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 13.729s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:58:07 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-12fc70ef-467a-4edd-89b7-f23518964ada tempest-VolumesSnapshotListTestJSON-408696757 None] Creating offline snapshot 5ed55c95-0601-4af7-9416-486bbb1f8ea3 of volume 53093f60-603e-4351-9be9-798d0c4b1ed1 {{(pid=82485) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 15:58:07 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-b6ed17ad-9164-477d-be2f-0d648634ab1f tempest-VolumesActionsTest-680032541 None] Copy volume to image completed successfully.
Apr 15 15:58:07 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[823e9348-5839-4c53-9fd4-97e5e4a93726]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:58:07 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-12fc70ef-467a-4edd-89b7-f23518964ada tempest-VolumesSnapshotListTestJSON-408696757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.396c3f29-5375-47d3-9be8-f9a799f17f9d {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:07 devstack sudo[88580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.396c3f29-5375-47d3-9be8-f9a799f17f9d
Apr 15 15:58:07 devstack sudo[88580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:08 devstack sudo[88580]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:08 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-12fc70ef-467a-4edd-89b7-f23518964ada tempest-VolumesSnapshotListTestJSON-408696757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.396c3f29-5375-47d3-9be8-f9a799f17f9d" returned: 0 in 0.509s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:08 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-12fc70ef-467a-4edd-89b7-f23518964ada tempest-VolumesSnapshotListTestJSON-408696757 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53093f60-603e-4351-9be9-798d0c4b1ed1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82485) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 15:58:08 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-12fc70ef-467a-4edd-89b7-f23518964ada tempest-VolumesSnapshotListTestJSON-408696757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.396c3f29-5375-47d3-9be8-f9a799f17f9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.5ed55c95-0601-4af7-9416-486bbb1f8ea3 1G {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:08 devstack sudo[88585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.396c3f29-5375-47d3-9be8-f9a799f17f9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.5ed55c95-0601-4af7-9416-486bbb1f8ea3 1G
Apr 15 15:58:08 devstack sudo[88585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:08 devstack sudo[88585]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:08 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-12fc70ef-467a-4edd-89b7-f23518964ada tempest-VolumesSnapshotListTestJSON-408696757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.396c3f29-5375-47d3-9be8-f9a799f17f9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.5ed55c95-0601-4af7-9416-486bbb1f8ea3 1G" returned: 0 in 0.544s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:08 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-12fc70ef-467a-4edd-89b7-f23518964ada tempest-VolumesSnapshotListTestJSON-408696757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53093f60-603e-4351-9be9-798d0c4b1ed1.396c3f29-5375-47d3-9be8-f9a799f17f9d -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.5ed55c95-0601-4af7-9416-486bbb1f8ea3 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:08 devstack sudo[88590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53093f60-603e-4351-9be9-798d0c4b1ed1.396c3f29-5375-47d3-9be8-f9a799f17f9d -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.5ed55c95-0601-4af7-9416-486bbb1f8ea3
Apr 15 15:58:08 devstack sudo[88590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:08 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-72642d59-c550-4a69-8bf8-a036bf5d1e3d tempest-VolumesActionsTest-680032541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:58:09 devstack sudo[88590]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:09 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-12fc70ef-467a-4edd-89b7-f23518964ada tempest-VolumesSnapshotListTestJSON-408696757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53093f60-603e-4351-9be9-798d0c4b1ed1.396c3f29-5375-47d3-9be8-f9a799f17f9d -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.5ed55c95-0601-4af7-9416-486bbb1f8ea3" returned: 0 in 0.435s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:09 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-12fc70ef-467a-4edd-89b7-f23518964ada tempest-VolumesSnapshotListTestJSON-408696757 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.5ed55c95-0601-4af7-9416-486bbb1f8ea3 is being set with open permissions: ugo+rw
Apr 15 15:58:09 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-12fc70ef-467a-4edd-89b7-f23518964ada tempest-VolumesSnapshotListTestJSON-408696757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.5ed55c95-0601-4af7-9416-486bbb1f8ea3 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:09 devstack sudo[88595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.5ed55c95-0601-4af7-9416-486bbb1f8ea3
Apr 15 15:58:09 devstack sudo[88595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:09 devstack sudo[88595]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:09 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-12fc70ef-467a-4edd-89b7-f23518964ada tempest-VolumesSnapshotListTestJSON-408696757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.5ed55c95-0601-4af7-9416-486bbb1f8ea3" returned: 0 in 0.442s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:09 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-12fc70ef-467a-4edd-89b7-f23518964ada tempest-VolumesSnapshotListTestJSON-408696757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.993s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:58:09 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-6ecbfedd-a5f6-4f2c-8133-4952d36aab10 tempest-VolumesActionsTest-1371964133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.217s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:58:09 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbfedd-a5f6-4f2c-8133-4952d36aab10 tempest-VolumesActionsTest-1371964133 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-471945904',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bec81de1-94fc-4894-b434-db3915f0bdfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed231ba239684efe9c626e77361b1165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:58:02Z,use_quota=True,user_id='3b9306ef6f824ad8a0aafabf4de5ee26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:58:09 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-6ecbfedd-a5f6-4f2c-8133-4952d36aab10 tempest-VolumesActionsTest-1371964133 None] Creating volume bec81de1-94fc-4894-b434-db3915f0bdfc {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:58:09 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-6ecbfedd-a5f6-4f2c-8133-4952d36aab10 tempest-VolumesActionsTest-1371964133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:58:09 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-6ecbfedd-a5f6-4f2c-8133-4952d36aab10 tempest-VolumesActionsTest-1371964133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:58:09 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbfedd-a5f6-4f2c-8133-4952d36aab10 tempest-VolumesActionsTest-1371964133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:58:09 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbfedd-a5f6-4f2c-8133-4952d36aab10 tempest-VolumesActionsTest-1371964133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:58:09 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-6ecbfedd-a5f6-4f2c-8133-4952d36aab10 tempest-VolumesActionsTest-1371964133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:58:09 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbfedd-a5f6-4f2c-8133-4952d36aab10 tempest-VolumesActionsTest-1371964133 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:58:09 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-6ecbfedd-a5f6-4f2c-8133-4952d36aab10 tempest-VolumesActionsTest-1371964133 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:58:09 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6ecbfedd-a5f6-4f2c-8133-4952d36aab10 tempest-VolumesActionsTest-1371964133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-bec81de1-94fc-4894-b434-db3915f0bdfc 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:09 devstack sudo[88598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-bec81de1-94fc-4894-b434-db3915f0bdfc 1073741824
Apr 15 15:58:09 devstack sudo[88598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:09 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-12fc70ef-467a-4edd-89b7-f23518964ada tempest-VolumesSnapshotListTestJSON-408696757 None] Create snapshot completed successfully
Apr 15 15:58:10 devstack sudo[88598]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6ecbfedd-a5f6-4f2c-8133-4952d36aab10 tempest-VolumesActionsTest-1371964133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-bec81de1-94fc-4894-b434-db3915f0bdfc 1073741824" returned: 0 in 0.513s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6ecbfedd-a5f6-4f2c-8133-4952d36aab10 tempest-VolumesActionsTest-1371964133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-bec81de1-94fc-4894-b434-db3915f0bdfc {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:10 devstack sudo[88603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-bec81de1-94fc-4894-b434-db3915f0bdfc
Apr 15 15:58:10 devstack sudo[88603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:10 devstack sudo[88603]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6ecbfedd-a5f6-4f2c-8133-4952d36aab10 tempest-VolumesActionsTest-1371964133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-bec81de1-94fc-4894-b434-db3915f0bdfc" returned: 0 in 0.436s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:10 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbfedd-a5f6-4f2c-8133-4952d36aab10 tempest-VolumesActionsTest-1371964133 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:58:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-6ecbfedd-a5f6-4f2c-8133-4952d36aab10 tempest-VolumesActionsTest-1371964133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:58:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-72642d59-c550-4a69-8bf8-a036bf5d1e3d tempest-VolumesActionsTest-680032541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.726s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:58:10 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f668dd-61ec-45c6-b53d-6c52794d5921]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:58:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-72642d59-c550-4a69-8bf8-a036bf5d1e3d tempest-VolumesActionsTest-680032541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f4e03146-9dc3-44f6-a091-ed0e9c7f4305 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:10 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-6ecbfedd-a5f6-4f2c-8133-4952d36aab10 tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbef81f3-0cc2-4e7d-9b68-80cdf1d8d8c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bec81de1-94fc-4894-b434-db3915f0bdfc', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:10 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-6ecbfedd-a5f6-4f2c-8133-4952d36aab10 tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4980a1e-10f8-4ff6-8592-a4122e4971fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:10 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-6ecbfedd-a5f6-4f2c-8133-4952d36aab10 tempest-VolumesActionsTest-1371964133 None] Volume volume-bec81de1-94fc-4894-b434-db3915f0bdfc (bec81de1-94fc-4894-b434-db3915f0bdfc): created successfully
Apr 15 15:58:10 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-6ecbfedd-a5f6-4f2c-8133-4952d36aab10 tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4980a1e-10f8-4ff6-8592-a4122e4971fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:10 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-6ecbfedd-a5f6-4f2c-8133-4952d36aab10 tempest-VolumesActionsTest-1371964133 None] Flow 'volume_create_manager' (797936fe-94c5-40b5-9117-138079241791) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:58:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-3309dfbe-b410-4334-88a7-49218f5b946f tempest-VolumesSnapshotListTestJSON-408696757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:58:10 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-6ecbfedd-a5f6-4f2c-8133-4952d36aab10 tempest-VolumesActionsTest-1371964133 None] Created volume successfully.
Apr 15 15:58:10 devstack sudo[88606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f4e03146-9dc3-44f6-a091-ed0e9c7f4305
Apr 15 15:58:10 devstack sudo[88606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:11 devstack sudo[88606]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:11 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-72642d59-c550-4a69-8bf8-a036bf5d1e3d tempest-VolumesActionsTest-680032541 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f4e03146-9dc3-44f6-a091-ed0e9c7f4305" returned: 0 in 0.520s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:11 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde09715-1af5-4000-9f9f-e764391f9f99]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:58:11 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-72642d59-c550-4a69-8bf8-a036bf5d1e3d tempest-VolumesActionsTest-680032541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f4e03146-9dc3-44f6-a091-ed0e9c7f4305 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:11 devstack sudo[88611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f4e03146-9dc3-44f6-a091-ed0e9c7f4305
Apr 15 15:58:11 devstack sudo[88611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:11 devstack sudo[88611]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:11 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-72642d59-c550-4a69-8bf8-a036bf5d1e3d tempest-VolumesActionsTest-680032541 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f4e03146-9dc3-44f6-a091-ed0e9c7f4305" returned: 0 in 0.467s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:11 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-72642d59-c550-4a69-8bf8-a036bf5d1e3d tempest-VolumesActionsTest-680032541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f4e03146-9dc3-44f6-a091-ed0e9c7f4305 /opt/stack/data/cinder/conversion/f4e03146-9dc3-44f6-a091-ed0e9c7f4305.temp_image.38ef0972-63cf-40f3-ae34-e2708c2ff86cw9xk_g9c.img {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:11 devstack sudo[88616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f4e03146-9dc3-44f6-a091-ed0e9c7f4305 /opt/stack/data/cinder/conversion/f4e03146-9dc3-44f6-a091-ed0e9c7f4305.temp_image.38ef0972-63cf-40f3-ae34-e2708c2ff86cw9xk_g9c.img
Apr 15 15:58:11 devstack sudo[88616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:11 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-8022b486-0423-4633-b4b0-493081767933 tempest-VolumesActionsTest-902023646 None] Acquiring lock "cinder-bec81de1-94fc-4894-b434-db3915f0bdfc-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:58:11 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-8022b486-0423-4633-b4b0-493081767933 tempest-VolumesActionsTest-902023646 None] Lock "cinder-bec81de1-94fc-4894-b434-db3915f0bdfc-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:58:11 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-8022b486-0423-4633-b4b0-493081767933 tempest-VolumesActionsTest-902023646 None] Acquiring lock "cinder-quobyte-bec81de1-94fc-4894-b434-db3915f0bdfc" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:58:11 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-8022b486-0423-4633-b4b0-493081767933 tempest-VolumesActionsTest-902023646 None] Lock "cinder-quobyte-bec81de1-94fc-4894-b434-db3915f0bdfc" acquired by "delete_volume" :: waited 0.008s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:58:11 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[866ffff2-b569-49c5-bcf1-dd497764b09a]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:58:11 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-8022b486-0423-4633-b4b0-493081767933 tempest-VolumesActionsTest-902023646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-bec81de1-94fc-4894-b434-db3915f0bdfc {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:11 devstack sudo[88618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-bec81de1-94fc-4894-b434-db3915f0bdfc
Apr 15 15:58:11 devstack sudo[88618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:12 devstack sudo[88618]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-8022b486-0423-4633-b4b0-493081767933 tempest-VolumesActionsTest-902023646 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-bec81de1-94fc-4894-b434-db3915f0bdfc" returned: 0 in 0.946s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-8022b486-0423-4633-b4b0-493081767933 tempest-VolumesActionsTest-902023646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-bec81de1-94fc-4894-b434-db3915f0bdfc {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:12 devstack sudo[88633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-bec81de1-94fc-4894-b434-db3915f0bdfc
Apr 15 15:58:12 devstack sudo[88633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:13 devstack sudo[88616]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:13 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-72642d59-c550-4a69-8bf8-a036bf5d1e3d tempest-VolumesActionsTest-680032541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f4e03146-9dc3-44f6-a091-ed0e9c7f4305 /opt/stack/data/cinder/conversion/f4e03146-9dc3-44f6-a091-ed0e9c7f4305.temp_image.38ef0972-63cf-40f3-ae34-e2708c2ff86cw9xk_g9c.img" returned: 0 in 2.186s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:13 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8dfed8-5bda-4543-b8b0-86635a0f4da7]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:58:13 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-72642d59-c550-4a69-8bf8-a036bf5d1e3d tempest-VolumesActionsTest-680032541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f4e03146-9dc3-44f6-a091-ed0e9c7f4305 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:13 devstack sudo[88633]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:13 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-8022b486-0423-4633-b4b0-493081767933 tempest-VolumesActionsTest-902023646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-bec81de1-94fc-4894-b434-db3915f0bdfc" returned: 0 in 0.963s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:13 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-8022b486-0423-4633-b4b0-493081767933 tempest-VolumesActionsTest-902023646 None] Lock "cinder-quobyte-bec81de1-94fc-4894-b434-db3915f0bdfc" released by "delete_volume" :: held 1.948s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:58:13 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-8022b486-0423-4633-b4b0-493081767933 tempest-VolumesActionsTest-902023646 None] Created reservations ['5fb06a3a-7ef1-4c53-b824-4afa5aaa01c5', 'f8bc0cd8-c174-4e23-900f-0e6dce0b63af', '9a4bd692-d4bf-40a5-be3c-4a9d1709e43e', '6ecf41f0-b051-4826-a25d-73048137077f'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:58:13 devstack sudo[88637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f4e03146-9dc3-44f6-a091-ed0e9c7f4305
Apr 15 15:58:13 devstack sudo[88637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:13 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-8022b486-0423-4633-b4b0-493081767933 tempest-VolumesActionsTest-902023646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:58:13 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-8022b486-0423-4633-b4b0-493081767933 tempest-VolumesActionsTest-902023646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:58:13 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-8022b486-0423-4633-b4b0-493081767933 tempest-VolumesActionsTest-902023646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:58:13 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-8022b486-0423-4633-b4b0-493081767933 tempest-VolumesActionsTest-902023646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:58:13 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-8022b486-0423-4633-b4b0-493081767933 tempest-VolumesActionsTest-902023646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:58:13 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-8022b486-0423-4633-b4b0-493081767933 tempest-VolumesActionsTest-902023646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:13 devstack sudo[88639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:58:13 devstack sudo[88639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:14 devstack sudo[88639]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:14 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-8022b486-0423-4633-b4b0-493081767933 tempest-VolumesActionsTest-902023646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.479s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:14 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-8022b486-0423-4633-b4b0-493081767933 tempest-VolumesActionsTest-902023646 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:58:14 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-8022b486-0423-4633-b4b0-493081767933 tempest-VolumesActionsTest-902023646 None] Deleted volume successfully.
Apr 15 15:58:14 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-8022b486-0423-4633-b4b0-493081767933 tempest-VolumesActionsTest-902023646 None] Lock "cinder-bec81de1-94fc-4894-b434-db3915f0bdfc-delete_volume" released by "delete_volume" :: held 2.555s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:58:14 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-b930503b-cf3b-4fe5-b3a6-1cd636d19451 tempest-VolumesActionsTest-1371964133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:58:14 devstack sudo[88637]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:14 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b930503b-cf3b-4fe5-b3a6-1cd636d19451 tempest-VolumesActionsTest-1371964133 None] Flow 'volume_create_manager' (1e53ecdc-e6ea-452d-9523-9d5b1582a57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:58:14 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b930503b-cf3b-4fe5-b3a6-1cd636d19451 tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3a9284e-f538-4ba0-ab4c-d6cabc1edbea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:14 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-72642d59-c550-4a69-8bf8-a036bf5d1e3d tempest-VolumesActionsTest-680032541 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f4e03146-9dc3-44f6-a091-ed0e9c7f4305" returned: 0 in 0.668s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:14 devstack cinder-volume[82485]: DEBUG cinder.image.image_utils [None req-72642d59-c550-4a69-8bf8-a036bf5d1e3d tempest-VolumesActionsTest-680032541 None] Image conversion details: src /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f4e03146-9dc3-44f6-a091-ed0e9c7f4305, size 1024.00 MB, duration 2.19 sec, destination /opt/stack/data/cinder/conversion/f4e03146-9dc3-44f6-a091-ed0e9c7f4305.temp_image.38ef0972-63cf-40f3-ae34-e2708c2ff86cw9xk_g9c.img {{(pid=82485) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 15:58:14 devstack cinder-volume[82485]: INFO cinder.image.image_utils [None req-72642d59-c550-4a69-8bf8-a036bf5d1e3d tempest-VolumesActionsTest-680032541 None] Converted 1024.00 MB image at 468.27 MB/s
Apr 15 15:58:14 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b930503b-cf3b-4fe5-b3a6-1cd636d19451 tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3a9284e-f538-4ba0-ab4c-d6cabc1edbea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:58:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1081065043',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=131f44f6-ce26-44bf-b685-3baf9ea6a745,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed231ba239684efe9c626e77361b1165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:58:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:58:14Z,use_quota=True,user_id='3b9306ef6f824ad8a0aafabf4de5ee26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:14 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b930503b-cf3b-4fe5-b3a6-1cd636d19451 tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de9462c8-d318-4504-98a3-19dbbd0798b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:14 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b930503b-cf3b-4fe5-b3a6-1cd636d19451 tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de9462c8-d318-4504-98a3-19dbbd0798b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:14 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b930503b-cf3b-4fe5-b3a6-1cd636d19451 tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d373349f-6631-4d8d-a7db-bebc6138d609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:14 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b930503b-cf3b-4fe5-b3a6-1cd636d19451 tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d373349f-6631-4d8d-a7db-bebc6138d609) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '131f44f6-ce26-44bf-b685-3baf9ea6a745', 'volume_name': 'volume-131f44f6-ce26-44bf-b685-3baf9ea6a745', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:14 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b930503b-cf3b-4fe5-b3a6-1cd636d19451 tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ac787e3-5bd4-414a-b217-f78f3894c29f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:14 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b930503b-cf3b-4fe5-b3a6-1cd636d19451 tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ac787e3-5bd4-414a-b217-f78f3894c29f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:14 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b930503b-cf3b-4fe5-b3a6-1cd636d19451 tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10fe790e-874f-4586-b585-ff972790aa5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:14 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-b930503b-cf3b-4fe5-b3a6-1cd636d19451 tempest-VolumesActionsTest-1371964133 None] Volume 131f44f6-ce26-44bf-b685-3baf9ea6a745: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-131f44f6-ce26-44bf-b685-3baf9ea6a745', 'volume_size': 1}
Apr 15 15:58:14 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-b930503b-cf3b-4fe5-b3a6-1cd636d19451 tempest-VolumesActionsTest-1371964133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:58:14 devstack cinder-volume[82485]: DEBUG cinder.image.image_utils [None req-72642d59-c550-4a69-8bf8-a036bf5d1e3d tempest-VolumesActionsTest-680032541 None] 38ef0972-63cf-40f3-ae34-e2708c2ff86c was raw, converting to qcow2 {{(pid=82485) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}}
Apr 15 15:58:14 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8d3dea-5999-49df-b95e-5e027b055579]: (4, 'raw') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:58:14 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-72642d59-c550-4a69-8bf8-a036bf5d1e3d tempest-VolumesActionsTest-680032541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f4e03146-9dc3-44f6-a091-ed0e9c7f4305.temp_image.38ef0972-63cf-40f3-ae34-e2708c2ff86cw9xk_g9c.img {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:14 devstack sudo[88646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f4e03146-9dc3-44f6-a091-ed0e9c7f4305.temp_image.38ef0972-63cf-40f3-ae34-e2708c2ff86cw9xk_g9c.img
Apr 15 15:58:14 devstack sudo[88646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:14 devstack sudo[88646]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:14 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-72642d59-c550-4a69-8bf8-a036bf5d1e3d tempest-VolumesActionsTest-680032541 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f4e03146-9dc3-44f6-a091-ed0e9c7f4305.temp_image.38ef0972-63cf-40f3-ae34-e2708c2ff86cw9xk_g9c.img" returned: 0 in 0.451s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:14 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-72642d59-c550-4a69-8bf8-a036bf5d1e3d tempest-VolumesActionsTest-680032541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f4e03146-9dc3-44f6-a091-ed0e9c7f4305.temp_image.38ef0972-63cf-40f3-ae34-e2708c2ff86cw9xk_g9c.img {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:15 devstack sudo[88650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f4e03146-9dc3-44f6-a091-ed0e9c7f4305.temp_image.38ef0972-63cf-40f3-ae34-e2708c2ff86cw9xk_g9c.img
Apr 15 15:58:15 devstack sudo[88650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:15 devstack sudo[88650]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:15 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-72642d59-c550-4a69-8bf8-a036bf5d1e3d tempest-VolumesActionsTest-680032541 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f4e03146-9dc3-44f6-a091-ed0e9c7f4305.temp_image.38ef0972-63cf-40f3-ae34-e2708c2ff86cw9xk_g9c.img" returned: 1 in 0.490s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:15 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-72642d59-c550-4a69-8bf8-a036bf5d1e3d tempest-VolumesActionsTest-680032541 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f4e03146-9dc3-44f6-a091-ed0e9c7f4305.temp_image.38ef0972-63cf-40f3-ae34-e2708c2ff86cw9xk_g9c.img' failed. Not Retrying. {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 15:58:15 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-72642d59-c550-4a69-8bf8-a036bf5d1e3d tempest-VolumesActionsTest-680032541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f4e03146-9dc3-44f6-a091-ed0e9c7f4305.temp_image.38ef0972-63cf-40f3-ae34-e2708c2ff86cw9xk_g9c.img /opt/stack/data/cinder/conversion/vol_upload_zd9g931r {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:15 devstack sudo[88655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f4e03146-9dc3-44f6-a091-ed0e9c7f4305.temp_image.38ef0972-63cf-40f3-ae34-e2708c2ff86cw9xk_g9c.img /opt/stack/data/cinder/conversion/vol_upload_zd9g931r
Apr 15 15:58:15 devstack sudo[88655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:15 devstack sudo[88655]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:15 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-72642d59-c550-4a69-8bf8-a036bf5d1e3d tempest-VolumesActionsTest-680032541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f4e03146-9dc3-44f6-a091-ed0e9c7f4305.temp_image.38ef0972-63cf-40f3-ae34-e2708c2ff86cw9xk_g9c.img /opt/stack/data/cinder/conversion/vol_upload_zd9g931r" returned: 0 in 0.407s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:15 devstack cinder-volume[82485]: DEBUG cinder.image.image_utils [None req-72642d59-c550-4a69-8bf8-a036bf5d1e3d tempest-VolumesActionsTest-680032541 None] Image conversion details: src /opt/stack/data/cinder/conversion/f4e03146-9dc3-44f6-a091-ed0e9c7f4305.temp_image.38ef0972-63cf-40f3-ae34-e2708c2ff86cw9xk_g9c.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_zd9g931r {{(pid=82485) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 15:58:15 devstack cinder-volume[82485]: INFO cinder.image.image_utils [None req-72642d59-c550-4a69-8bf8-a036bf5d1e3d tempest-VolumesActionsTest-680032541 None] Converted 1024.00 MB image at 1024.00 MB/s
Apr 15 15:58:15 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[767380d8-6498-4640-8053-d4201f52c945]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:58:15 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-72642d59-c550-4a69-8bf8-a036bf5d1e3d tempest-VolumesActionsTest-680032541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_zd9g931r {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:15 devstack sudo[88660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_zd9g931r
Apr 15 15:58:15 devstack sudo[88660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:16 devstack sudo[88660]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:16 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-72642d59-c550-4a69-8bf8-a036bf5d1e3d tempest-VolumesActionsTest-680032541 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_zd9g931r" returned: 0 in 0.442s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:17 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-72642d59-c550-4a69-8bf8-a036bf5d1e3d tempest-VolumesActionsTest-680032541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 6.524s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:58:17 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-72642d59-c550-4a69-8bf8-a036bf5d1e3d tempest-VolumesActionsTest-680032541 None] Uploaded volume to glance image-id: 38ef0972-63cf-40f3-ae34-e2708c2ff86c. {{(pid=82485) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 15 15:58:17 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-3309dfbe-b410-4334-88a7-49218f5b946f tempest-VolumesSnapshotListTestJSON-408696757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.470s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:58:17 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-72642d59-c550-4a69-8bf8-a036bf5d1e3d tempest-VolumesActionsTest-680032541 None] Copy volume to image completed successfully.
Apr 15 15:58:17 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-3309dfbe-b410-4334-88a7-49218f5b946f tempest-VolumesSnapshotListTestJSON-408696757 None] Creating offline snapshot a8f0fe3d-4439-4abb-bc73-6fd949c3b070 of volume 53093f60-603e-4351-9be9-798d0c4b1ed1 {{(pid=82485) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 15:58:17 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[3136a7e8-67c9-4c9f-a0aa-bb374b43c519]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:58:17 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3309dfbe-b410-4334-88a7-49218f5b946f tempest-VolumesSnapshotListTestJSON-408696757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.5ed55c95-0601-4af7-9416-486bbb1f8ea3 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:17 devstack sudo[88665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.5ed55c95-0601-4af7-9416-486bbb1f8ea3
Apr 15 15:58:17 devstack sudo[88665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:17 devstack sudo[88665]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:17 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3309dfbe-b410-4334-88a7-49218f5b946f tempest-VolumesSnapshotListTestJSON-408696757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.5ed55c95-0601-4af7-9416-486bbb1f8ea3" returned: 0 in 0.499s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:17 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-3309dfbe-b410-4334-88a7-49218f5b946f tempest-VolumesSnapshotListTestJSON-408696757 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53093f60-603e-4351-9be9-798d0c4b1ed1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82485) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 15:58:17 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3309dfbe-b410-4334-88a7-49218f5b946f tempest-VolumesSnapshotListTestJSON-408696757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.5ed55c95-0601-4af7-9416-486bbb1f8ea3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.a8f0fe3d-4439-4abb-bc73-6fd949c3b070 1G {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:17 devstack sudo[88670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.5ed55c95-0601-4af7-9416-486bbb1f8ea3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.a8f0fe3d-4439-4abb-bc73-6fd949c3b070 1G
Apr 15 15:58:17 devstack sudo[88670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:18 devstack sudo[88670]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3309dfbe-b410-4334-88a7-49218f5b946f tempest-VolumesSnapshotListTestJSON-408696757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.5ed55c95-0601-4af7-9416-486bbb1f8ea3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.a8f0fe3d-4439-4abb-bc73-6fd949c3b070 1G" returned: 0 in 0.578s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3309dfbe-b410-4334-88a7-49218f5b946f tempest-VolumesSnapshotListTestJSON-408696757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53093f60-603e-4351-9be9-798d0c4b1ed1.5ed55c95-0601-4af7-9416-486bbb1f8ea3 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.a8f0fe3d-4439-4abb-bc73-6fd949c3b070 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:18 devstack sudo[88675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53093f60-603e-4351-9be9-798d0c4b1ed1.5ed55c95-0601-4af7-9416-486bbb1f8ea3 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.a8f0fe3d-4439-4abb-bc73-6fd949c3b070
Apr 15 15:58:18 devstack sudo[88675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:18 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-ea2cd096-6ca8-4e28-b876-2527a81536b7 tempest-VolumesActionsTest-680032541 None] Acquiring lock "cinder-f4e03146-9dc3-44f6-a091-ed0e9c7f4305-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:58:18 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-ea2cd096-6ca8-4e28-b876-2527a81536b7 tempest-VolumesActionsTest-680032541 None] Lock "cinder-f4e03146-9dc3-44f6-a091-ed0e9c7f4305-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:58:18 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-ea2cd096-6ca8-4e28-b876-2527a81536b7 tempest-VolumesActionsTest-680032541 None] Acquiring lock "cinder-quobyte-f4e03146-9dc3-44f6-a091-ed0e9c7f4305" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:58:18 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-ea2cd096-6ca8-4e28-b876-2527a81536b7 tempest-VolumesActionsTest-680032541 None] Lock "cinder-quobyte-f4e03146-9dc3-44f6-a091-ed0e9c7f4305" acquired by "delete_volume" :: waited 0.009s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:58:18 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bff05c6-ee75-4475-b386-2e3adc56ea38]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:58:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ea2cd096-6ca8-4e28-b876-2527a81536b7 tempest-VolumesActionsTest-680032541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f4e03146-9dc3-44f6-a091-ed0e9c7f4305 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:18 devstack sudo[88680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f4e03146-9dc3-44f6-a091-ed0e9c7f4305
Apr 15 15:58:18 devstack sudo[88680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:18 devstack sudo[88675]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3309dfbe-b410-4334-88a7-49218f5b946f tempest-VolumesSnapshotListTestJSON-408696757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53093f60-603e-4351-9be9-798d0c4b1ed1.5ed55c95-0601-4af7-9416-486bbb1f8ea3 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.a8f0fe3d-4439-4abb-bc73-6fd949c3b070" returned: 0 in 0.504s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:18 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-3309dfbe-b410-4334-88a7-49218f5b946f tempest-VolumesSnapshotListTestJSON-408696757 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.a8f0fe3d-4439-4abb-bc73-6fd949c3b070 is being set with open permissions: ugo+rw
Apr 15 15:58:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3309dfbe-b410-4334-88a7-49218f5b946f tempest-VolumesSnapshotListTestJSON-408696757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.a8f0fe3d-4439-4abb-bc73-6fd949c3b070 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:18 devstack sudo[88682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.a8f0fe3d-4439-4abb-bc73-6fd949c3b070
Apr 15 15:58:18 devstack sudo[88682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:19 devstack sudo[88680]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ea2cd096-6ca8-4e28-b876-2527a81536b7 tempest-VolumesActionsTest-680032541 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f4e03146-9dc3-44f6-a091-ed0e9c7f4305" returned: 0 in 0.459s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ea2cd096-6ca8-4e28-b876-2527a81536b7 tempest-VolumesActionsTest-680032541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f4e03146-9dc3-44f6-a091-ed0e9c7f4305 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:19 devstack sudo[88688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f4e03146-9dc3-44f6-a091-ed0e9c7f4305
Apr 15 15:58:19 devstack sudo[88688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:19 devstack sudo[88682]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3309dfbe-b410-4334-88a7-49218f5b946f tempest-VolumesSnapshotListTestJSON-408696757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.a8f0fe3d-4439-4abb-bc73-6fd949c3b070" returned: 0 in 0.454s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-3309dfbe-b410-4334-88a7-49218f5b946f tempest-VolumesSnapshotListTestJSON-408696757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.093s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:58:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-b930503b-cf3b-4fe5-b3a6-1cd636d19451 tempest-VolumesActionsTest-1371964133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.734s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:58:19 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-b930503b-cf3b-4fe5-b3a6-1cd636d19451 tempest-VolumesActionsTest-1371964133 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:58:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1081065043',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=131f44f6-ce26-44bf-b685-3baf9ea6a745,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed231ba239684efe9c626e77361b1165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:58:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:58:14Z,use_quota=True,user_id='3b9306ef6f824ad8a0aafabf4de5ee26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:58:19 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-b930503b-cf3b-4fe5-b3a6-1cd636d19451 tempest-VolumesActionsTest-1371964133 None] Creating volume 131f44f6-ce26-44bf-b685-3baf9ea6a745 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:58:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-b930503b-cf3b-4fe5-b3a6-1cd636d19451 tempest-VolumesActionsTest-1371964133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:58:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-b930503b-cf3b-4fe5-b3a6-1cd636d19451 tempest-VolumesActionsTest-1371964133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:58:19 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-b930503b-cf3b-4fe5-b3a6-1cd636d19451 tempest-VolumesActionsTest-1371964133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:58:19 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-b930503b-cf3b-4fe5-b3a6-1cd636d19451 tempest-VolumesActionsTest-1371964133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:58:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-b930503b-cf3b-4fe5-b3a6-1cd636d19451 tempest-VolumesActionsTest-1371964133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:58:19 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-b930503b-cf3b-4fe5-b3a6-1cd636d19451 tempest-VolumesActionsTest-1371964133 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:58:19 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-b930503b-cf3b-4fe5-b3a6-1cd636d19451 tempest-VolumesActionsTest-1371964133 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:58:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b930503b-cf3b-4fe5-b3a6-1cd636d19451 tempest-VolumesActionsTest-1371964133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-131f44f6-ce26-44bf-b685-3baf9ea6a745 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:19 devstack sudo[88690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-131f44f6-ce26-44bf-b685-3baf9ea6a745 1073741824
Apr 15 15:58:19 devstack sudo[88690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:19 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-3309dfbe-b410-4334-88a7-49218f5b946f tempest-VolumesSnapshotListTestJSON-408696757 None] Create snapshot completed successfully
Apr 15 15:58:19 devstack sudo[88688]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ea2cd096-6ca8-4e28-b876-2527a81536b7 tempest-VolumesActionsTest-680032541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f4e03146-9dc3-44f6-a091-ed0e9c7f4305" returned: 0 in 0.402s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:19 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-ea2cd096-6ca8-4e28-b876-2527a81536b7 tempest-VolumesActionsTest-680032541 None] Lock "cinder-quobyte-f4e03146-9dc3-44f6-a091-ed0e9c7f4305" released by "delete_volume" :: held 0.883s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:58:19 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-ea2cd096-6ca8-4e28-b876-2527a81536b7 tempest-VolumesActionsTest-680032541 None] Created reservations ['d1d48d50-868d-4386-a5e7-0d5fcf1d620c', '7c731848-f537-4f4c-89d1-2669eaf5f035', 'a221b596-af2b-4eae-93e1-f207ae06f8ae', '0c3051e0-eb1f-444a-990f-345dcf2a4c09'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:58:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-ea2cd096-6ca8-4e28-b876-2527a81536b7 tempest-VolumesActionsTest-680032541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:58:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-ea2cd096-6ca8-4e28-b876-2527a81536b7 tempest-VolumesActionsTest-680032541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:58:19 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-ea2cd096-6ca8-4e28-b876-2527a81536b7 tempest-VolumesActionsTest-680032541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:58:19 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-ea2cd096-6ca8-4e28-b876-2527a81536b7 tempest-VolumesActionsTest-680032541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:58:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-ea2cd096-6ca8-4e28-b876-2527a81536b7 tempest-VolumesActionsTest-680032541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:58:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ea2cd096-6ca8-4e28-b876-2527a81536b7 tempest-VolumesActionsTest-680032541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:19 devstack sudo[88693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:58:19 devstack sudo[88693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:19 devstack sudo[88690]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b930503b-cf3b-4fe5-b3a6-1cd636d19451 tempest-VolumesActionsTest-1371964133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-131f44f6-ce26-44bf-b685-3baf9ea6a745 1073741824" returned: 0 in 0.585s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b930503b-cf3b-4fe5-b3a6-1cd636d19451 tempest-VolumesActionsTest-1371964133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-131f44f6-ce26-44bf-b685-3baf9ea6a745 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:19 devstack sudo[88698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-131f44f6-ce26-44bf-b685-3baf9ea6a745
Apr 15 15:58:19 devstack sudo[88698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:20 devstack sudo[88693]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:20 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ea2cd096-6ca8-4e28-b876-2527a81536b7 tempest-VolumesActionsTest-680032541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.500s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:20 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-ea2cd096-6ca8-4e28-b876-2527a81536b7 tempest-VolumesActionsTest-680032541 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:58:20 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-ea2cd096-6ca8-4e28-b876-2527a81536b7 tempest-VolumesActionsTest-680032541 None] Deleted volume successfully.
Apr 15 15:58:20 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-ea2cd096-6ca8-4e28-b876-2527a81536b7 tempest-VolumesActionsTest-680032541 None] Lock "cinder-f4e03146-9dc3-44f6-a091-ed0e9c7f4305-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:58:20 devstack sudo[88698]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:20 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b930503b-cf3b-4fe5-b3a6-1cd636d19451 tempest-VolumesActionsTest-1371964133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-131f44f6-ce26-44bf-b685-3baf9ea6a745" returned: 0 in 0.608s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:20 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-b930503b-cf3b-4fe5-b3a6-1cd636d19451 tempest-VolumesActionsTest-1371964133 None] <== create_volume: return (1225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:58:20 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-b930503b-cf3b-4fe5-b3a6-1cd636d19451 tempest-VolumesActionsTest-1371964133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:58:20 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b930503b-cf3b-4fe5-b3a6-1cd636d19451 tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10fe790e-874f-4586-b585-ff972790aa5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-131f44f6-ce26-44bf-b685-3baf9ea6a745', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:20 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b930503b-cf3b-4fe5-b3a6-1cd636d19451 tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1b6c6d7-3b28-4bc9-a2d7-421aa67214ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:20 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-b930503b-cf3b-4fe5-b3a6-1cd636d19451 tempest-VolumesActionsTest-1371964133 None] Volume volume-131f44f6-ce26-44bf-b685-3baf9ea6a745 (131f44f6-ce26-44bf-b685-3baf9ea6a745): created successfully
Apr 15 15:58:20 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b930503b-cf3b-4fe5-b3a6-1cd636d19451 tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1b6c6d7-3b28-4bc9-a2d7-421aa67214ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:20 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b930503b-cf3b-4fe5-b3a6-1cd636d19451 tempest-VolumesActionsTest-1371964133 None] Flow 'volume_create_manager' (1e53ecdc-e6ea-452d-9523-9d5b1582a57f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:58:20 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-b930503b-cf3b-4fe5-b3a6-1cd636d19451 tempest-VolumesActionsTest-1371964133 None] Created volume successfully.
Apr 15 15:58:20 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-2613ba26-30b9-4cd4-acee-2ba8f0c30132 tempest-VolumesSnapshotListTestJSON-408696757 None] Acquiring lock "cinder-a8f0fe3d-4439-4abb-bc73-6fd949c3b070-delete_snapshot" by "delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:58:20 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-2613ba26-30b9-4cd4-acee-2ba8f0c30132 tempest-VolumesSnapshotListTestJSON-408696757 None] Lock "cinder-a8f0fe3d-4439-4abb-bc73-6fd949c3b070-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:58:20 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-2613ba26-30b9-4cd4-acee-2ba8f0c30132 tempest-VolumesSnapshotListTestJSON-408696757 None] Acquiring lock "cinder-quobyte-53093f60-603e-4351-9be9-798d0c4b1ed1" by "delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:58:20 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-2613ba26-30b9-4cd4-acee-2ba8f0c30132 tempest-VolumesSnapshotListTestJSON-408696757 None] Lock "cinder-quobyte-53093f60-603e-4351-9be9-798d0c4b1ed1" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:58:20 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-2613ba26-30b9-4cd4-acee-2ba8f0c30132 tempest-VolumesSnapshotListTestJSON-408696757 None] Acquiring lock "cinder-quobyte-a8f0fe3d-4439-4abb-bc73-6fd949c3b070" by "_delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:58:20 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-2613ba26-30b9-4cd4-acee-2ba8f0c30132 tempest-VolumesSnapshotListTestJSON-408696757 None] Lock "cinder-quobyte-a8f0fe3d-4439-4abb-bc73-6fd949c3b070" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:58:20 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-2613ba26-30b9-4cd4-acee-2ba8f0c30132 tempest-VolumesSnapshotListTestJSON-408696757 None] Deleting offline snapshot a8f0fe3d-4439-4abb-bc73-6fd949c3b070 of volume 53093f60-603e-4351-9be9-798d0c4b1ed1 {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 15:58:20 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-2613ba26-30b9-4cd4-acee-2ba8f0c30132 tempest-VolumesSnapshotListTestJSON-408696757 None] snapshot_file for this snap is: volume-53093f60-603e-4351-9be9-798d0c4b1ed1.a8f0fe3d-4439-4abb-bc73-6fd949c3b070 {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 15:58:20 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[32eae5c0-106d-4fa2-ae11-3f318aca6b31]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:58:20 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-2613ba26-30b9-4cd4-acee-2ba8f0c30132 tempest-VolumesSnapshotListTestJSON-408696757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.a8f0fe3d-4439-4abb-bc73-6fd949c3b070 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:20 devstack sudo[88702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.a8f0fe3d-4439-4abb-bc73-6fd949c3b070
Apr 15 15:58:20 devstack sudo[88702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:20 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-7d47b4d0-3587-4bd0-8289-0ab90164edf3 tempest-VolumesActionsTest-902023646 None] Acquiring lock "cinder-131f44f6-ce26-44bf-b685-3baf9ea6a745-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:58:20 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-7d47b4d0-3587-4bd0-8289-0ab90164edf3 tempest-VolumesActionsTest-902023646 None] Lock "cinder-131f44f6-ce26-44bf-b685-3baf9ea6a745-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:58:20 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-7d47b4d0-3587-4bd0-8289-0ab90164edf3 tempest-VolumesActionsTest-902023646 None] Acquiring lock "cinder-quobyte-131f44f6-ce26-44bf-b685-3baf9ea6a745" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:58:20 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-7d47b4d0-3587-4bd0-8289-0ab90164edf3 tempest-VolumesActionsTest-902023646 None] Lock "cinder-quobyte-131f44f6-ce26-44bf-b685-3baf9ea6a745" acquired by "delete_volume" :: waited 0.007s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:58:20 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[04723d3e-c555-453e-911a-213771ea3370]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:58:20 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7d47b4d0-3587-4bd0-8289-0ab90164edf3 tempest-VolumesActionsTest-902023646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-131f44f6-ce26-44bf-b685-3baf9ea6a745 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:20 devstack sudo[88705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-131f44f6-ce26-44bf-b685-3baf9ea6a745
Apr 15 15:58:20 devstack sudo[88705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:21 devstack sudo[88702]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-2613ba26-30b9-4cd4-acee-2ba8f0c30132 tempest-VolumesSnapshotListTestJSON-408696757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.a8f0fe3d-4439-4abb-bc73-6fd949c3b070" returned: 0 in 0.598s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:21 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-2613ba26-30b9-4cd4-acee-2ba8f0c30132 tempest-VolumesSnapshotListTestJSON-408696757 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53093f60-603e-4351-9be9-798d0c4b1ed1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82485) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 15:58:21 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d39134-dd4d-4edd-ab71-bd12a2eaef86]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:58:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-2613ba26-30b9-4cd4-acee-2ba8f0c30132 tempest-VolumesSnapshotListTestJSON-408696757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.5ed55c95-0601-4af7-9416-486bbb1f8ea3 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:21 devstack sudo[88710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.5ed55c95-0601-4af7-9416-486bbb1f8ea3
Apr 15 15:58:21 devstack sudo[88710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:21 devstack sudo[88705]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7d47b4d0-3587-4bd0-8289-0ab90164edf3 tempest-VolumesActionsTest-902023646 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-131f44f6-ce26-44bf-b685-3baf9ea6a745" returned: 0 in 0.529s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7d47b4d0-3587-4bd0-8289-0ab90164edf3 tempest-VolumesActionsTest-902023646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-131f44f6-ce26-44bf-b685-3baf9ea6a745 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:21 devstack sudo[88715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-131f44f6-ce26-44bf-b685-3baf9ea6a745
Apr 15 15:58:21 devstack sudo[88715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:21 devstack sudo[88710]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-2613ba26-30b9-4cd4-acee-2ba8f0c30132 tempest-VolumesSnapshotListTestJSON-408696757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.5ed55c95-0601-4af7-9416-486bbb1f8ea3" returned: 0 in 0.557s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:21 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-2613ba26-30b9-4cd4-acee-2ba8f0c30132 tempest-VolumesSnapshotListTestJSON-408696757 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53093f60-603e-4351-9be9-798d0c4b1ed1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82485) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 15:58:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-2613ba26-30b9-4cd4-acee-2ba8f0c30132 tempest-VolumesSnapshotListTestJSON-408696757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.a8f0fe3d-4439-4abb-bc73-6fd949c3b070 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:21 devstack sudo[88721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.a8f0fe3d-4439-4abb-bc73-6fd949c3b070
Apr 15 15:58:21 devstack sudo[88721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:21 devstack sudo[88715]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7d47b4d0-3587-4bd0-8289-0ab90164edf3 tempest-VolumesActionsTest-902023646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-131f44f6-ce26-44bf-b685-3baf9ea6a745" returned: 0 in 0.509s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:21 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-7d47b4d0-3587-4bd0-8289-0ab90164edf3 tempest-VolumesActionsTest-902023646 None] Lock "cinder-quobyte-131f44f6-ce26-44bf-b685-3baf9ea6a745" released by "delete_volume" :: held 1.059s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:58:21 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-7d47b4d0-3587-4bd0-8289-0ab90164edf3 tempest-VolumesActionsTest-902023646 None] Created reservations ['13d92662-e42e-496b-8633-4115b7dc66de', '67d40ab0-2f32-4317-89c0-4bf2f48ab537', '4c6ba4dc-f724-4ba7-853b-bebb4b7f6e26', 'ead415e7-304a-427c-be6a-28ce5da66fb1'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:58:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7d47b4d0-3587-4bd0-8289-0ab90164edf3 tempest-VolumesActionsTest-902023646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:58:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7d47b4d0-3587-4bd0-8289-0ab90164edf3 tempest-VolumesActionsTest-902023646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:58:21 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-7d47b4d0-3587-4bd0-8289-0ab90164edf3 tempest-VolumesActionsTest-902023646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:58:21 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-7d47b4d0-3587-4bd0-8289-0ab90164edf3 tempest-VolumesActionsTest-902023646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:58:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7d47b4d0-3587-4bd0-8289-0ab90164edf3 tempest-VolumesActionsTest-902023646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:58:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7d47b4d0-3587-4bd0-8289-0ab90164edf3 tempest-VolumesActionsTest-902023646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:22 devstack sudo[88724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:58:22 devstack sudo[88724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:22 devstack sudo[88721]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:22 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-2613ba26-30b9-4cd4-acee-2ba8f0c30132 tempest-VolumesSnapshotListTestJSON-408696757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.a8f0fe3d-4439-4abb-bc73-6fd949c3b070" returned: 0 in 0.594s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:22 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-2613ba26-30b9-4cd4-acee-2ba8f0c30132 tempest-VolumesSnapshotListTestJSON-408696757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.a8f0fe3d-4439-4abb-bc73-6fd949c3b070 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:22 devstack sudo[88729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.a8f0fe3d-4439-4abb-bc73-6fd949c3b070
Apr 15 15:58:22 devstack sudo[88729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:22 devstack sudo[88724]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:22 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7d47b4d0-3587-4bd0-8289-0ab90164edf3 tempest-VolumesActionsTest-902023646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.555s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:22 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-7d47b4d0-3587-4bd0-8289-0ab90164edf3 tempest-VolumesActionsTest-902023646 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:58:22 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-7d47b4d0-3587-4bd0-8289-0ab90164edf3 tempest-VolumesActionsTest-902023646 None] Deleted volume successfully.
Apr 15 15:58:22 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-7d47b4d0-3587-4bd0-8289-0ab90164edf3 tempest-VolumesActionsTest-902023646 None] Lock "cinder-131f44f6-ce26-44bf-b685-3baf9ea6a745-delete_volume" released by "delete_volume" :: held 1.749s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:58:22 devstack sudo[88729]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:22 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-2613ba26-30b9-4cd4-acee-2ba8f0c30132 tempest-VolumesSnapshotListTestJSON-408696757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.a8f0fe3d-4439-4abb-bc73-6fd949c3b070" returned: 0 in 0.445s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:22 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-2613ba26-30b9-4cd4-acee-2ba8f0c30132 tempest-VolumesSnapshotListTestJSON-408696757 None] Lock "cinder-quobyte-a8f0fe3d-4439-4abb-bc73-6fd949c3b070" released by "_delete_snapshot" :: held 2.248s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:58:22 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-2613ba26-30b9-4cd4-acee-2ba8f0c30132 tempest-VolumesSnapshotListTestJSON-408696757 None] Lock "cinder-quobyte-53093f60-603e-4351-9be9-798d0c4b1ed1" released by "delete_snapshot" :: held 2.261s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:58:22 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-2613ba26-30b9-4cd4-acee-2ba8f0c30132 tempest-VolumesSnapshotListTestJSON-408696757 None] Created reservations ['2667a58a-f8c1-49cb-af11-876bafdfa00a', 'fd9510f6-69b2-4dcc-80c2-62d101bbc6aa', '5ac41492-c6a0-4cd7-bd52-91b1bd3efe7d', 'e6bbc30c-8904-49b6-9ced-450051df267c'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:58:22 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-2613ba26-30b9-4cd4-acee-2ba8f0c30132 tempest-VolumesSnapshotListTestJSON-408696757 None] Delete snapshot completed successfully.
Apr 15 15:58:22 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-2613ba26-30b9-4cd4-acee-2ba8f0c30132 tempest-VolumesSnapshotListTestJSON-408696757 None] Lock "cinder-a8f0fe3d-4439-4abb-bc73-6fd949c3b070-delete_snapshot" released by "delete_snapshot" :: held 2.356s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:58:23 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-fae2850d-62ef-4cc3-a4cb-98820604fd1c tempest-VolumesActionsTest-1371964133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:58:23 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-fae2850d-62ef-4cc3-a4cb-98820604fd1c tempest-VolumesActionsTest-1371964133 None] Flow 'volume_create_manager' (ce07482a-d9fc-489a-844b-35c3f2ffd7b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:58:23 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-fae2850d-62ef-4cc3-a4cb-98820604fd1c tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a48843ce-07b5-4222-b484-4649cd25913f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:23 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-fae2850d-62ef-4cc3-a4cb-98820604fd1c tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a48843ce-07b5-4222-b484-4649cd25913f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:58:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-613507474',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94de7e72-0f5f-46fa-af05-a88e5ca5e4be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed231ba239684efe9c626e77361b1165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:58:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:58:23Z,use_quota=True,user_id='3b9306ef6f824ad8a0aafabf4de5ee26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:23 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-fae2850d-62ef-4cc3-a4cb-98820604fd1c tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcf386d4-5f9a-4689-9488-974a4caa2652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:23 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-fae2850d-62ef-4cc3-a4cb-98820604fd1c tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcf386d4-5f9a-4689-9488-974a4caa2652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:23 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-fae2850d-62ef-4cc3-a4cb-98820604fd1c tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (180bf643-978e-433d-a101-98b785c8a124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:23 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-fae2850d-62ef-4cc3-a4cb-98820604fd1c tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (180bf643-978e-433d-a101-98b785c8a124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94de7e72-0f5f-46fa-af05-a88e5ca5e4be', 'volume_name': 'volume-94de7e72-0f5f-46fa-af05-a88e5ca5e4be', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:23 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-fae2850d-62ef-4cc3-a4cb-98820604fd1c tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a787ef58-a4bb-439c-a910-658e003e5ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:23 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-fae2850d-62ef-4cc3-a4cb-98820604fd1c tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a787ef58-a4bb-439c-a910-658e003e5ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:23 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-fae2850d-62ef-4cc3-a4cb-98820604fd1c tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f08fe61-482f-4b5d-bc47-d1aff012bb51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:23 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-fae2850d-62ef-4cc3-a4cb-98820604fd1c tempest-VolumesActionsTest-1371964133 None] Volume 94de7e72-0f5f-46fa-af05-a88e5ca5e4be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94de7e72-0f5f-46fa-af05-a88e5ca5e4be', 'volume_size': 1}
Apr 15 15:58:23 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-fae2850d-62ef-4cc3-a4cb-98820604fd1c tempest-VolumesActionsTest-1371964133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:58:23 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-fae2850d-62ef-4cc3-a4cb-98820604fd1c tempest-VolumesActionsTest-1371964133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:58:23 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-fae2850d-62ef-4cc3-a4cb-98820604fd1c tempest-VolumesActionsTest-1371964133 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:58:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-613507474',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94de7e72-0f5f-46fa-af05-a88e5ca5e4be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed231ba239684efe9c626e77361b1165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:58:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:58:23Z,use_quota=True,user_id='3b9306ef6f824ad8a0aafabf4de5ee26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:58:23 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-fae2850d-62ef-4cc3-a4cb-98820604fd1c tempest-VolumesActionsTest-1371964133 None] Creating volume 94de7e72-0f5f-46fa-af05-a88e5ca5e4be {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:58:23 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-fae2850d-62ef-4cc3-a4cb-98820604fd1c tempest-VolumesActionsTest-1371964133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:58:23 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-fae2850d-62ef-4cc3-a4cb-98820604fd1c tempest-VolumesActionsTest-1371964133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:58:23 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-fae2850d-62ef-4cc3-a4cb-98820604fd1c tempest-VolumesActionsTest-1371964133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:58:23 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-fae2850d-62ef-4cc3-a4cb-98820604fd1c tempest-VolumesActionsTest-1371964133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:58:23 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-fae2850d-62ef-4cc3-a4cb-98820604fd1c tempest-VolumesActionsTest-1371964133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:58:23 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-fae2850d-62ef-4cc3-a4cb-98820604fd1c tempest-VolumesActionsTest-1371964133 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:58:23 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-fae2850d-62ef-4cc3-a4cb-98820604fd1c tempest-VolumesActionsTest-1371964133 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:58:23 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-fae2850d-62ef-4cc3-a4cb-98820604fd1c tempest-VolumesActionsTest-1371964133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-94de7e72-0f5f-46fa-af05-a88e5ca5e4be 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:23 devstack sudo[88734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-94de7e72-0f5f-46fa-af05-a88e5ca5e4be 1073741824
Apr 15 15:58:23 devstack sudo[88734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:23 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-e2c3fc7f-59cb-426f-9680-7be8066f0de6 tempest-VolumesSnapshotListTestJSON-408696757 None] Acquiring lock "cinder-5ed55c95-0601-4af7-9416-486bbb1f8ea3-delete_snapshot" by "delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:58:23 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-e2c3fc7f-59cb-426f-9680-7be8066f0de6 tempest-VolumesSnapshotListTestJSON-408696757 None] Lock "cinder-5ed55c95-0601-4af7-9416-486bbb1f8ea3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:58:23 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-e2c3fc7f-59cb-426f-9680-7be8066f0de6 tempest-VolumesSnapshotListTestJSON-408696757 None] Acquiring lock "cinder-quobyte-53093f60-603e-4351-9be9-798d0c4b1ed1" by "delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:58:23 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-e2c3fc7f-59cb-426f-9680-7be8066f0de6 tempest-VolumesSnapshotListTestJSON-408696757 None] Lock "cinder-quobyte-53093f60-603e-4351-9be9-798d0c4b1ed1" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:58:23 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-e2c3fc7f-59cb-426f-9680-7be8066f0de6 tempest-VolumesSnapshotListTestJSON-408696757 None] Acquiring lock "cinder-quobyte-5ed55c95-0601-4af7-9416-486bbb1f8ea3" by "_delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:58:23 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-e2c3fc7f-59cb-426f-9680-7be8066f0de6 tempest-VolumesSnapshotListTestJSON-408696757 None] Lock "cinder-quobyte-5ed55c95-0601-4af7-9416-486bbb1f8ea3" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:58:23 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-e2c3fc7f-59cb-426f-9680-7be8066f0de6 tempest-VolumesSnapshotListTestJSON-408696757 None] Deleting offline snapshot 5ed55c95-0601-4af7-9416-486bbb1f8ea3 of volume 53093f60-603e-4351-9be9-798d0c4b1ed1 {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 15:58:23 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-e2c3fc7f-59cb-426f-9680-7be8066f0de6 tempest-VolumesSnapshotListTestJSON-408696757 None] snapshot_file for this snap is: volume-53093f60-603e-4351-9be9-798d0c4b1ed1.5ed55c95-0601-4af7-9416-486bbb1f8ea3 {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 15:58:23 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[257c62de-7207-4a30-bd51-65978bb62476]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:58:23 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-e2c3fc7f-59cb-426f-9680-7be8066f0de6 tempest-VolumesSnapshotListTestJSON-408696757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.5ed55c95-0601-4af7-9416-486bbb1f8ea3 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:23 devstack sudo[88736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.5ed55c95-0601-4af7-9416-486bbb1f8ea3
Apr 15 15:58:23 devstack sudo[88736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:23 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec5dd5d2-5069-4893-9d84-5e11ee192517 tempest-VolumesCloneNegativeTest-1503427787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:58:23 devstack sudo[88734]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:23 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-ec5dd5d2-5069-4893-9d84-5e11ee192517 tempest-VolumesCloneNegativeTest-1503427787 None] Flow 'volume_create_manager' (4adc31c8-d3dd-400a-9624-200a4c878348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:58:23 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-ec5dd5d2-5069-4893-9d84-5e11ee192517 tempest-VolumesCloneNegativeTest-1503427787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5710db8-3e22-409b-b26f-b4bf11d13c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:23 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-fae2850d-62ef-4cc3-a4cb-98820604fd1c tempest-VolumesActionsTest-1371964133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-94de7e72-0f5f-46fa-af05-a88e5ca5e4be 1073741824" returned: 0 in 0.622s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:23 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-ec5dd5d2-5069-4893-9d84-5e11ee192517 tempest-VolumesCloneNegativeTest-1503427787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5710db8-3e22-409b-b26f-b4bf11d13c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:58:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-555555728',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e96f72a8-4335-4953-9b6a-b879e610a4ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d50d2e543694d4f87ff72c2414881ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:58:24Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:58:24Z,use_quota=True,user_id='eaf5bf870549429593d0d9a860dba98e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:23 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-ec5dd5d2-5069-4893-9d84-5e11ee192517 tempest-VolumesCloneNegativeTest-1503427787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef1d5e42-89f1-44b8-ad01-59eff01f1736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:23 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-ec5dd5d2-5069-4893-9d84-5e11ee192517 tempest-VolumesCloneNegativeTest-1503427787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef1d5e42-89f1-44b8-ad01-59eff01f1736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:23 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-ec5dd5d2-5069-4893-9d84-5e11ee192517 tempest-VolumesCloneNegativeTest-1503427787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (545173a2-dd38-46b5-9bd3-9ccea02b37f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:23 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-ec5dd5d2-5069-4893-9d84-5e11ee192517 tempest-VolumesCloneNegativeTest-1503427787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (545173a2-dd38-46b5-9bd3-9ccea02b37f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e96f72a8-4335-4953-9b6a-b879e610a4ff', 'volume_name': 'volume-e96f72a8-4335-4953-9b6a-b879e610a4ff', 'volume_size': 2}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:23 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-ec5dd5d2-5069-4893-9d84-5e11ee192517 tempest-VolumesCloneNegativeTest-1503427787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b2d80b4-1b0e-4612-965e-cc4472f5b69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:23 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-ec5dd5d2-5069-4893-9d84-5e11ee192517 tempest-VolumesCloneNegativeTest-1503427787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b2d80b4-1b0e-4612-965e-cc4472f5b69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:23 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-ec5dd5d2-5069-4893-9d84-5e11ee192517 tempest-VolumesCloneNegativeTest-1503427787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a595234f-543b-41b1-b6f5-ab542f331b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:23 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-ec5dd5d2-5069-4893-9d84-5e11ee192517 tempest-VolumesCloneNegativeTest-1503427787 None] Volume e96f72a8-4335-4953-9b6a-b879e610a4ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e96f72a8-4335-4953-9b6a-b879e610a4ff', 'volume_size': 2}
Apr 15 15:58:23 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-ec5dd5d2-5069-4893-9d84-5e11ee192517 tempest-VolumesCloneNegativeTest-1503427787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:58:23 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-fae2850d-62ef-4cc3-a4cb-98820604fd1c tempest-VolumesActionsTest-1371964133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-94de7e72-0f5f-46fa-af05-a88e5ca5e4be {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:23 devstack sudo[88741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-94de7e72-0f5f-46fa-af05-a88e5ca5e4be
Apr 15 15:58:23 devstack sudo[88741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:24 devstack sudo[88736]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:24 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-e2c3fc7f-59cb-426f-9680-7be8066f0de6 tempest-VolumesSnapshotListTestJSON-408696757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.5ed55c95-0601-4af7-9416-486bbb1f8ea3" returned: 0 in 0.583s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:24 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-e2c3fc7f-59cb-426f-9680-7be8066f0de6 tempest-VolumesSnapshotListTestJSON-408696757 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53093f60-603e-4351-9be9-798d0c4b1ed1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82485) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 15:58:24 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[26390550-5b45-49c8-944a-224c5fe8cc50]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:58:24 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-e2c3fc7f-59cb-426f-9680-7be8066f0de6 tempest-VolumesSnapshotListTestJSON-408696757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.396c3f29-5375-47d3-9be8-f9a799f17f9d {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:24 devstack sudo[88746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.396c3f29-5375-47d3-9be8-f9a799f17f9d
Apr 15 15:58:24 devstack sudo[88746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:24 devstack sudo[88741]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:24 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-fae2850d-62ef-4cc3-a4cb-98820604fd1c tempest-VolumesActionsTest-1371964133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-94de7e72-0f5f-46fa-af05-a88e5ca5e4be" returned: 0 in 0.415s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:24 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-fae2850d-62ef-4cc3-a4cb-98820604fd1c tempest-VolumesActionsTest-1371964133 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:58:24 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-fae2850d-62ef-4cc3-a4cb-98820604fd1c tempest-VolumesActionsTest-1371964133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:58:24 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-ec5dd5d2-5069-4893-9d84-5e11ee192517 tempest-VolumesCloneNegativeTest-1503427787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.422s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:58:24 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-ec5dd5d2-5069-4893-9d84-5e11ee192517 tempest-VolumesCloneNegativeTest-1503427787 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:58:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-555555728',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e96f72a8-4335-4953-9b6a-b879e610a4ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d50d2e543694d4f87ff72c2414881ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:58:24Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:58:24Z,use_quota=True,user_id='eaf5bf870549429593d0d9a860dba98e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:58:24 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-ec5dd5d2-5069-4893-9d84-5e11ee192517 tempest-VolumesCloneNegativeTest-1503427787 None] Creating volume e96f72a8-4335-4953-9b6a-b879e610a4ff {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:58:24 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-ec5dd5d2-5069-4893-9d84-5e11ee192517 tempest-VolumesCloneNegativeTest-1503427787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:58:24 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-ec5dd5d2-5069-4893-9d84-5e11ee192517 tempest-VolumesCloneNegativeTest-1503427787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:58:24 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-ec5dd5d2-5069-4893-9d84-5e11ee192517 tempest-VolumesCloneNegativeTest-1503427787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:58:24 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-ec5dd5d2-5069-4893-9d84-5e11ee192517 tempest-VolumesCloneNegativeTest-1503427787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:58:24 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-ec5dd5d2-5069-4893-9d84-5e11ee192517 tempest-VolumesCloneNegativeTest-1503427787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:58:24 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-ec5dd5d2-5069-4893-9d84-5e11ee192517 tempest-VolumesCloneNegativeTest-1503427787 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:58:24 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-ec5dd5d2-5069-4893-9d84-5e11ee192517 tempest-VolumesCloneNegativeTest-1503427787 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:58:24 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ec5dd5d2-5069-4893-9d84-5e11ee192517 tempest-VolumesCloneNegativeTest-1503427787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e96f72a8-4335-4953-9b6a-b879e610a4ff 2147483648 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:24 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-fae2850d-62ef-4cc3-a4cb-98820604fd1c tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f08fe61-482f-4b5d-bc47-d1aff012bb51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94de7e72-0f5f-46fa-af05-a88e5ca5e4be', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:24 devstack sudo[88749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e96f72a8-4335-4953-9b6a-b879e610a4ff 2147483648
Apr 15 15:58:24 devstack sudo[88749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:24 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-fae2850d-62ef-4cc3-a4cb-98820604fd1c tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36845e9d-da8a-489a-a5ed-5c23cda136a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:24 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-fae2850d-62ef-4cc3-a4cb-98820604fd1c tempest-VolumesActionsTest-1371964133 None] Volume volume-94de7e72-0f5f-46fa-af05-a88e5ca5e4be (94de7e72-0f5f-46fa-af05-a88e5ca5e4be): created successfully
Apr 15 15:58:24 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-fae2850d-62ef-4cc3-a4cb-98820604fd1c tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36845e9d-da8a-489a-a5ed-5c23cda136a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:24 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-fae2850d-62ef-4cc3-a4cb-98820604fd1c tempest-VolumesActionsTest-1371964133 None] Flow 'volume_create_manager' (ce07482a-d9fc-489a-844b-35c3f2ffd7b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:58:24 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-fae2850d-62ef-4cc3-a4cb-98820604fd1c tempest-VolumesActionsTest-1371964133 None] Created volume successfully.
Apr 15 15:58:24 devstack sudo[88746]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:24 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-e2c3fc7f-59cb-426f-9680-7be8066f0de6 tempest-VolumesSnapshotListTestJSON-408696757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.396c3f29-5375-47d3-9be8-f9a799f17f9d" returned: 0 in 0.513s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:24 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-e2c3fc7f-59cb-426f-9680-7be8066f0de6 tempest-VolumesSnapshotListTestJSON-408696757 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53093f60-603e-4351-9be9-798d0c4b1ed1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82485) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 15:58:24 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-e2c3fc7f-59cb-426f-9680-7be8066f0de6 tempest-VolumesSnapshotListTestJSON-408696757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.5ed55c95-0601-4af7-9416-486bbb1f8ea3 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:24 devstack sudo[88758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.5ed55c95-0601-4af7-9416-486bbb1f8ea3
Apr 15 15:58:24 devstack sudo[88758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:24 devstack sudo[88749]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:24 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ec5dd5d2-5069-4893-9d84-5e11ee192517 tempest-VolumesCloneNegativeTest-1503427787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e96f72a8-4335-4953-9b6a-b879e610a4ff 2147483648" returned: 0 in 0.506s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:24 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ec5dd5d2-5069-4893-9d84-5e11ee192517 tempest-VolumesCloneNegativeTest-1503427787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e96f72a8-4335-4953-9b6a-b879e610a4ff {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:24 devstack sudo[88760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e96f72a8-4335-4953-9b6a-b879e610a4ff
Apr 15 15:58:24 devstack sudo[88760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:25 devstack sudo[88758]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:25 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-e2c3fc7f-59cb-426f-9680-7be8066f0de6 tempest-VolumesSnapshotListTestJSON-408696757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.5ed55c95-0601-4af7-9416-486bbb1f8ea3" returned: 0 in 0.484s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:25 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-e2c3fc7f-59cb-426f-9680-7be8066f0de6 tempest-VolumesSnapshotListTestJSON-408696757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.5ed55c95-0601-4af7-9416-486bbb1f8ea3 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:25 devstack sudo[88766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.5ed55c95-0601-4af7-9416-486bbb1f8ea3
Apr 15 15:58:25 devstack sudo[88766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:25 devstack sudo[88760]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:25 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ec5dd5d2-5069-4893-9d84-5e11ee192517 tempest-VolumesCloneNegativeTest-1503427787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e96f72a8-4335-4953-9b6a-b879e610a4ff" returned: 0 in 0.423s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:25 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-ec5dd5d2-5069-4893-9d84-5e11ee192517 tempest-VolumesCloneNegativeTest-1503427787 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:58:25 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-ec5dd5d2-5069-4893-9d84-5e11ee192517 tempest-VolumesCloneNegativeTest-1503427787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:58:25 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-ec5dd5d2-5069-4893-9d84-5e11ee192517 tempest-VolumesCloneNegativeTest-1503427787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a595234f-543b-41b1-b6f5-ab542f331b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e96f72a8-4335-4953-9b6a-b879e610a4ff', 'volume_size': 2}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:25 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-ec5dd5d2-5069-4893-9d84-5e11ee192517 tempest-VolumesCloneNegativeTest-1503427787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bf3b912-a5a3-4bf3-a607-9582d23f90b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:25 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-ec5dd5d2-5069-4893-9d84-5e11ee192517 tempest-VolumesCloneNegativeTest-1503427787 None] Volume volume-e96f72a8-4335-4953-9b6a-b879e610a4ff (e96f72a8-4335-4953-9b6a-b879e610a4ff): created successfully
Apr 15 15:58:25 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-ec5dd5d2-5069-4893-9d84-5e11ee192517 tempest-VolumesCloneNegativeTest-1503427787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bf3b912-a5a3-4bf3-a607-9582d23f90b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:25 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-ec5dd5d2-5069-4893-9d84-5e11ee192517 tempest-VolumesCloneNegativeTest-1503427787 None] Flow 'volume_create_manager' (4adc31c8-d3dd-400a-9624-200a4c878348) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:58:25 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-ec5dd5d2-5069-4893-9d84-5e11ee192517 tempest-VolumesCloneNegativeTest-1503427787 None] Created volume successfully.
Apr 15 15:58:25 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-5b313c1b-d4ef-4166-a5eb-e6afebaaf971 tempest-VolumesActionsTest-902023646 None] Acquiring lock "cinder-94de7e72-0f5f-46fa-af05-a88e5ca5e4be-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:58:25 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-5b313c1b-d4ef-4166-a5eb-e6afebaaf971 tempest-VolumesActionsTest-902023646 None] Lock "cinder-94de7e72-0f5f-46fa-af05-a88e5ca5e4be-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:58:25 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-5b313c1b-d4ef-4166-a5eb-e6afebaaf971 tempest-VolumesActionsTest-902023646 None] Acquiring lock "cinder-quobyte-94de7e72-0f5f-46fa-af05-a88e5ca5e4be" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:58:25 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-5b313c1b-d4ef-4166-a5eb-e6afebaaf971 tempest-VolumesActionsTest-902023646 None] Lock "cinder-quobyte-94de7e72-0f5f-46fa-af05-a88e5ca5e4be" acquired by "delete_volume" :: waited 0.015s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:58:25 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[4afc7e3c-806e-4559-a476-c2f715215863]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:58:25 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-5b313c1b-d4ef-4166-a5eb-e6afebaaf971 tempest-VolumesActionsTest-902023646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-94de7e72-0f5f-46fa-af05-a88e5ca5e4be {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:25 devstack sudo[88768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-94de7e72-0f5f-46fa-af05-a88e5ca5e4be
Apr 15 15:58:25 devstack sudo[88768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:25 devstack sudo[88766]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:25 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-e2c3fc7f-59cb-426f-9680-7be8066f0de6 tempest-VolumesSnapshotListTestJSON-408696757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.5ed55c95-0601-4af7-9416-486bbb1f8ea3" returned: 0 in 0.436s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:25 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-e2c3fc7f-59cb-426f-9680-7be8066f0de6 tempest-VolumesSnapshotListTestJSON-408696757 None] Lock "cinder-quobyte-5ed55c95-0601-4af7-9416-486bbb1f8ea3" released by "_delete_snapshot" :: held 2.071s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:58:25 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-e2c3fc7f-59cb-426f-9680-7be8066f0de6 tempest-VolumesSnapshotListTestJSON-408696757 None] Lock "cinder-quobyte-53093f60-603e-4351-9be9-798d0c4b1ed1" released by "delete_snapshot" :: held 2.085s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:58:25 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-e2c3fc7f-59cb-426f-9680-7be8066f0de6 tempest-VolumesSnapshotListTestJSON-408696757 None] Created reservations ['c4075bfa-2cce-4fd5-8bad-30540b7c34fa', '20e77756-5a0d-4218-96ab-58e0c1102ddb', '31ef02c9-921c-48e4-8c7d-a38320f4b278', '07ace328-e355-4b17-b9b1-047c0fc5ef6b'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:58:25 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-e2c3fc7f-59cb-426f-9680-7be8066f0de6 tempest-VolumesSnapshotListTestJSON-408696757 None] Delete snapshot completed successfully.
Apr 15 15:58:25 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-e2c3fc7f-59cb-426f-9680-7be8066f0de6 tempest-VolumesSnapshotListTestJSON-408696757 None] Lock "cinder-5ed55c95-0601-4af7-9416-486bbb1f8ea3-delete_snapshot" released by "delete_snapshot" :: held 2.168s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:58:26 devstack sudo[88768]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-5b313c1b-d4ef-4166-a5eb-e6afebaaf971 tempest-VolumesActionsTest-902023646 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-94de7e72-0f5f-46fa-af05-a88e5ca5e4be" returned: 0 in 0.491s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-5b313c1b-d4ef-4166-a5eb-e6afebaaf971 tempest-VolumesActionsTest-902023646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-94de7e72-0f5f-46fa-af05-a88e5ca5e4be {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:26 devstack sudo[88774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-94de7e72-0f5f-46fa-af05-a88e5ca5e4be
Apr 15 15:58:26 devstack sudo[88774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:26 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-ea2f53f2-55b8-4323-a0e2-c41a37b28382 tempest-VolumesCloneNegativeTest-1503427787 None] Acquiring lock "cinder-e96f72a8-4335-4953-9b6a-b879e610a4ff-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:58:26 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-ea2f53f2-55b8-4323-a0e2-c41a37b28382 tempest-VolumesCloneNegativeTest-1503427787 None] Lock "cinder-e96f72a8-4335-4953-9b6a-b879e610a4ff-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:58:26 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-ea2f53f2-55b8-4323-a0e2-c41a37b28382 tempest-VolumesCloneNegativeTest-1503427787 None] Acquiring lock "cinder-quobyte-e96f72a8-4335-4953-9b6a-b879e610a4ff" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:58:26 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-ea2f53f2-55b8-4323-a0e2-c41a37b28382 tempest-VolumesCloneNegativeTest-1503427787 None] Lock "cinder-quobyte-e96f72a8-4335-4953-9b6a-b879e610a4ff" acquired by "delete_volume" :: waited 0.009s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:58:26 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2cfdf11-bffb-482d-aa56-c9c01f11cced]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:58:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ea2f53f2-55b8-4323-a0e2-c41a37b28382 tempest-VolumesCloneNegativeTest-1503427787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e96f72a8-4335-4953-9b6a-b879e610a4ff {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:26 devstack sudo[88776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e96f72a8-4335-4953-9b6a-b879e610a4ff
Apr 15 15:58:26 devstack sudo[88776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:26 devstack sudo[88774]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-5b313c1b-d4ef-4166-a5eb-e6afebaaf971 tempest-VolumesActionsTest-902023646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-94de7e72-0f5f-46fa-af05-a88e5ca5e4be" returned: 0 in 0.437s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:26 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-5b313c1b-d4ef-4166-a5eb-e6afebaaf971 tempest-VolumesActionsTest-902023646 None] Lock "cinder-quobyte-94de7e72-0f5f-46fa-af05-a88e5ca5e4be" released by "delete_volume" :: held 0.948s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:58:26 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-5b313c1b-d4ef-4166-a5eb-e6afebaaf971 tempest-VolumesActionsTest-902023646 None] Created reservations ['4268b569-bcff-46d9-bcf5-4c92f715c00d', '7c217796-0185-4453-b2f9-c7f468346436', '3fb423f9-97ca-45c4-b421-3eb26153b0d7', '29f7450c-c09f-4990-947a-cf4ac0c15f43'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:58:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-5b313c1b-d4ef-4166-a5eb-e6afebaaf971 tempest-VolumesActionsTest-902023646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:58:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-5b313c1b-d4ef-4166-a5eb-e6afebaaf971 tempest-VolumesActionsTest-902023646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:58:26 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-5b313c1b-d4ef-4166-a5eb-e6afebaaf971 tempest-VolumesActionsTest-902023646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:58:26 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-5b313c1b-d4ef-4166-a5eb-e6afebaaf971 tempest-VolumesActionsTest-902023646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:58:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-5b313c1b-d4ef-4166-a5eb-e6afebaaf971 tempest-VolumesActionsTest-902023646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:58:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-5b313c1b-d4ef-4166-a5eb-e6afebaaf971 tempest-VolumesActionsTest-902023646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:26 devstack sudo[88779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:58:26 devstack sudo[88779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:26 devstack sudo[88776]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ea2f53f2-55b8-4323-a0e2-c41a37b28382 tempest-VolumesCloneNegativeTest-1503427787 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e96f72a8-4335-4953-9b6a-b879e610a4ff" returned: 0 in 0.498s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ea2f53f2-55b8-4323-a0e2-c41a37b28382 tempest-VolumesCloneNegativeTest-1503427787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e96f72a8-4335-4953-9b6a-b879e610a4ff {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:26 devstack sudo[88784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e96f72a8-4335-4953-9b6a-b879e610a4ff
Apr 15 15:58:26 devstack sudo[88784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:26 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-ba471f09-1d3d-4e93-a59c-cca343b0768c tempest-VolumesSnapshotListTestJSON-408696757 None] Acquiring lock "cinder-396c3f29-5375-47d3-9be8-f9a799f17f9d-delete_snapshot" by "delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:58:26 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-ba471f09-1d3d-4e93-a59c-cca343b0768c tempest-VolumesSnapshotListTestJSON-408696757 None] Lock "cinder-396c3f29-5375-47d3-9be8-f9a799f17f9d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:58:26 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-ba471f09-1d3d-4e93-a59c-cca343b0768c tempest-VolumesSnapshotListTestJSON-408696757 None] Acquiring lock "cinder-quobyte-53093f60-603e-4351-9be9-798d0c4b1ed1" by "delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:58:26 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-ba471f09-1d3d-4e93-a59c-cca343b0768c tempest-VolumesSnapshotListTestJSON-408696757 None] Lock "cinder-quobyte-53093f60-603e-4351-9be9-798d0c4b1ed1" acquired by "delete_snapshot" :: waited 0.034s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:58:26 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-ba471f09-1d3d-4e93-a59c-cca343b0768c tempest-VolumesSnapshotListTestJSON-408696757 None] Acquiring lock "cinder-quobyte-396c3f29-5375-47d3-9be8-f9a799f17f9d" by "_delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:58:26 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-ba471f09-1d3d-4e93-a59c-cca343b0768c tempest-VolumesSnapshotListTestJSON-408696757 None] Lock "cinder-quobyte-396c3f29-5375-47d3-9be8-f9a799f17f9d" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:58:26 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-ba471f09-1d3d-4e93-a59c-cca343b0768c tempest-VolumesSnapshotListTestJSON-408696757 None] Deleting offline snapshot 396c3f29-5375-47d3-9be8-f9a799f17f9d of volume 53093f60-603e-4351-9be9-798d0c4b1ed1 {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 15:58:26 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-ba471f09-1d3d-4e93-a59c-cca343b0768c tempest-VolumesSnapshotListTestJSON-408696757 None] snapshot_file for this snap is: volume-53093f60-603e-4351-9be9-798d0c4b1ed1.396c3f29-5375-47d3-9be8-f9a799f17f9d {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 15:58:26 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5d64cd-68e5-4ae8-b822-b0fdff15bd2d]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:58:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ba471f09-1d3d-4e93-a59c-cca343b0768c tempest-VolumesSnapshotListTestJSON-408696757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.396c3f29-5375-47d3-9be8-f9a799f17f9d {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:26 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-e673242b-0fe5-42fb-9f4f-da14e4676f7f tempest-VolumesActionsTest-1371964133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:58:26 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-e673242b-0fe5-42fb-9f4f-da14e4676f7f tempest-VolumesActionsTest-1371964133 None] Flow 'volume_create_manager' (0600efb1-fdf5-4704-8e8e-7672df36103a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:58:26 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-e673242b-0fe5-42fb-9f4f-da14e4676f7f tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7a1575c-9d00-45e4-a1f5-a622ef8b626c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:26 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-e673242b-0fe5-42fb-9f4f-da14e4676f7f tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7a1575c-9d00-45e4-a1f5-a622ef8b626c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:58:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1416143515',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79ce082b-0a98-447d-805f-a5a372cffdd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed231ba239684efe9c626e77361b1165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:58:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:58:27Z,use_quota=True,user_id='3b9306ef6f824ad8a0aafabf4de5ee26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:26 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-e673242b-0fe5-42fb-9f4f-da14e4676f7f tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95e09ca8-bf2f-4ff1-b95f-add7afa480ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:26 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-e673242b-0fe5-42fb-9f4f-da14e4676f7f tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95e09ca8-bf2f-4ff1-b95f-add7afa480ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:26 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-e673242b-0fe5-42fb-9f4f-da14e4676f7f tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef324fe2-33c0-4bb7-bd0f-2800ab060376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:26 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-e673242b-0fe5-42fb-9f4f-da14e4676f7f tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef324fe2-33c0-4bb7-bd0f-2800ab060376) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79ce082b-0a98-447d-805f-a5a372cffdd5', 'volume_name': 'volume-79ce082b-0a98-447d-805f-a5a372cffdd5', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:26 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-e673242b-0fe5-42fb-9f4f-da14e4676f7f tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a93dc549-1f39-43ba-97a5-5d2609d02a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:26 devstack sudo[88788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.396c3f29-5375-47d3-9be8-f9a799f17f9d
Apr 15 15:58:26 devstack sudo[88788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:26 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-e673242b-0fe5-42fb-9f4f-da14e4676f7f tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a93dc549-1f39-43ba-97a5-5d2609d02a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:26 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-e673242b-0fe5-42fb-9f4f-da14e4676f7f tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73a2e69d-4804-4726-8c12-bb6d8577e6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:26 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-e673242b-0fe5-42fb-9f4f-da14e4676f7f tempest-VolumesActionsTest-1371964133 None] Volume 79ce082b-0a98-447d-805f-a5a372cffdd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79ce082b-0a98-447d-805f-a5a372cffdd5', 'volume_size': 1}
Apr 15 15:58:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-e673242b-0fe5-42fb-9f4f-da14e4676f7f tempest-VolumesActionsTest-1371964133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:58:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-e673242b-0fe5-42fb-9f4f-da14e4676f7f tempest-VolumesActionsTest-1371964133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:58:26 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-e673242b-0fe5-42fb-9f4f-da14e4676f7f tempest-VolumesActionsTest-1371964133 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:58:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1416143515',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79ce082b-0a98-447d-805f-a5a372cffdd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed231ba239684efe9c626e77361b1165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:58:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:58:27Z,use_quota=True,user_id='3b9306ef6f824ad8a0aafabf4de5ee26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:58:26 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-e673242b-0fe5-42fb-9f4f-da14e4676f7f tempest-VolumesActionsTest-1371964133 None] Creating volume 79ce082b-0a98-447d-805f-a5a372cffdd5 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:58:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-e673242b-0fe5-42fb-9f4f-da14e4676f7f tempest-VolumesActionsTest-1371964133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:58:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-e673242b-0fe5-42fb-9f4f-da14e4676f7f tempest-VolumesActionsTest-1371964133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:58:26 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-e673242b-0fe5-42fb-9f4f-da14e4676f7f tempest-VolumesActionsTest-1371964133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:58:26 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-e673242b-0fe5-42fb-9f4f-da14e4676f7f tempest-VolumesActionsTest-1371964133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:58:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-e673242b-0fe5-42fb-9f4f-da14e4676f7f tempest-VolumesActionsTest-1371964133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:58:26 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-e673242b-0fe5-42fb-9f4f-da14e4676f7f tempest-VolumesActionsTest-1371964133 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:58:26 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-e673242b-0fe5-42fb-9f4f-da14e4676f7f tempest-VolumesActionsTest-1371964133 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:58:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-e673242b-0fe5-42fb-9f4f-da14e4676f7f tempest-VolumesActionsTest-1371964133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-79ce082b-0a98-447d-805f-a5a372cffdd5 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:27 devstack sudo[88790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-79ce082b-0a98-447d-805f-a5a372cffdd5 1073741824
Apr 15 15:58:27 devstack sudo[88790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:27 devstack sudo[88779]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:27 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-5b313c1b-d4ef-4166-a5eb-e6afebaaf971 tempest-VolumesActionsTest-902023646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.528s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:27 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-5b313c1b-d4ef-4166-a5eb-e6afebaaf971 tempest-VolumesActionsTest-902023646 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:58:27 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-5b313c1b-d4ef-4166-a5eb-e6afebaaf971 tempest-VolumesActionsTest-902023646 None] Deleted volume successfully.
Apr 15 15:58:27 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-5b313c1b-d4ef-4166-a5eb-e6afebaaf971 tempest-VolumesActionsTest-902023646 None] Lock "cinder-94de7e72-0f5f-46fa-af05-a88e5ca5e4be-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:58:27 devstack sudo[88784]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:27 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ea2f53f2-55b8-4323-a0e2-c41a37b28382 tempest-VolumesCloneNegativeTest-1503427787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e96f72a8-4335-4953-9b6a-b879e610a4ff" returned: 0 in 0.491s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:27 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-ea2f53f2-55b8-4323-a0e2-c41a37b28382 tempest-VolumesCloneNegativeTest-1503427787 None] Lock "cinder-quobyte-e96f72a8-4335-4953-9b6a-b879e610a4ff" released by "delete_volume" :: held 1.014s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:58:27 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-ea2f53f2-55b8-4323-a0e2-c41a37b28382 tempest-VolumesCloneNegativeTest-1503427787 None] Created reservations ['7f196a6a-13d0-427a-9e9a-e1bd44fcabfe', '8968449f-2bd7-413a-a016-79e75fd51381', 'a7457132-d3f0-4b3d-8fd3-8e70580fab7f', '62c289a0-b187-4311-8464-6bd60f633937'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:58:27 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-ea2f53f2-55b8-4323-a0e2-c41a37b28382 tempest-VolumesCloneNegativeTest-1503427787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:58:27 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-ea2f53f2-55b8-4323-a0e2-c41a37b28382 tempest-VolumesCloneNegativeTest-1503427787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:58:27 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-ea2f53f2-55b8-4323-a0e2-c41a37b28382 tempest-VolumesCloneNegativeTest-1503427787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:58:27 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-ea2f53f2-55b8-4323-a0e2-c41a37b28382 tempest-VolumesCloneNegativeTest-1503427787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:58:27 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-ea2f53f2-55b8-4323-a0e2-c41a37b28382 tempest-VolumesCloneNegativeTest-1503427787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:58:27 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ea2f53f2-55b8-4323-a0e2-c41a37b28382 tempest-VolumesCloneNegativeTest-1503427787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:27 devstack sudo[88794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:58:27 devstack sudo[88794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:27 devstack sudo[88788]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:27 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ba471f09-1d3d-4e93-a59c-cca343b0768c tempest-VolumesSnapshotListTestJSON-408696757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.396c3f29-5375-47d3-9be8-f9a799f17f9d" returned: 0 in 0.533s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:27 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-ba471f09-1d3d-4e93-a59c-cca343b0768c tempest-VolumesSnapshotListTestJSON-408696757 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53093f60-603e-4351-9be9-798d0c4b1ed1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82485) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 15:58:27 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7d79b6-7abc-4505-a61b-d25dea4914e7]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:58:27 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ba471f09-1d3d-4e93-a59c-cca343b0768c tempest-VolumesSnapshotListTestJSON-408696757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:27 devstack sudo[88802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1
Apr 15 15:58:27 devstack sudo[88802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:27 devstack sudo[88790]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:27 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-e673242b-0fe5-42fb-9f4f-da14e4676f7f tempest-VolumesActionsTest-1371964133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-79ce082b-0a98-447d-805f-a5a372cffdd5 1073741824" returned: 0 in 0.533s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:27 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-e673242b-0fe5-42fb-9f4f-da14e4676f7f tempest-VolumesActionsTest-1371964133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-79ce082b-0a98-447d-805f-a5a372cffdd5 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:27 devstack sudo[88804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-79ce082b-0a98-447d-805f-a5a372cffdd5
Apr 15 15:58:27 devstack sudo[88804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:27 devstack sudo[88794]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:27 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ea2f53f2-55b8-4323-a0e2-c41a37b28382 tempest-VolumesCloneNegativeTest-1503427787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.436s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:27 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-ea2f53f2-55b8-4323-a0e2-c41a37b28382 tempest-VolumesCloneNegativeTest-1503427787 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:58:27 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-ea2f53f2-55b8-4323-a0e2-c41a37b28382 tempest-VolumesCloneNegativeTest-1503427787 None] Deleted volume successfully.
Apr 15 15:58:27 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-ea2f53f2-55b8-4323-a0e2-c41a37b28382 tempest-VolumesCloneNegativeTest-1503427787 None] Lock "cinder-e96f72a8-4335-4953-9b6a-b879e610a4ff-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:58:27 devstack sudo[88804]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:27 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-e673242b-0fe5-42fb-9f4f-da14e4676f7f tempest-VolumesActionsTest-1371964133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-79ce082b-0a98-447d-805f-a5a372cffdd5" returned: 0 in 0.414s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:27 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-e673242b-0fe5-42fb-9f4f-da14e4676f7f tempest-VolumesActionsTest-1371964133 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:58:27 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-e673242b-0fe5-42fb-9f4f-da14e4676f7f tempest-VolumesActionsTest-1371964133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:58:27 devstack sudo[88802]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:27 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-e673242b-0fe5-42fb-9f4f-da14e4676f7f tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73a2e69d-4804-4726-8c12-bb6d8577e6b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79ce082b-0a98-447d-805f-a5a372cffdd5', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:27 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-e673242b-0fe5-42fb-9f4f-da14e4676f7f tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4f292ec-84c9-49f1-a8f0-325e1ff29670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:27 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ba471f09-1d3d-4e93-a59c-cca343b0768c tempest-VolumesSnapshotListTestJSON-408696757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1" returned: 0 in 0.526s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:27 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ba471f09-1d3d-4e93-a59c-cca343b0768c tempest-VolumesSnapshotListTestJSON-408696757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.396c3f29-5375-47d3-9be8-f9a799f17f9d {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:27 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-e673242b-0fe5-42fb-9f4f-da14e4676f7f tempest-VolumesActionsTest-1371964133 None] Volume volume-79ce082b-0a98-447d-805f-a5a372cffdd5 (79ce082b-0a98-447d-805f-a5a372cffdd5): created successfully
Apr 15 15:58:27 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-e673242b-0fe5-42fb-9f4f-da14e4676f7f tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4f292ec-84c9-49f1-a8f0-325e1ff29670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:27 devstack sudo[88811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.396c3f29-5375-47d3-9be8-f9a799f17f9d
Apr 15 15:58:28 devstack sudo[88811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:28 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-e673242b-0fe5-42fb-9f4f-da14e4676f7f tempest-VolumesActionsTest-1371964133 None] Flow 'volume_create_manager' (0600efb1-fdf5-4704-8e8e-7672df36103a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:58:28 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-e673242b-0fe5-42fb-9f4f-da14e4676f7f tempest-VolumesActionsTest-1371964133 None] Created volume successfully.
Apr 15 15:58:28 devstack sudo[88811]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:28 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ba471f09-1d3d-4e93-a59c-cca343b0768c tempest-VolumesSnapshotListTestJSON-408696757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.396c3f29-5375-47d3-9be8-f9a799f17f9d" returned: 0 in 0.478s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:28 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ba471f09-1d3d-4e93-a59c-cca343b0768c tempest-VolumesSnapshotListTestJSON-408696757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.396c3f29-5375-47d3-9be8-f9a799f17f9d {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:28 devstack sudo[88816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.396c3f29-5375-47d3-9be8-f9a799f17f9d
Apr 15 15:58:28 devstack sudo[88816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:28 devstack sudo[88816]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:28 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ba471f09-1d3d-4e93-a59c-cca343b0768c tempest-VolumesSnapshotListTestJSON-408696757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1.396c3f29-5375-47d3-9be8-f9a799f17f9d" returned: 0 in 0.450s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:28 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-ba471f09-1d3d-4e93-a59c-cca343b0768c tempest-VolumesSnapshotListTestJSON-408696757 None] Lock "cinder-quobyte-396c3f29-5375-47d3-9be8-f9a799f17f9d" released by "_delete_snapshot" :: held 2.051s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:58:28 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-ba471f09-1d3d-4e93-a59c-cca343b0768c tempest-VolumesSnapshotListTestJSON-408696757 None] Lock "cinder-quobyte-53093f60-603e-4351-9be9-798d0c4b1ed1" released by "delete_snapshot" :: held 2.070s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:58:28 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-ba471f09-1d3d-4e93-a59c-cca343b0768c tempest-VolumesSnapshotListTestJSON-408696757 None] Created reservations ['1c3e1326-85d0-4e1d-a5aa-8c30a74ed330', 'd82ee578-af9d-4fcd-b8f5-ad6c099c23f0', 'cce05d96-cc39-4964-8a13-4e7263a3a66d', '4eeb93c5-d06b-4f07-8c98-614e208603cb'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:58:29 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-ba471f09-1d3d-4e93-a59c-cca343b0768c tempest-VolumesSnapshotListTestJSON-408696757 None] Delete snapshot completed successfully.
Apr 15 15:58:29 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-ba471f09-1d3d-4e93-a59c-cca343b0768c tempest-VolumesSnapshotListTestJSON-408696757 None] Lock "cinder-396c3f29-5375-47d3-9be8-f9a799f17f9d-delete_snapshot" released by "delete_snapshot" :: held 2.194s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:58:29 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-e61b283c-c256-40fb-b590-4b943371d3aa tempest-VolumesActionsTest-902023646 None] Acquiring lock "cinder-79ce082b-0a98-447d-805f-a5a372cffdd5-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:58:29 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-e61b283c-c256-40fb-b590-4b943371d3aa tempest-VolumesActionsTest-902023646 None] Lock "cinder-79ce082b-0a98-447d-805f-a5a372cffdd5-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:58:29 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-e61b283c-c256-40fb-b590-4b943371d3aa tempest-VolumesActionsTest-902023646 None] Acquiring lock "cinder-quobyte-79ce082b-0a98-447d-805f-a5a372cffdd5" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:58:29 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-e61b283c-c256-40fb-b590-4b943371d3aa tempest-VolumesActionsTest-902023646 None] Lock "cinder-quobyte-79ce082b-0a98-447d-805f-a5a372cffdd5" acquired by "delete_volume" :: waited 0.006s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:58:29 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[8123ea3b-0ce6-4cb1-b165-f9dc08997b98]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:58:29 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-e61b283c-c256-40fb-b590-4b943371d3aa tempest-VolumesActionsTest-902023646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-79ce082b-0a98-447d-805f-a5a372cffdd5 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:29 devstack sudo[88819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-79ce082b-0a98-447d-805f-a5a372cffdd5
Apr 15 15:58:29 devstack sudo[88819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:29 devstack sudo[88819]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:29 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-e61b283c-c256-40fb-b590-4b943371d3aa tempest-VolumesActionsTest-902023646 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-79ce082b-0a98-447d-805f-a5a372cffdd5" returned: 0 in 0.520s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:29 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-e61b283c-c256-40fb-b590-4b943371d3aa tempest-VolumesActionsTest-902023646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-79ce082b-0a98-447d-805f-a5a372cffdd5 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:29 devstack sudo[88824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-79ce082b-0a98-447d-805f-a5a372cffdd5
Apr 15 15:58:29 devstack sudo[88824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:30 devstack sudo[88824]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:30 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-e61b283c-c256-40fb-b590-4b943371d3aa tempest-VolumesActionsTest-902023646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-79ce082b-0a98-447d-805f-a5a372cffdd5" returned: 0 in 0.441s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:30 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-e61b283c-c256-40fb-b590-4b943371d3aa tempest-VolumesActionsTest-902023646 None] Lock "cinder-quobyte-79ce082b-0a98-447d-805f-a5a372cffdd5" released by "delete_volume" :: held 0.991s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:58:30 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-e61b283c-c256-40fb-b590-4b943371d3aa tempest-VolumesActionsTest-902023646 None] Created reservations ['73dcd26d-d8db-487f-8dd3-b189fac97cb5', '9ab4f475-48c4-4678-b81b-863e45004d13', '3061a562-790b-4423-aa68-f04711520e83', '91b3c7d8-b7a8-4c9c-b982-29871139c865'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:58:30 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-72bb2c42-4cf0-41fe-9ee0-826faf23b05a tempest-VolumesSnapshotListTestJSON-408696757 None] Acquiring lock "cinder-53093f60-603e-4351-9be9-798d0c4b1ed1-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:58:30 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-e61b283c-c256-40fb-b590-4b943371d3aa tempest-VolumesActionsTest-902023646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:58:30 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-e61b283c-c256-40fb-b590-4b943371d3aa tempest-VolumesActionsTest-902023646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:58:30 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-e61b283c-c256-40fb-b590-4b943371d3aa tempest-VolumesActionsTest-902023646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:58:30 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-e61b283c-c256-40fb-b590-4b943371d3aa tempest-VolumesActionsTest-902023646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:58:30 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-e61b283c-c256-40fb-b590-4b943371d3aa tempest-VolumesActionsTest-902023646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:58:30 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-e61b283c-c256-40fb-b590-4b943371d3aa tempest-VolumesActionsTest-902023646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:30 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-72bb2c42-4cf0-41fe-9ee0-826faf23b05a tempest-VolumesSnapshotListTestJSON-408696757 None] Lock "cinder-53093f60-603e-4351-9be9-798d0c4b1ed1-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:58:30 devstack sudo[88827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:58:30 devstack sudo[88827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:30 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-72bb2c42-4cf0-41fe-9ee0-826faf23b05a tempest-VolumesSnapshotListTestJSON-408696757 None] Acquiring lock "cinder-quobyte-53093f60-603e-4351-9be9-798d0c4b1ed1" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:58:30 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-72bb2c42-4cf0-41fe-9ee0-826faf23b05a tempest-VolumesSnapshotListTestJSON-408696757 None] Lock "cinder-quobyte-53093f60-603e-4351-9be9-798d0c4b1ed1" acquired by "delete_volume" :: waited 0.008s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:58:30 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83a3436-3e33-4862-886f-142410a1659d]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:58:30 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-72bb2c42-4cf0-41fe-9ee0-826faf23b05a tempest-VolumesSnapshotListTestJSON-408696757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:30 devstack sudo[88829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1
Apr 15 15:58:30 devstack sudo[88829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:30 devstack sudo[88827]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:30 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-e61b283c-c256-40fb-b590-4b943371d3aa tempest-VolumesActionsTest-902023646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.478s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:30 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-e61b283c-c256-40fb-b590-4b943371d3aa tempest-VolumesActionsTest-902023646 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:58:30 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-e61b283c-c256-40fb-b590-4b943371d3aa tempest-VolumesActionsTest-902023646 None] Deleted volume successfully.
Apr 15 15:58:30 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-e61b283c-c256-40fb-b590-4b943371d3aa tempest-VolumesActionsTest-902023646 None] Lock "cinder-79ce082b-0a98-447d-805f-a5a372cffdd5-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:58:30 devstack sudo[88829]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:30 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-72bb2c42-4cf0-41fe-9ee0-826faf23b05a tempest-VolumesSnapshotListTestJSON-408696757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1" returned: 0 in 0.540s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:30 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-72bb2c42-4cf0-41fe-9ee0-826faf23b05a tempest-VolumesSnapshotListTestJSON-408696757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:30 devstack sudo[88835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1
Apr 15 15:58:30 devstack sudo[88835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:31 devstack sudo[88835]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:31 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-72bb2c42-4cf0-41fe-9ee0-826faf23b05a tempest-VolumesSnapshotListTestJSON-408696757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-53093f60-603e-4351-9be9-798d0c4b1ed1" returned: 0 in 0.420s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:31 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-72bb2c42-4cf0-41fe-9ee0-826faf23b05a tempest-VolumesSnapshotListTestJSON-408696757 None] Lock "cinder-quobyte-53093f60-603e-4351-9be9-798d0c4b1ed1" released by "delete_volume" :: held 0.992s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:58:31 devstack cinder-volume[82485]: DEBUG dbcounter [-] [82485] Writing DB stats cinder:UPDATE=134,cinder:SELECT=103,cinder:INSERT=38,cinder:DELETE=12 {{(pid=82485) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 15:58:31 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-72bb2c42-4cf0-41fe-9ee0-826faf23b05a tempest-VolumesSnapshotListTestJSON-408696757 None] Created reservations ['21f7d465-a117-4b17-86bf-9adc79ad8da3', 'bb777723-ff75-47b4-918a-3710518453e3', '42406c43-9c98-42bb-bda4-be4ee9d50ab8', '7f786003-bb2e-4b8f-a58b-1d00c652178d'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:58:31 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-72bb2c42-4cf0-41fe-9ee0-826faf23b05a tempest-VolumesSnapshotListTestJSON-408696757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:58:31 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-72bb2c42-4cf0-41fe-9ee0-826faf23b05a tempest-VolumesSnapshotListTestJSON-408696757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:58:31 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-72bb2c42-4cf0-41fe-9ee0-826faf23b05a tempest-VolumesSnapshotListTestJSON-408696757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:58:31 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-72bb2c42-4cf0-41fe-9ee0-826faf23b05a tempest-VolumesSnapshotListTestJSON-408696757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:58:31 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-72bb2c42-4cf0-41fe-9ee0-826faf23b05a tempest-VolumesSnapshotListTestJSON-408696757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:58:31 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-72bb2c42-4cf0-41fe-9ee0-826faf23b05a tempest-VolumesSnapshotListTestJSON-408696757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:31 devstack sudo[88838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:58:31 devstack sudo[88838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:31 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-d46a279c-e0db-4763-8f70-b251ce9ecef3 tempest-CinderUnicodeTest-691955740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:58:31 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d46a279c-e0db-4763-8f70-b251ce9ecef3 tempest-CinderUnicodeTest-691955740 None] Flow 'volume_create_manager' (22897e09-6112-4fd0-816a-1251fadc8c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:58:31 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d46a279c-e0db-4763-8f70-b251ce9ecef3 tempest-CinderUnicodeTest-691955740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b4f8c62-5642-424c-b1f5-53a109e315e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:31 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d46a279c-e0db-4763-8f70-b251ce9ecef3 tempest-CinderUnicodeTest-691955740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b4f8c62-5642-424c-b1f5-53a109e315e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:58:31Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21ec4473-b979-4c52-a0e5-f8875be1e77b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04017b257bdc4922afecdeec471d32e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:58:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:58:31Z,use_quota=True,user_id='6e01cf1b69dc4d73863db1029ba52182',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:31 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d46a279c-e0db-4763-8f70-b251ce9ecef3 tempest-CinderUnicodeTest-691955740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (271c825b-6a35-4aa1-b881-d9c60f9868a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:31 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d46a279c-e0db-4763-8f70-b251ce9ecef3 tempest-CinderUnicodeTest-691955740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (271c825b-6a35-4aa1-b881-d9c60f9868a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:31 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d46a279c-e0db-4763-8f70-b251ce9ecef3 tempest-CinderUnicodeTest-691955740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9adce386-fadd-4944-ac83-579d742e1b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:31 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d46a279c-e0db-4763-8f70-b251ce9ecef3 tempest-CinderUnicodeTest-691955740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9adce386-fadd-4944-ac83-579d742e1b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21ec4473-b979-4c52-a0e5-f8875be1e77b', 'volume_name': 'volume-21ec4473-b979-4c52-a0e5-f8875be1e77b', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:31 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d46a279c-e0db-4763-8f70-b251ce9ecef3 tempest-CinderUnicodeTest-691955740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4a0398a-e024-46f3-8669-93c6d856a7f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:31 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d46a279c-e0db-4763-8f70-b251ce9ecef3 tempest-CinderUnicodeTest-691955740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4a0398a-e024-46f3-8669-93c6d856a7f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:31 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d46a279c-e0db-4763-8f70-b251ce9ecef3 tempest-CinderUnicodeTest-691955740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69d78e89-aa0f-4421-801e-bdcbebf99a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:31 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-d46a279c-e0db-4763-8f70-b251ce9ecef3 tempest-CinderUnicodeTest-691955740 None] Volume 21ec4473-b979-4c52-a0e5-f8875be1e77b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21ec4473-b979-4c52-a0e5-f8875be1e77b', 'volume_size': 1}
Apr 15 15:58:31 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-d46a279c-e0db-4763-8f70-b251ce9ecef3 tempest-CinderUnicodeTest-691955740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:58:31 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-d46a279c-e0db-4763-8f70-b251ce9ecef3 tempest-CinderUnicodeTest-691955740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:58:31 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-d46a279c-e0db-4763-8f70-b251ce9ecef3 tempest-CinderUnicodeTest-691955740 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:58:31Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21ec4473-b979-4c52-a0e5-f8875be1e77b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04017b257bdc4922afecdeec471d32e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:58:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:58:31Z,use_quota=True,user_id='6e01cf1b69dc4d73863db1029ba52182',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:58:31 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-d46a279c-e0db-4763-8f70-b251ce9ecef3 tempest-CinderUnicodeTest-691955740 None] Creating volume 21ec4473-b979-4c52-a0e5-f8875be1e77b {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:58:31 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-d46a279c-e0db-4763-8f70-b251ce9ecef3 tempest-CinderUnicodeTest-691955740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:58:31 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-d46a279c-e0db-4763-8f70-b251ce9ecef3 tempest-CinderUnicodeTest-691955740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:58:31 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-d46a279c-e0db-4763-8f70-b251ce9ecef3 tempest-CinderUnicodeTest-691955740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:58:31 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-d46a279c-e0db-4763-8f70-b251ce9ecef3 tempest-CinderUnicodeTest-691955740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:58:31 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-d46a279c-e0db-4763-8f70-b251ce9ecef3 tempest-CinderUnicodeTest-691955740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:58:31 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-d46a279c-e0db-4763-8f70-b251ce9ecef3 tempest-CinderUnicodeTest-691955740 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:58:31 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-d46a279c-e0db-4763-8f70-b251ce9ecef3 tempest-CinderUnicodeTest-691955740 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:58:31 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-d46a279c-e0db-4763-8f70-b251ce9ecef3 tempest-CinderUnicodeTest-691955740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-21ec4473-b979-4c52-a0e5-f8875be1e77b 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:31 devstack sudo[88840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-21ec4473-b979-4c52-a0e5-f8875be1e77b 1073741824
Apr 15 15:58:31 devstack sudo[88840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:31 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-9df83d52-6b67-416a-9dd2-b8d197dad78a tempest-VolumesActionsTest-1371964133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:58:31 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9df83d52-6b67-416a-9dd2-b8d197dad78a tempest-VolumesActionsTest-1371964133 None] Flow 'volume_create_manager' (88e5f542-d076-4ca0-89bd-1af129549665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:58:31 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9df83d52-6b67-416a-9dd2-b8d197dad78a tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (810a7c7b-19c6-45e5-aa13-032ed71a68bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:31 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9df83d52-6b67-416a-9dd2-b8d197dad78a tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (810a7c7b-19c6-45e5-aa13-032ed71a68bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:58:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1030642813',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fea466c6-f825-4489-a631-09d70f6efce3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed231ba239684efe9c626e77361b1165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:58:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:58:32Z,use_quota=True,user_id='3b9306ef6f824ad8a0aafabf4de5ee26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:31 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9df83d52-6b67-416a-9dd2-b8d197dad78a tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (776d7712-6087-4754-9f6e-12d1f6039fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:31 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9df83d52-6b67-416a-9dd2-b8d197dad78a tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (776d7712-6087-4754-9f6e-12d1f6039fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:31 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9df83d52-6b67-416a-9dd2-b8d197dad78a tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36201db7-cf94-483d-89ca-468acad794e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:31 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9df83d52-6b67-416a-9dd2-b8d197dad78a tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36201db7-cf94-483d-89ca-468acad794e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fea466c6-f825-4489-a631-09d70f6efce3', 'volume_name': 'volume-fea466c6-f825-4489-a631-09d70f6efce3', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:31 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9df83d52-6b67-416a-9dd2-b8d197dad78a tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52f8e248-194e-42d3-abfc-aee39bfae6a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:31 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9df83d52-6b67-416a-9dd2-b8d197dad78a tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52f8e248-194e-42d3-abfc-aee39bfae6a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:31 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9df83d52-6b67-416a-9dd2-b8d197dad78a tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94401d6b-aeab-4fd5-b33c-66f745d0b3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:31 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-9df83d52-6b67-416a-9dd2-b8d197dad78a tempest-VolumesActionsTest-1371964133 None] Volume fea466c6-f825-4489-a631-09d70f6efce3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fea466c6-f825-4489-a631-09d70f6efce3', 'volume_size': 1}
Apr 15 15:58:31 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-9df83d52-6b67-416a-9dd2-b8d197dad78a tempest-VolumesActionsTest-1371964133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:58:31 devstack sudo[88838]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:31 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-72bb2c42-4cf0-41fe-9ee0-826faf23b05a tempest-VolumesSnapshotListTestJSON-408696757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.446s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:31 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-72bb2c42-4cf0-41fe-9ee0-826faf23b05a tempest-VolumesSnapshotListTestJSON-408696757 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:58:31 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-72bb2c42-4cf0-41fe-9ee0-826faf23b05a tempest-VolumesSnapshotListTestJSON-408696757 None] Deleted volume successfully.
Apr 15 15:58:31 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-72bb2c42-4cf0-41fe-9ee0-826faf23b05a tempest-VolumesSnapshotListTestJSON-408696757 None] Lock "cinder-53093f60-603e-4351-9be9-798d0c4b1ed1-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:58:32 devstack sudo[88840]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:32 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-d46a279c-e0db-4763-8f70-b251ce9ecef3 tempest-CinderUnicodeTest-691955740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-21ec4473-b979-4c52-a0e5-f8875be1e77b 1073741824" returned: 0 in 0.515s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:32 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-d46a279c-e0db-4763-8f70-b251ce9ecef3 tempest-CinderUnicodeTest-691955740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-21ec4473-b979-4c52-a0e5-f8875be1e77b {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:32 devstack sudo[88846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-21ec4473-b979-4c52-a0e5-f8875be1e77b
Apr 15 15:58:32 devstack sudo[88846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:32 devstack sudo[88846]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:32 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-d46a279c-e0db-4763-8f70-b251ce9ecef3 tempest-CinderUnicodeTest-691955740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-21ec4473-b979-4c52-a0e5-f8875be1e77b" returned: 0 in 0.411s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:32 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-d46a279c-e0db-4763-8f70-b251ce9ecef3 tempest-CinderUnicodeTest-691955740 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:58:32 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-d46a279c-e0db-4763-8f70-b251ce9ecef3 tempest-CinderUnicodeTest-691955740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:58:32 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-9df83d52-6b67-416a-9dd2-b8d197dad78a tempest-VolumesActionsTest-1371964133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.754s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:58:32 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-9df83d52-6b67-416a-9dd2-b8d197dad78a tempest-VolumesActionsTest-1371964133 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:58:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1030642813',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fea466c6-f825-4489-a631-09d70f6efce3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed231ba239684efe9c626e77361b1165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:58:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:58:32Z,use_quota=True,user_id='3b9306ef6f824ad8a0aafabf4de5ee26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:58:32 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-9df83d52-6b67-416a-9dd2-b8d197dad78a tempest-VolumesActionsTest-1371964133 None] Creating volume fea466c6-f825-4489-a631-09d70f6efce3 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:58:32 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-9df83d52-6b67-416a-9dd2-b8d197dad78a tempest-VolumesActionsTest-1371964133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:58:32 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-9df83d52-6b67-416a-9dd2-b8d197dad78a tempest-VolumesActionsTest-1371964133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:58:32 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-9df83d52-6b67-416a-9dd2-b8d197dad78a tempest-VolumesActionsTest-1371964133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:58:32 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-9df83d52-6b67-416a-9dd2-b8d197dad78a tempest-VolumesActionsTest-1371964133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:58:32 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-9df83d52-6b67-416a-9dd2-b8d197dad78a tempest-VolumesActionsTest-1371964133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:58:32 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-9df83d52-6b67-416a-9dd2-b8d197dad78a tempest-VolumesActionsTest-1371964133 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:58:32 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-9df83d52-6b67-416a-9dd2-b8d197dad78a tempest-VolumesActionsTest-1371964133 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:58:32 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9df83d52-6b67-416a-9dd2-b8d197dad78a tempest-VolumesActionsTest-1371964133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fea466c6-f825-4489-a631-09d70f6efce3 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:32 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d46a279c-e0db-4763-8f70-b251ce9ecef3 tempest-CinderUnicodeTest-691955740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69d78e89-aa0f-4421-801e-bdcbebf99a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21ec4473-b979-4c52-a0e5-f8875be1e77b', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:32 devstack sudo[88849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fea466c6-f825-4489-a631-09d70f6efce3 1073741824
Apr 15 15:58:32 devstack sudo[88849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:32 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d46a279c-e0db-4763-8f70-b251ce9ecef3 tempest-CinderUnicodeTest-691955740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41f5ee67-4da4-4ca9-bda0-42ee1961a58c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:32 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-d46a279c-e0db-4763-8f70-b251ce9ecef3 tempest-CinderUnicodeTest-691955740 None] Volume volume-21ec4473-b979-4c52-a0e5-f8875be1e77b (21ec4473-b979-4c52-a0e5-f8875be1e77b): created successfully
Apr 15 15:58:32 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d46a279c-e0db-4763-8f70-b251ce9ecef3 tempest-CinderUnicodeTest-691955740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41f5ee67-4da4-4ca9-bda0-42ee1961a58c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:32 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d46a279c-e0db-4763-8f70-b251ce9ecef3 tempest-CinderUnicodeTest-691955740 None] Flow 'volume_create_manager' (22897e09-6112-4fd0-816a-1251fadc8c91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:58:32 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-d46a279c-e0db-4763-8f70-b251ce9ecef3 tempest-CinderUnicodeTest-691955740 None] Created volume successfully.
Apr 15 15:58:32 devstack sudo[88849]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:32 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9df83d52-6b67-416a-9dd2-b8d197dad78a tempest-VolumesActionsTest-1371964133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fea466c6-f825-4489-a631-09d70f6efce3 1073741824" returned: 0 in 0.497s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:32 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9df83d52-6b67-416a-9dd2-b8d197dad78a tempest-VolumesActionsTest-1371964133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fea466c6-f825-4489-a631-09d70f6efce3 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:33 devstack sudo[88854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fea466c6-f825-4489-a631-09d70f6efce3
Apr 15 15:58:33 devstack sudo[88854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:33 devstack sudo[88854]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:33 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9df83d52-6b67-416a-9dd2-b8d197dad78a tempest-VolumesActionsTest-1371964133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fea466c6-f825-4489-a631-09d70f6efce3" returned: 0 in 0.457s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:33 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-9df83d52-6b67-416a-9dd2-b8d197dad78a tempest-VolumesActionsTest-1371964133 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:58:33 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-9df83d52-6b67-416a-9dd2-b8d197dad78a tempest-VolumesActionsTest-1371964133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:58:33 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9df83d52-6b67-416a-9dd2-b8d197dad78a tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94401d6b-aeab-4fd5-b33c-66f745d0b3d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fea466c6-f825-4489-a631-09d70f6efce3', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:33 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9df83d52-6b67-416a-9dd2-b8d197dad78a tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27a47188-a4a6-4b8a-9419-d87f355cfbd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:33 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-9df83d52-6b67-416a-9dd2-b8d197dad78a tempest-VolumesActionsTest-1371964133 None] Volume volume-fea466c6-f825-4489-a631-09d70f6efce3 (fea466c6-f825-4489-a631-09d70f6efce3): created successfully
Apr 15 15:58:33 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9df83d52-6b67-416a-9dd2-b8d197dad78a tempest-VolumesActionsTest-1371964133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27a47188-a4a6-4b8a-9419-d87f355cfbd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:33 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9df83d52-6b67-416a-9dd2-b8d197dad78a tempest-VolumesActionsTest-1371964133 None] Flow 'volume_create_manager' (88e5f542-d076-4ca0-89bd-1af129549665) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:58:33 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-9df83d52-6b67-416a-9dd2-b8d197dad78a tempest-VolumesActionsTest-1371964133 None] Created volume successfully.
Apr 15 15:58:33 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6262ecd-641b-4214-9d82-f63b3150a01e tempest-CinderUnicodeTest-691955740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:58:33 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b6262ecd-641b-4214-9d82-f63b3150a01e tempest-CinderUnicodeTest-691955740 None] Flow 'volume_create_manager' (8dba4fe6-4c7c-484d-9d03-f657d9cf5955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:58:33 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b6262ecd-641b-4214-9d82-f63b3150a01e tempest-CinderUnicodeTest-691955740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (659013d5-9b0d-47c4-a4ef-73fb107f207f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:33 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b6262ecd-641b-4214-9d82-f63b3150a01e tempest-CinderUnicodeTest-691955740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (659013d5-9b0d-47c4-a4ef-73fb107f207f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:58:34Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-440972513',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc51b520-3c9f-423c-a3de-83c3a4d620f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04017b257bdc4922afecdeec471d32e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:58:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:58:34Z,use_quota=True,user_id='6e01cf1b69dc4d73863db1029ba52182',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:33 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b6262ecd-641b-4214-9d82-f63b3150a01e tempest-CinderUnicodeTest-691955740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4737a350-9925-4812-be01-da3d68805876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:33 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b6262ecd-641b-4214-9d82-f63b3150a01e tempest-CinderUnicodeTest-691955740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4737a350-9925-4812-be01-da3d68805876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:33 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b6262ecd-641b-4214-9d82-f63b3150a01e tempest-CinderUnicodeTest-691955740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (250d100b-b2ba-4818-85ae-077814211864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:33 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b6262ecd-641b-4214-9d82-f63b3150a01e tempest-CinderUnicodeTest-691955740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (250d100b-b2ba-4818-85ae-077814211864) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc51b520-3c9f-423c-a3de-83c3a4d620f3', 'volume_name': 'volume-fc51b520-3c9f-423c-a3de-83c3a4d620f3', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:33 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b6262ecd-641b-4214-9d82-f63b3150a01e tempest-CinderUnicodeTest-691955740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e1b6656-9c25-4bbb-adcb-554a618e313a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:33 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b6262ecd-641b-4214-9d82-f63b3150a01e tempest-CinderUnicodeTest-691955740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e1b6656-9c25-4bbb-adcb-554a618e313a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:33 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b6262ecd-641b-4214-9d82-f63b3150a01e tempest-CinderUnicodeTest-691955740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (387eb769-135a-426b-9a23-b5ee6a0484fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:33 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-b6262ecd-641b-4214-9d82-f63b3150a01e tempest-CinderUnicodeTest-691955740 None] Volume fc51b520-3c9f-423c-a3de-83c3a4d620f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc51b520-3c9f-423c-a3de-83c3a4d620f3', 'volume_size': 1}
Apr 15 15:58:33 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-b6262ecd-641b-4214-9d82-f63b3150a01e tempest-CinderUnicodeTest-691955740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:58:33 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-b6262ecd-641b-4214-9d82-f63b3150a01e tempest-CinderUnicodeTest-691955740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:58:33 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-b6262ecd-641b-4214-9d82-f63b3150a01e tempest-CinderUnicodeTest-691955740 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:58:34Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-440972513',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc51b520-3c9f-423c-a3de-83c3a4d620f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04017b257bdc4922afecdeec471d32e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:58:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:58:34Z,use_quota=True,user_id='6e01cf1b69dc4d73863db1029ba52182',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:58:33 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-b6262ecd-641b-4214-9d82-f63b3150a01e tempest-CinderUnicodeTest-691955740 None] Creating volume fc51b520-3c9f-423c-a3de-83c3a4d620f3 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:58:33 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-b6262ecd-641b-4214-9d82-f63b3150a01e tempest-CinderUnicodeTest-691955740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:58:33 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-b6262ecd-641b-4214-9d82-f63b3150a01e tempest-CinderUnicodeTest-691955740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:58:33 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-b6262ecd-641b-4214-9d82-f63b3150a01e tempest-CinderUnicodeTest-691955740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:58:33 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-b6262ecd-641b-4214-9d82-f63b3150a01e tempest-CinderUnicodeTest-691955740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:58:33 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-b6262ecd-641b-4214-9d82-f63b3150a01e tempest-CinderUnicodeTest-691955740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:58:33 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-b6262ecd-641b-4214-9d82-f63b3150a01e tempest-CinderUnicodeTest-691955740 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:58:33 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-b6262ecd-641b-4214-9d82-f63b3150a01e tempest-CinderUnicodeTest-691955740 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:58:33 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b6262ecd-641b-4214-9d82-f63b3150a01e tempest-CinderUnicodeTest-691955740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fc51b520-3c9f-423c-a3de-83c3a4d620f3 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:33 devstack sudo[88857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fc51b520-3c9f-423c-a3de-83c3a4d620f3 1073741824
Apr 15 15:58:33 devstack sudo[88857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:34 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-5a9a9461-5032-4917-b99a-0172bcbbce3e tempest-VolumesActionsTest-1371964133 None] Acquiring lock "cinder-fea466c6-f825-4489-a631-09d70f6efce3-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:58:34 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-5a9a9461-5032-4917-b99a-0172bcbbce3e tempest-VolumesActionsTest-1371964133 None] Lock "cinder-fea466c6-f825-4489-a631-09d70f6efce3-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:58:34 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-36f4e289-20e8-4c75-b15e-b5781cfa8b1a tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:58:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-36f4e289-20e8-4c75-b15e-b5781cfa8b1a tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Flow 'volume_create_manager' (7d82d7c3-7bce-4720-948b-c3d8e1ce8b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:58:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-36f4e289-20e8-4c75-b15e-b5781cfa8b1a tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7d53f8f-2bbe-431a-980f-e99e1078f199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:34 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-5a9a9461-5032-4917-b99a-0172bcbbce3e tempest-VolumesActionsTest-1371964133 None] Acquiring lock "cinder-quobyte-fea466c6-f825-4489-a631-09d70f6efce3" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:58:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-36f4e289-20e8-4c75-b15e-b5781cfa8b1a tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7d53f8f-2bbe-431a-980f-e99e1078f199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:58:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-944547214',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dfad17a-85d1-4d53-961d-50fbb90e17e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b188c06bf6ef486db601a0b5ac77c209',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:58:34Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:58:34Z,use_quota=True,user_id='0e80cd243af04079b921b20d67d31e02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-36f4e289-20e8-4c75-b15e-b5781cfa8b1a tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (154b8a4b-2f11-4671-9874-a295eea0d16c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-36f4e289-20e8-4c75-b15e-b5781cfa8b1a tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (154b8a4b-2f11-4671-9874-a295eea0d16c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-36f4e289-20e8-4c75-b15e-b5781cfa8b1a tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0d07be6-712b-4216-86ca-4f3980898907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-36f4e289-20e8-4c75-b15e-b5781cfa8b1a tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0d07be6-712b-4216-86ca-4f3980898907) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dfad17a-85d1-4d53-961d-50fbb90e17e7', 'volume_name': 'volume-3dfad17a-85d1-4d53-961d-50fbb90e17e7', 'volume_size': 2}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-36f4e289-20e8-4c75-b15e-b5781cfa8b1a tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd4bf10e-caef-47ea-98dc-759d029d1912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-36f4e289-20e8-4c75-b15e-b5781cfa8b1a tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd4bf10e-caef-47ea-98dc-759d029d1912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-36f4e289-20e8-4c75-b15e-b5781cfa8b1a tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e36ac3a-cf3c-47be-b85d-8e305a606693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:34 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-36f4e289-20e8-4c75-b15e-b5781cfa8b1a tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Volume 3dfad17a-85d1-4d53-961d-50fbb90e17e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dfad17a-85d1-4d53-961d-50fbb90e17e7', 'volume_size': 2}
Apr 15 15:58:34 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-36f4e289-20e8-4c75-b15e-b5781cfa8b1a tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:58:34 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-5a9a9461-5032-4917-b99a-0172bcbbce3e tempest-VolumesActionsTest-1371964133 None] Lock "cinder-quobyte-fea466c6-f825-4489-a631-09d70f6efce3" acquired by "delete_volume" :: waited 0.053s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:58:34 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f38aec2-b1f6-4c5b-b601-3965272e7f36]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:58:34 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-5a9a9461-5032-4917-b99a-0172bcbbce3e tempest-VolumesActionsTest-1371964133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fea466c6-f825-4489-a631-09d70f6efce3 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:34 devstack sudo[88862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fea466c6-f825-4489-a631-09d70f6efce3
Apr 15 15:58:34 devstack sudo[88862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:34 devstack sudo[88857]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:34 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b6262ecd-641b-4214-9d82-f63b3150a01e tempest-CinderUnicodeTest-691955740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fc51b520-3c9f-423c-a3de-83c3a4d620f3 1073741824" returned: 0 in 0.589s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:34 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b6262ecd-641b-4214-9d82-f63b3150a01e tempest-CinderUnicodeTest-691955740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fc51b520-3c9f-423c-a3de-83c3a4d620f3 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:34 devstack sudo[88865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fc51b520-3c9f-423c-a3de-83c3a4d620f3
Apr 15 15:58:34 devstack sudo[88865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:34 devstack sudo[88862]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:34 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-5a9a9461-5032-4917-b99a-0172bcbbce3e tempest-VolumesActionsTest-1371964133 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fea466c6-f825-4489-a631-09d70f6efce3" returned: 0 in 0.502s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:34 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-5a9a9461-5032-4917-b99a-0172bcbbce3e tempest-VolumesActionsTest-1371964133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fea466c6-f825-4489-a631-09d70f6efce3 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:34 devstack sudo[88865]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:34 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b6262ecd-641b-4214-9d82-f63b3150a01e tempest-CinderUnicodeTest-691955740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fc51b520-3c9f-423c-a3de-83c3a4d620f3" returned: 0 in 0.420s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:34 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-b6262ecd-641b-4214-9d82-f63b3150a01e tempest-CinderUnicodeTest-691955740 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:58:34 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-b6262ecd-641b-4214-9d82-f63b3150a01e tempest-CinderUnicodeTest-691955740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:58:34 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-36f4e289-20e8-4c75-b15e-b5781cfa8b1a tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.537s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:58:34 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-36f4e289-20e8-4c75-b15e-b5781cfa8b1a tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:58:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-944547214',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dfad17a-85d1-4d53-961d-50fbb90e17e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b188c06bf6ef486db601a0b5ac77c209',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:58:34Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:58:34Z,use_quota=True,user_id='0e80cd243af04079b921b20d67d31e02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:58:34 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-36f4e289-20e8-4c75-b15e-b5781cfa8b1a tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Creating volume 3dfad17a-85d1-4d53-961d-50fbb90e17e7 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:58:34 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-36f4e289-20e8-4c75-b15e-b5781cfa8b1a tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:58:34 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-36f4e289-20e8-4c75-b15e-b5781cfa8b1a tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:58:34 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-36f4e289-20e8-4c75-b15e-b5781cfa8b1a tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:58:34 devstack sudo[88877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fea466c6-f825-4489-a631-09d70f6efce3
Apr 15 15:58:34 devstack sudo[88877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:34 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-36f4e289-20e8-4c75-b15e-b5781cfa8b1a tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:58:34 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-36f4e289-20e8-4c75-b15e-b5781cfa8b1a tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:58:34 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-36f4e289-20e8-4c75-b15e-b5781cfa8b1a tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:58:34 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-36f4e289-20e8-4c75-b15e-b5781cfa8b1a tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:58:34 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-36f4e289-20e8-4c75-b15e-b5781cfa8b1a tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3dfad17a-85d1-4d53-961d-50fbb90e17e7 2147483648 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b6262ecd-641b-4214-9d82-f63b3150a01e tempest-CinderUnicodeTest-691955740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (387eb769-135a-426b-9a23-b5ee6a0484fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc51b520-3c9f-423c-a3de-83c3a4d620f3', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b6262ecd-641b-4214-9d82-f63b3150a01e tempest-CinderUnicodeTest-691955740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b61c990d-a3b2-4780-baf0-774c671a499a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:34 devstack sudo[88879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3dfad17a-85d1-4d53-961d-50fbb90e17e7 2147483648
Apr 15 15:58:34 devstack sudo[88879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:34 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-b6262ecd-641b-4214-9d82-f63b3150a01e tempest-CinderUnicodeTest-691955740 None] Volume volume-fc51b520-3c9f-423c-a3de-83c3a4d620f3 (fc51b520-3c9f-423c-a3de-83c3a4d620f3): created successfully
Apr 15 15:58:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b6262ecd-641b-4214-9d82-f63b3150a01e tempest-CinderUnicodeTest-691955740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b61c990d-a3b2-4780-baf0-774c671a499a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b6262ecd-641b-4214-9d82-f63b3150a01e tempest-CinderUnicodeTest-691955740 None] Flow 'volume_create_manager' (8dba4fe6-4c7c-484d-9d03-f657d9cf5955) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:58:34 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-b6262ecd-641b-4214-9d82-f63b3150a01e tempest-CinderUnicodeTest-691955740 None] Created volume successfully.
Apr 15 15:58:35 devstack sudo[88877]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:35 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-5a9a9461-5032-4917-b99a-0172bcbbce3e tempest-VolumesActionsTest-1371964133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fea466c6-f825-4489-a631-09d70f6efce3" returned: 0 in 0.419s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:35 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-5a9a9461-5032-4917-b99a-0172bcbbce3e tempest-VolumesActionsTest-1371964133 None] Lock "cinder-quobyte-fea466c6-f825-4489-a631-09d70f6efce3" released by "delete_volume" :: held 0.939s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:58:35 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-5a9a9461-5032-4917-b99a-0172bcbbce3e tempest-VolumesActionsTest-1371964133 None] Created reservations ['3603ac51-8557-49f8-8e17-e23603ef81b4', 'bfea347d-8325-431c-b5ca-8287149d116c', 'b97b04db-723a-4279-9f88-79fa42218261', 'a051b045-2c98-4069-9097-8ae4804f8dc8'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:58:35 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-5a9a9461-5032-4917-b99a-0172bcbbce3e tempest-VolumesActionsTest-1371964133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:58:35 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-5a9a9461-5032-4917-b99a-0172bcbbce3e tempest-VolumesActionsTest-1371964133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:58:35 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-5a9a9461-5032-4917-b99a-0172bcbbce3e tempest-VolumesActionsTest-1371964133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:58:35 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-5a9a9461-5032-4917-b99a-0172bcbbce3e tempest-VolumesActionsTest-1371964133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:58:35 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-5a9a9461-5032-4917-b99a-0172bcbbce3e tempest-VolumesActionsTest-1371964133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:58:35 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-5a9a9461-5032-4917-b99a-0172bcbbce3e tempest-VolumesActionsTest-1371964133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:35 devstack sudo[88885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:58:35 devstack sudo[88885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:35 devstack sudo[88879]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:35 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-36f4e289-20e8-4c75-b15e-b5781cfa8b1a tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3dfad17a-85d1-4d53-961d-50fbb90e17e7 2147483648" returned: 0 in 0.556s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:35 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-36f4e289-20e8-4c75-b15e-b5781cfa8b1a tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3dfad17a-85d1-4d53-961d-50fbb90e17e7 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:35 devstack sudo[88887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3dfad17a-85d1-4d53-961d-50fbb90e17e7
Apr 15 15:58:35 devstack sudo[88887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:35 devstack sudo[88885]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:35 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-5a9a9461-5032-4917-b99a-0172bcbbce3e tempest-VolumesActionsTest-1371964133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.407s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:35 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-5a9a9461-5032-4917-b99a-0172bcbbce3e tempest-VolumesActionsTest-1371964133 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:58:35 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-5a9a9461-5032-4917-b99a-0172bcbbce3e tempest-VolumesActionsTest-1371964133 None] Deleted volume successfully.
Apr 15 15:58:35 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-5a9a9461-5032-4917-b99a-0172bcbbce3e tempest-VolumesActionsTest-1371964133 None] Lock "cinder-fea466c6-f825-4489-a631-09d70f6efce3-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:58:35 devstack sudo[88887]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:35 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-36f4e289-20e8-4c75-b15e-b5781cfa8b1a tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3dfad17a-85d1-4d53-961d-50fbb90e17e7" returned: 0 in 0.426s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:35 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-36f4e289-20e8-4c75-b15e-b5781cfa8b1a tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:58:35 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-36f4e289-20e8-4c75-b15e-b5781cfa8b1a tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:58:35 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-36f4e289-20e8-4c75-b15e-b5781cfa8b1a tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e36ac3a-cf3c-47be-b85d-8e305a606693) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dfad17a-85d1-4d53-961d-50fbb90e17e7', 'volume_size': 2}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:35 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-36f4e289-20e8-4c75-b15e-b5781cfa8b1a tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0174cfd0-1fc1-49b2-af12-f30f6fb30595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:35 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-36f4e289-20e8-4c75-b15e-b5781cfa8b1a tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Volume volume-3dfad17a-85d1-4d53-961d-50fbb90e17e7 (3dfad17a-85d1-4d53-961d-50fbb90e17e7): created successfully
Apr 15 15:58:35 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-36f4e289-20e8-4c75-b15e-b5781cfa8b1a tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0174cfd0-1fc1-49b2-af12-f30f6fb30595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:35 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-36f4e289-20e8-4c75-b15e-b5781cfa8b1a tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Flow 'volume_create_manager' (7d82d7c3-7bce-4720-948b-c3d8e1ce8b3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:58:35 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-36f4e289-20e8-4c75-b15e-b5781cfa8b1a tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Created volume successfully.
Apr 15 15:58:36 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-6ff20f0d-6006-4960-825d-106153ab5f02 tempest-CinderUnicodeTest-691955740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:58:36 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-6ff20f0d-6006-4960-825d-106153ab5f02 tempest-CinderUnicodeTest-691955740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:58:36 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-6ff20f0d-6006-4960-825d-106153ab5f02 tempest-CinderUnicodeTest-691955740 None] Creating offline snapshot ffbe3168-71f4-4305-8aad-4543e6d3e321 of volume fc51b520-3c9f-423c-a3de-83c3a4d620f3 {{(pid=82485) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 15:58:36 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a3d767-85e5-45ad-994c-45b301e30dac]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:58:36 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6ff20f0d-6006-4960-825d-106153ab5f02 tempest-CinderUnicodeTest-691955740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fc51b520-3c9f-423c-a3de-83c3a4d620f3 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:36 devstack sudo[88891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fc51b520-3c9f-423c-a3de-83c3a4d620f3
Apr 15 15:58:36 devstack sudo[88891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:36 devstack sudo[88891]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:36 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6ff20f0d-6006-4960-825d-106153ab5f02 tempest-CinderUnicodeTest-691955740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fc51b520-3c9f-423c-a3de-83c3a4d620f3" returned: 0 in 0.482s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:36 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6ff20f0d-6006-4960-825d-106153ab5f02 tempest-CinderUnicodeTest-691955740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fc51b520-3c9f-423c-a3de-83c3a4d620f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fc51b520-3c9f-423c-a3de-83c3a4d620f3.ffbe3168-71f4-4305-8aad-4543e6d3e321 1G {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:36 devstack sudo[88896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fc51b520-3c9f-423c-a3de-83c3a4d620f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fc51b520-3c9f-423c-a3de-83c3a4d620f3.ffbe3168-71f4-4305-8aad-4543e6d3e321 1G
Apr 15 15:58:36 devstack sudo[88896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:36 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-57c138be-f73d-4c15-bb9d-6c21b46efee7 tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:58:37 devstack sudo[88896]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:37 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6ff20f0d-6006-4960-825d-106153ab5f02 tempest-CinderUnicodeTest-691955740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fc51b520-3c9f-423c-a3de-83c3a4d620f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fc51b520-3c9f-423c-a3de-83c3a4d620f3.ffbe3168-71f4-4305-8aad-4543e6d3e321 1G" returned: 0 in 0.571s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:37 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6ff20f0d-6006-4960-825d-106153ab5f02 tempest-CinderUnicodeTest-691955740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc51b520-3c9f-423c-a3de-83c3a4d620f3 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fc51b520-3c9f-423c-a3de-83c3a4d620f3.ffbe3168-71f4-4305-8aad-4543e6d3e321 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:37 devstack sudo[88901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc51b520-3c9f-423c-a3de-83c3a4d620f3 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fc51b520-3c9f-423c-a3de-83c3a4d620f3.ffbe3168-71f4-4305-8aad-4543e6d3e321
Apr 15 15:58:37 devstack sudo[88901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:37 devstack sudo[88901]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:37 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6ff20f0d-6006-4960-825d-106153ab5f02 tempest-CinderUnicodeTest-691955740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc51b520-3c9f-423c-a3de-83c3a4d620f3 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fc51b520-3c9f-423c-a3de-83c3a4d620f3.ffbe3168-71f4-4305-8aad-4543e6d3e321" returned: 0 in 0.474s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:37 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-6ff20f0d-6006-4960-825d-106153ab5f02 tempest-CinderUnicodeTest-691955740 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fc51b520-3c9f-423c-a3de-83c3a4d620f3.ffbe3168-71f4-4305-8aad-4543e6d3e321 is being set with open permissions: ugo+rw
Apr 15 15:58:37 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6ff20f0d-6006-4960-825d-106153ab5f02 tempest-CinderUnicodeTest-691955740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fc51b520-3c9f-423c-a3de-83c3a4d620f3.ffbe3168-71f4-4305-8aad-4543e6d3e321 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:37 devstack sudo[88907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fc51b520-3c9f-423c-a3de-83c3a4d620f3.ffbe3168-71f4-4305-8aad-4543e6d3e321
Apr 15 15:58:37 devstack sudo[88907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:38 devstack sudo[88907]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:38 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6ff20f0d-6006-4960-825d-106153ab5f02 tempest-CinderUnicodeTest-691955740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fc51b520-3c9f-423c-a3de-83c3a4d620f3.ffbe3168-71f4-4305-8aad-4543e6d3e321" returned: 0 in 0.431s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:38 devstack cinder-volume[82485]: DEBUG dbcounter [-] [82485] Writing DB stats cinder:SELECT=125,cinder:INSERT=34,cinder:UPDATE=146,cinder:DELETE=10 {{(pid=82485) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 15:58:38 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6ff20f0d-6006-4960-825d-106153ab5f02 tempest-CinderUnicodeTest-691955740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fc51b520-3c9f-423c-a3de-83c3a4d620f3.info {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:38 devstack sudo[88910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fc51b520-3c9f-423c-a3de-83c3a4d620f3.info
Apr 15 15:58:38 devstack sudo[88910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:38 devstack sudo[88910]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:38 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6ff20f0d-6006-4960-825d-106153ab5f02 tempest-CinderUnicodeTest-691955740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fc51b520-3c9f-423c-a3de-83c3a4d620f3.info" returned: 0 in 0.453s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:38 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-6ff20f0d-6006-4960-825d-106153ab5f02 tempest-CinderUnicodeTest-691955740 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fc51b520-3c9f-423c-a3de-83c3a4d620f3.info is being set with open permissions: ugo+rw
Apr 15 15:58:38 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6ff20f0d-6006-4960-825d-106153ab5f02 tempest-CinderUnicodeTest-691955740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fc51b520-3c9f-423c-a3de-83c3a4d620f3.info {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:38 devstack sudo[88913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fc51b520-3c9f-423c-a3de-83c3a4d620f3.info
Apr 15 15:58:38 devstack sudo[88913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:38 devstack sudo[88913]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:38 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6ff20f0d-6006-4960-825d-106153ab5f02 tempest-CinderUnicodeTest-691955740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fc51b520-3c9f-423c-a3de-83c3a4d620f3.info" returned: 0 in 0.421s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:38 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-6ff20f0d-6006-4960-825d-106153ab5f02 tempest-CinderUnicodeTest-691955740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.897s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:58:38 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-57c138be-f73d-4c15-bb9d-6c21b46efee7 tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.228s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:58:38 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-57c138be-f73d-4c15-bb9d-6c21b46efee7 tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Creating offline snapshot e3934ecd-13e1-4858-bdb6-232441c78b40 of volume 3dfad17a-85d1-4d53-961d-50fbb90e17e7 {{(pid=82485) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 15:58:39 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-6ff20f0d-6006-4960-825d-106153ab5f02 tempest-CinderUnicodeTest-691955740 None] Create snapshot completed successfully
Apr 15 15:58:39 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ec9207-d686-47d4-9e0d-817318ef7569]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:58:39 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-57c138be-f73d-4c15-bb9d-6c21b46efee7 tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3dfad17a-85d1-4d53-961d-50fbb90e17e7 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:39 devstack sudo[88917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3dfad17a-85d1-4d53-961d-50fbb90e17e7
Apr 15 15:58:39 devstack sudo[88917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:39 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-63db5520-3adb-4a5d-9cba-82bc6a19bf14 tempest-CinderUnicodeTest-691955740 None] Acquiring lock "cinder-ffbe3168-71f4-4305-8aad-4543e6d3e321-delete_snapshot" by "delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:58:39 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-63db5520-3adb-4a5d-9cba-82bc6a19bf14 tempest-CinderUnicodeTest-691955740 None] Lock "cinder-ffbe3168-71f4-4305-8aad-4543e6d3e321-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:58:39 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-63db5520-3adb-4a5d-9cba-82bc6a19bf14 tempest-CinderUnicodeTest-691955740 None] Acquiring lock "cinder-quobyte-fc51b520-3c9f-423c-a3de-83c3a4d620f3" by "delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:58:39 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-63db5520-3adb-4a5d-9cba-82bc6a19bf14 tempest-CinderUnicodeTest-691955740 None] Lock "cinder-quobyte-fc51b520-3c9f-423c-a3de-83c3a4d620f3" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:58:39 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-63db5520-3adb-4a5d-9cba-82bc6a19bf14 tempest-CinderUnicodeTest-691955740 None] Acquiring lock "cinder-quobyte-ffbe3168-71f4-4305-8aad-4543e6d3e321" by "_delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:58:39 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-63db5520-3adb-4a5d-9cba-82bc6a19bf14 tempest-CinderUnicodeTest-691955740 None] Lock "cinder-quobyte-ffbe3168-71f4-4305-8aad-4543e6d3e321" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:58:39 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-63db5520-3adb-4a5d-9cba-82bc6a19bf14 tempest-CinderUnicodeTest-691955740 None] Deleting offline snapshot ffbe3168-71f4-4305-8aad-4543e6d3e321 of volume fc51b520-3c9f-423c-a3de-83c3a4d620f3 {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 15:58:39 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-63db5520-3adb-4a5d-9cba-82bc6a19bf14 tempest-CinderUnicodeTest-691955740 None] snapshot_file for this snap is: volume-fc51b520-3c9f-423c-a3de-83c3a4d620f3.ffbe3168-71f4-4305-8aad-4543e6d3e321 {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 15:58:39 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c36655-b331-4c39-b645-0da69ec5fdc4]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:58:39 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-63db5520-3adb-4a5d-9cba-82bc6a19bf14 tempest-CinderUnicodeTest-691955740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fc51b520-3c9f-423c-a3de-83c3a4d620f3.ffbe3168-71f4-4305-8aad-4543e6d3e321 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:39 devstack sudo[88919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fc51b520-3c9f-423c-a3de-83c3a4d620f3.ffbe3168-71f4-4305-8aad-4543e6d3e321
Apr 15 15:58:39 devstack sudo[88919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:39 devstack sudo[88917]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:39 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-57c138be-f73d-4c15-bb9d-6c21b46efee7 tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3dfad17a-85d1-4d53-961d-50fbb90e17e7" returned: 0 in 0.560s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:39 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-57c138be-f73d-4c15-bb9d-6c21b46efee7 tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3dfad17a-85d1-4d53-961d-50fbb90e17e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3dfad17a-85d1-4d53-961d-50fbb90e17e7.e3934ecd-13e1-4858-bdb6-232441c78b40 2G {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:39 devstack sudo[88924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3dfad17a-85d1-4d53-961d-50fbb90e17e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3dfad17a-85d1-4d53-961d-50fbb90e17e7.e3934ecd-13e1-4858-bdb6-232441c78b40 2G
Apr 15 15:58:39 devstack sudo[88924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:39 devstack sudo[88919]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:39 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-63db5520-3adb-4a5d-9cba-82bc6a19bf14 tempest-CinderUnicodeTest-691955740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fc51b520-3c9f-423c-a3de-83c3a4d620f3.ffbe3168-71f4-4305-8aad-4543e6d3e321" returned: 0 in 0.537s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:39 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-63db5520-3adb-4a5d-9cba-82bc6a19bf14 tempest-CinderUnicodeTest-691955740 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc51b520-3c9f-423c-a3de-83c3a4d620f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82485) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 15:58:39 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[a663f9af-e013-47b3-aa36-20124b8b3684]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:58:39 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-63db5520-3adb-4a5d-9cba-82bc6a19bf14 tempest-CinderUnicodeTest-691955740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fc51b520-3c9f-423c-a3de-83c3a4d620f3 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:39 devstack sudo[88929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fc51b520-3c9f-423c-a3de-83c3a4d620f3
Apr 15 15:58:39 devstack sudo[88929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:40 devstack sudo[88924]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:40 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-57c138be-f73d-4c15-bb9d-6c21b46efee7 tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3dfad17a-85d1-4d53-961d-50fbb90e17e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3dfad17a-85d1-4d53-961d-50fbb90e17e7.e3934ecd-13e1-4858-bdb6-232441c78b40 2G" returned: 0 in 0.573s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:40 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-57c138be-f73d-4c15-bb9d-6c21b46efee7 tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dfad17a-85d1-4d53-961d-50fbb90e17e7 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3dfad17a-85d1-4d53-961d-50fbb90e17e7.e3934ecd-13e1-4858-bdb6-232441c78b40 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:40 devstack sudo[88935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dfad17a-85d1-4d53-961d-50fbb90e17e7 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3dfad17a-85d1-4d53-961d-50fbb90e17e7.e3934ecd-13e1-4858-bdb6-232441c78b40
Apr 15 15:58:40 devstack sudo[88935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:40 devstack sudo[88929]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:40 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-63db5520-3adb-4a5d-9cba-82bc6a19bf14 tempest-CinderUnicodeTest-691955740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fc51b520-3c9f-423c-a3de-83c3a4d620f3" returned: 0 in 0.525s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:40 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-63db5520-3adb-4a5d-9cba-82bc6a19bf14 tempest-CinderUnicodeTest-691955740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fc51b520-3c9f-423c-a3de-83c3a4d620f3.ffbe3168-71f4-4305-8aad-4543e6d3e321 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:40 devstack sudo[88940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fc51b520-3c9f-423c-a3de-83c3a4d620f3.ffbe3168-71f4-4305-8aad-4543e6d3e321
Apr 15 15:58:40 devstack sudo[88940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:40 devstack sudo[88935]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:40 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-57c138be-f73d-4c15-bb9d-6c21b46efee7 tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dfad17a-85d1-4d53-961d-50fbb90e17e7 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3dfad17a-85d1-4d53-961d-50fbb90e17e7.e3934ecd-13e1-4858-bdb6-232441c78b40" returned: 0 in 0.476s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:40 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-57c138be-f73d-4c15-bb9d-6c21b46efee7 tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3dfad17a-85d1-4d53-961d-50fbb90e17e7.e3934ecd-13e1-4858-bdb6-232441c78b40 is being set with open permissions: ugo+rw
Apr 15 15:58:40 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-57c138be-f73d-4c15-bb9d-6c21b46efee7 tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3dfad17a-85d1-4d53-961d-50fbb90e17e7.e3934ecd-13e1-4858-bdb6-232441c78b40 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:40 devstack sudo[88945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3dfad17a-85d1-4d53-961d-50fbb90e17e7.e3934ecd-13e1-4858-bdb6-232441c78b40
Apr 15 15:58:40 devstack sudo[88945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:40 devstack sudo[88940]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:40 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-63db5520-3adb-4a5d-9cba-82bc6a19bf14 tempest-CinderUnicodeTest-691955740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fc51b520-3c9f-423c-a3de-83c3a4d620f3.ffbe3168-71f4-4305-8aad-4543e6d3e321" returned: 0 in 0.552s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:40 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-63db5520-3adb-4a5d-9cba-82bc6a19bf14 tempest-CinderUnicodeTest-691955740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fc51b520-3c9f-423c-a3de-83c3a4d620f3.ffbe3168-71f4-4305-8aad-4543e6d3e321 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:40 devstack sudo[88950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fc51b520-3c9f-423c-a3de-83c3a4d620f3.ffbe3168-71f4-4305-8aad-4543e6d3e321
Apr 15 15:58:40 devstack sudo[88950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:41 devstack sudo[88945]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:41 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-57c138be-f73d-4c15-bb9d-6c21b46efee7 tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3dfad17a-85d1-4d53-961d-50fbb90e17e7.e3934ecd-13e1-4858-bdb6-232441c78b40" returned: 0 in 0.463s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:41 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-57c138be-f73d-4c15-bb9d-6c21b46efee7 tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3dfad17a-85d1-4d53-961d-50fbb90e17e7.info {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:41 devstack sudo[88985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3dfad17a-85d1-4d53-961d-50fbb90e17e7.info
Apr 15 15:58:41 devstack sudo[88985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:41 devstack sudo[88950]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:41 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-63db5520-3adb-4a5d-9cba-82bc6a19bf14 tempest-CinderUnicodeTest-691955740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fc51b520-3c9f-423c-a3de-83c3a4d620f3.ffbe3168-71f4-4305-8aad-4543e6d3e321" returned: 0 in 0.511s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:41 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-63db5520-3adb-4a5d-9cba-82bc6a19bf14 tempest-CinderUnicodeTest-691955740 None] Lock "cinder-quobyte-ffbe3168-71f4-4305-8aad-4543e6d3e321" released by "_delete_snapshot" :: held 2.190s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:58:41 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-63db5520-3adb-4a5d-9cba-82bc6a19bf14 tempest-CinderUnicodeTest-691955740 None] Lock "cinder-quobyte-fc51b520-3c9f-423c-a3de-83c3a4d620f3" released by "delete_snapshot" :: held 2.202s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:58:41 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-63db5520-3adb-4a5d-9cba-82bc6a19bf14 tempest-CinderUnicodeTest-691955740 None] Created reservations ['618a26ec-9904-4ed6-bda2-ca8b600ab601', 'ebe9bc1b-f52d-44ea-bb08-8188bc24d5f5', 'c399c210-c1ae-4f9f-845a-1dd34004b7f6', '4da409f2-3971-40cb-b1a9-dcfc22f29461'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:58:41 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-63db5520-3adb-4a5d-9cba-82bc6a19bf14 tempest-CinderUnicodeTest-691955740 None] Delete snapshot completed successfully.
Apr 15 15:58:41 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-63db5520-3adb-4a5d-9cba-82bc6a19bf14 tempest-CinderUnicodeTest-691955740 None] Lock "cinder-ffbe3168-71f4-4305-8aad-4543e6d3e321-delete_snapshot" released by "delete_snapshot" :: held 2.290s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:58:41 devstack sudo[88985]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:41 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-57c138be-f73d-4c15-bb9d-6c21b46efee7 tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3dfad17a-85d1-4d53-961d-50fbb90e17e7.info" returned: 0 in 0.521s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:41 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-57c138be-f73d-4c15-bb9d-6c21b46efee7 tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3dfad17a-85d1-4d53-961d-50fbb90e17e7.info is being set with open permissions: ugo+rw
Apr 15 15:58:41 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-57c138be-f73d-4c15-bb9d-6c21b46efee7 tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3dfad17a-85d1-4d53-961d-50fbb90e17e7.info {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:41 devstack sudo[88992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3dfad17a-85d1-4d53-961d-50fbb90e17e7.info
Apr 15 15:58:41 devstack sudo[88992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:42 devstack sudo[88992]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:42 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-57c138be-f73d-4c15-bb9d-6c21b46efee7 tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3dfad17a-85d1-4d53-961d-50fbb90e17e7.info" returned: 0 in 0.468s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:42 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-57c138be-f73d-4c15-bb9d-6c21b46efee7 tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.134s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:58:42 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-57c138be-f73d-4c15-bb9d-6c21b46efee7 tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Create snapshot completed successfully
Apr 15 15:58:42 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-2882077e-4a84-4185-bd90-3ad20c62512a tempest-CinderUnicodeTest-691955740 None] Acquiring lock "cinder-fc51b520-3c9f-423c-a3de-83c3a4d620f3-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:58:42 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-2882077e-4a84-4185-bd90-3ad20c62512a tempest-CinderUnicodeTest-691955740 None] Lock "cinder-fc51b520-3c9f-423c-a3de-83c3a4d620f3-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:58:42 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-2882077e-4a84-4185-bd90-3ad20c62512a tempest-CinderUnicodeTest-691955740 None] Acquiring lock "cinder-quobyte-fc51b520-3c9f-423c-a3de-83c3a4d620f3" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:58:42 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-2882077e-4a84-4185-bd90-3ad20c62512a tempest-CinderUnicodeTest-691955740 None] Lock "cinder-quobyte-fc51b520-3c9f-423c-a3de-83c3a4d620f3" acquired by "delete_volume" :: waited 0.016s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:58:42 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[8566c328-2c5f-4ee5-b78f-df690258e430]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:58:42 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-2882077e-4a84-4185-bd90-3ad20c62512a tempest-CinderUnicodeTest-691955740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fc51b520-3c9f-423c-a3de-83c3a4d620f3 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:42 devstack sudo[88995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fc51b520-3c9f-423c-a3de-83c3a4d620f3
Apr 15 15:58:42 devstack sudo[88995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:42 devstack sudo[88995]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:42 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-2882077e-4a84-4185-bd90-3ad20c62512a tempest-CinderUnicodeTest-691955740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fc51b520-3c9f-423c-a3de-83c3a4d620f3" returned: 0 in 0.518s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:42 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-2882077e-4a84-4185-bd90-3ad20c62512a tempest-CinderUnicodeTest-691955740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fc51b520-3c9f-423c-a3de-83c3a4d620f3 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:42 devstack sudo[89000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fc51b520-3c9f-423c-a3de-83c3a4d620f3
Apr 15 15:58:42 devstack sudo[89000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:43 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-0d41e259-1f89-41d8-9348-02fb90448ba5 tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Acquiring lock "cinder-e3934ecd-13e1-4858-bdb6-232441c78b40-delete_snapshot" by "delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:58:43 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-0d41e259-1f89-41d8-9348-02fb90448ba5 tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Lock "cinder-e3934ecd-13e1-4858-bdb6-232441c78b40-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:58:43 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-0d41e259-1f89-41d8-9348-02fb90448ba5 tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Acquiring lock "cinder-quobyte-3dfad17a-85d1-4d53-961d-50fbb90e17e7" by "delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:58:43 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-0d41e259-1f89-41d8-9348-02fb90448ba5 tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Lock "cinder-quobyte-3dfad17a-85d1-4d53-961d-50fbb90e17e7" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:58:43 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-0d41e259-1f89-41d8-9348-02fb90448ba5 tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Acquiring lock "cinder-quobyte-e3934ecd-13e1-4858-bdb6-232441c78b40" by "_delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:58:43 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-0d41e259-1f89-41d8-9348-02fb90448ba5 tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Lock "cinder-quobyte-e3934ecd-13e1-4858-bdb6-232441c78b40" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:58:43 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-0d41e259-1f89-41d8-9348-02fb90448ba5 tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Deleting offline snapshot e3934ecd-13e1-4858-bdb6-232441c78b40 of volume 3dfad17a-85d1-4d53-961d-50fbb90e17e7 {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 15:58:43 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-0d41e259-1f89-41d8-9348-02fb90448ba5 tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] snapshot_file for this snap is: volume-3dfad17a-85d1-4d53-961d-50fbb90e17e7.e3934ecd-13e1-4858-bdb6-232441c78b40 {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 15:58:43 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b93f27-76fe-459b-8550-6c09ccdfde0d]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:58:43 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-0d41e259-1f89-41d8-9348-02fb90448ba5 tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3dfad17a-85d1-4d53-961d-50fbb90e17e7.e3934ecd-13e1-4858-bdb6-232441c78b40 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:43 devstack sudo[89002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3dfad17a-85d1-4d53-961d-50fbb90e17e7.e3934ecd-13e1-4858-bdb6-232441c78b40
Apr 15 15:58:43 devstack sudo[89002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:43 devstack sudo[89000]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:43 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-2882077e-4a84-4185-bd90-3ad20c62512a tempest-CinderUnicodeTest-691955740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fc51b520-3c9f-423c-a3de-83c3a4d620f3" returned: 0 in 0.481s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:43 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-2882077e-4a84-4185-bd90-3ad20c62512a tempest-CinderUnicodeTest-691955740 None] Lock "cinder-quobyte-fc51b520-3c9f-423c-a3de-83c3a4d620f3" released by "delete_volume" :: held 1.035s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:58:43 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-2882077e-4a84-4185-bd90-3ad20c62512a tempest-CinderUnicodeTest-691955740 None] Created reservations ['599c6568-5ca5-4ad5-9f3a-c32f75e68f38', '10686786-328b-4fbe-80a1-82769097f3e3', '76c88a0e-6898-4733-8f24-fc5fba965e8b', 'b9fb0226-f2e8-4788-a914-94f36f97b2af'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:58:43 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-2882077e-4a84-4185-bd90-3ad20c62512a tempest-CinderUnicodeTest-691955740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:58:43 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-2882077e-4a84-4185-bd90-3ad20c62512a tempest-CinderUnicodeTest-691955740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:58:43 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-2882077e-4a84-4185-bd90-3ad20c62512a tempest-CinderUnicodeTest-691955740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:58:43 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-2882077e-4a84-4185-bd90-3ad20c62512a tempest-CinderUnicodeTest-691955740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:58:43 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-2882077e-4a84-4185-bd90-3ad20c62512a tempest-CinderUnicodeTest-691955740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:58:43 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-2882077e-4a84-4185-bd90-3ad20c62512a tempest-CinderUnicodeTest-691955740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:43 devstack sudo[89007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:58:43 devstack sudo[89007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:43 devstack sudo[89002]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:43 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-0d41e259-1f89-41d8-9348-02fb90448ba5 tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3dfad17a-85d1-4d53-961d-50fbb90e17e7.e3934ecd-13e1-4858-bdb6-232441c78b40" returned: 0 in 0.550s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:43 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-0d41e259-1f89-41d8-9348-02fb90448ba5 tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3dfad17a-85d1-4d53-961d-50fbb90e17e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82485) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 15:58:43 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae003df-c773-4e3e-9923-58785a3baf74]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:58:43 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-0d41e259-1f89-41d8-9348-02fb90448ba5 tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3dfad17a-85d1-4d53-961d-50fbb90e17e7 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:43 devstack sudo[89010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3dfad17a-85d1-4d53-961d-50fbb90e17e7
Apr 15 15:58:43 devstack sudo[89010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:43 devstack sudo[89007]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:43 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-2882077e-4a84-4185-bd90-3ad20c62512a tempest-CinderUnicodeTest-691955740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.432s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:43 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-2882077e-4a84-4185-bd90-3ad20c62512a tempest-CinderUnicodeTest-691955740 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:58:43 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-2882077e-4a84-4185-bd90-3ad20c62512a tempest-CinderUnicodeTest-691955740 None] Deleted volume successfully.
Apr 15 15:58:43 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-2882077e-4a84-4185-bd90-3ad20c62512a tempest-CinderUnicodeTest-691955740 None] Lock "cinder-fc51b520-3c9f-423c-a3de-83c3a4d620f3-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:58:44 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-43515f41-170e-4602-aa0d-db004af81227 tempest-VolumesListAdminTestJSON-1168971102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:58:44 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-43515f41-170e-4602-aa0d-db004af81227 tempest-VolumesListAdminTestJSON-1168971102 None] Flow 'volume_create_manager' (645773b3-a419-42f5-8fd0-bad29bffa89f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:58:44 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-43515f41-170e-4602-aa0d-db004af81227 tempest-VolumesListAdminTestJSON-1168971102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db5a86e6-400f-4f8b-b968-66b5c8a6143b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:44 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-43515f41-170e-4602-aa0d-db004af81227 tempest-VolumesListAdminTestJSON-1168971102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db5a86e6-400f-4f8b-b968-66b5c8a6143b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:58:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-887649626',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8abb057d-1cbc-41b2-84dc-28a763d1d5da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52ba462e76a148158336e08a9ec0852c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:58:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:58:44Z,use_quota=True,user_id='097a63b0e3784e0c9bfadf98a3562ecf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:44 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-43515f41-170e-4602-aa0d-db004af81227 tempest-VolumesListAdminTestJSON-1168971102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b34da04c-915f-4f07-80f3-375c48fc5205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:44 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-43515f41-170e-4602-aa0d-db004af81227 tempest-VolumesListAdminTestJSON-1168971102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b34da04c-915f-4f07-80f3-375c48fc5205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:44 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-43515f41-170e-4602-aa0d-db004af81227 tempest-VolumesListAdminTestJSON-1168971102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57702577-6aa6-4629-b2a9-34b11dc31926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:44 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-43515f41-170e-4602-aa0d-db004af81227 tempest-VolumesListAdminTestJSON-1168971102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57702577-6aa6-4629-b2a9-34b11dc31926) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8abb057d-1cbc-41b2-84dc-28a763d1d5da', 'volume_name': 'volume-8abb057d-1cbc-41b2-84dc-28a763d1d5da', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:44 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-43515f41-170e-4602-aa0d-db004af81227 tempest-VolumesListAdminTestJSON-1168971102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb96bb1a-c1a8-437e-86aa-a802d05204d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:44 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-43515f41-170e-4602-aa0d-db004af81227 tempest-VolumesListAdminTestJSON-1168971102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb96bb1a-c1a8-437e-86aa-a802d05204d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:44 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-43515f41-170e-4602-aa0d-db004af81227 tempest-VolumesListAdminTestJSON-1168971102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f32959bb-0a10-4597-b7ae-96c10304a9ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:44 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-43515f41-170e-4602-aa0d-db004af81227 tempest-VolumesListAdminTestJSON-1168971102 None] Volume 8abb057d-1cbc-41b2-84dc-28a763d1d5da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8abb057d-1cbc-41b2-84dc-28a763d1d5da', 'volume_size': 1}
Apr 15 15:58:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-43515f41-170e-4602-aa0d-db004af81227 tempest-VolumesListAdminTestJSON-1168971102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:58:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-43515f41-170e-4602-aa0d-db004af81227 tempest-VolumesListAdminTestJSON-1168971102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:58:44 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-43515f41-170e-4602-aa0d-db004af81227 tempest-VolumesListAdminTestJSON-1168971102 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:58:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-887649626',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8abb057d-1cbc-41b2-84dc-28a763d1d5da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52ba462e76a148158336e08a9ec0852c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:58:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:58:44Z,use_quota=True,user_id='097a63b0e3784e0c9bfadf98a3562ecf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:58:44 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-43515f41-170e-4602-aa0d-db004af81227 tempest-VolumesListAdminTestJSON-1168971102 None] Creating volume 8abb057d-1cbc-41b2-84dc-28a763d1d5da {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:58:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-43515f41-170e-4602-aa0d-db004af81227 tempest-VolumesListAdminTestJSON-1168971102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:58:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-43515f41-170e-4602-aa0d-db004af81227 tempest-VolumesListAdminTestJSON-1168971102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:58:44 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-43515f41-170e-4602-aa0d-db004af81227 tempest-VolumesListAdminTestJSON-1168971102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:58:44 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-43515f41-170e-4602-aa0d-db004af81227 tempest-VolumesListAdminTestJSON-1168971102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:58:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-43515f41-170e-4602-aa0d-db004af81227 tempest-VolumesListAdminTestJSON-1168971102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:58:44 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-43515f41-170e-4602-aa0d-db004af81227 tempest-VolumesListAdminTestJSON-1168971102 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:58:44 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-43515f41-170e-4602-aa0d-db004af81227 tempest-VolumesListAdminTestJSON-1168971102 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:58:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-43515f41-170e-4602-aa0d-db004af81227 tempest-VolumesListAdminTestJSON-1168971102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8abb057d-1cbc-41b2-84dc-28a763d1d5da 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:44 devstack sudo[89015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8abb057d-1cbc-41b2-84dc-28a763d1d5da 1073741824
Apr 15 15:58:44 devstack sudo[89015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:44 devstack sudo[89010]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-0d41e259-1f89-41d8-9348-02fb90448ba5 tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3dfad17a-85d1-4d53-961d-50fbb90e17e7" returned: 0 in 0.519s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-0d41e259-1f89-41d8-9348-02fb90448ba5 tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3dfad17a-85d1-4d53-961d-50fbb90e17e7.e3934ecd-13e1-4858-bdb6-232441c78b40 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:44 devstack sudo[89018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3dfad17a-85d1-4d53-961d-50fbb90e17e7.e3934ecd-13e1-4858-bdb6-232441c78b40
Apr 15 15:58:44 devstack sudo[89018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:44 devstack cinder-volume[82485]: DEBUG oslo_service.periodic_task [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82485) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 15 15:58:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:58:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:58:44 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:58:44 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:58:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:58:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:44 devstack sudo[89022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:58:44 devstack sudo[89022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:44 devstack sudo[89015]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:44 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-4e912050-6172-4173-a738-3a872a616002 tempest-CinderUnicodeTest-691955740 None] Acquiring lock "cinder-21ec4473-b979-4c52-a0e5-f8875be1e77b-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:58:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-43515f41-170e-4602-aa0d-db004af81227 tempest-VolumesListAdminTestJSON-1168971102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8abb057d-1cbc-41b2-84dc-28a763d1d5da 1073741824" returned: 0 in 0.507s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:44 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-4e912050-6172-4173-a738-3a872a616002 tempest-CinderUnicodeTest-691955740 None] Lock "cinder-21ec4473-b979-4c52-a0e5-f8875be1e77b-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:58:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-43515f41-170e-4602-aa0d-db004af81227 tempest-VolumesListAdminTestJSON-1168971102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8abb057d-1cbc-41b2-84dc-28a763d1d5da {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:44 devstack sudo[89029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8abb057d-1cbc-41b2-84dc-28a763d1d5da
Apr 15 15:58:44 devstack sudo[89029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:44 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-4e912050-6172-4173-a738-3a872a616002 tempest-CinderUnicodeTest-691955740 None] Acquiring lock "cinder-quobyte-21ec4473-b979-4c52-a0e5-f8875be1e77b" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:58:44 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-4e912050-6172-4173-a738-3a872a616002 tempest-CinderUnicodeTest-691955740 None] Lock "cinder-quobyte-21ec4473-b979-4c52-a0e5-f8875be1e77b" acquired by "delete_volume" :: waited 0.010s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:58:44 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aac676d-6289-4d60-be67-64a11cf3c9db]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:58:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4e912050-6172-4173-a738-3a872a616002 tempest-CinderUnicodeTest-691955740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-21ec4473-b979-4c52-a0e5-f8875be1e77b {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:44 devstack sudo[89018]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-0d41e259-1f89-41d8-9348-02fb90448ba5 tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3dfad17a-85d1-4d53-961d-50fbb90e17e7.e3934ecd-13e1-4858-bdb6-232441c78b40" returned: 0 in 0.534s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-0d41e259-1f89-41d8-9348-02fb90448ba5 tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3dfad17a-85d1-4d53-961d-50fbb90e17e7.e3934ecd-13e1-4858-bdb6-232441c78b40 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:44 devstack sudo[89032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3dfad17a-85d1-4d53-961d-50fbb90e17e7.e3934ecd-13e1-4858-bdb6-232441c78b40
Apr 15 15:58:44 devstack sudo[89032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:44 devstack sudo[89031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-21ec4473-b979-4c52-a0e5-f8875be1e77b
Apr 15 15:58:44 devstack sudo[89031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:44 devstack sudo[89022]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.453s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:44 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:58:45 devstack sudo[89029]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:45 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-43515f41-170e-4602-aa0d-db004af81227 tempest-VolumesListAdminTestJSON-1168971102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8abb057d-1cbc-41b2-84dc-28a763d1d5da" returned: 0 in 0.431s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:45 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-43515f41-170e-4602-aa0d-db004af81227 tempest-VolumesListAdminTestJSON-1168971102 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:58:45 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-43515f41-170e-4602-aa0d-db004af81227 tempest-VolumesListAdminTestJSON-1168971102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:58:45 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-43515f41-170e-4602-aa0d-db004af81227 tempest-VolumesListAdminTestJSON-1168971102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f32959bb-0a10-4597-b7ae-96c10304a9ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8abb057d-1cbc-41b2-84dc-28a763d1d5da', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:45 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-43515f41-170e-4602-aa0d-db004af81227 tempest-VolumesListAdminTestJSON-1168971102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ee93ab6-ddd1-4607-a6d2-32d5299cbc94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:45 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-43515f41-170e-4602-aa0d-db004af81227 tempest-VolumesListAdminTestJSON-1168971102 None] Volume volume-8abb057d-1cbc-41b2-84dc-28a763d1d5da (8abb057d-1cbc-41b2-84dc-28a763d1d5da): created successfully
Apr 15 15:58:45 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-43515f41-170e-4602-aa0d-db004af81227 tempest-VolumesListAdminTestJSON-1168971102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ee93ab6-ddd1-4607-a6d2-32d5299cbc94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:45 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-43515f41-170e-4602-aa0d-db004af81227 tempest-VolumesListAdminTestJSON-1168971102 None] Flow 'volume_create_manager' (645773b3-a419-42f5-8fd0-bad29bffa89f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:58:45 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-43515f41-170e-4602-aa0d-db004af81227 tempest-VolumesListAdminTestJSON-1168971102 None] Created volume successfully.
Apr 15 15:58:45 devstack sudo[89032]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:45 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-0d41e259-1f89-41d8-9348-02fb90448ba5 tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3dfad17a-85d1-4d53-961d-50fbb90e17e7.e3934ecd-13e1-4858-bdb6-232441c78b40" returned: 0 in 0.476s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:45 devstack sudo[89031]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:45 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4e912050-6172-4173-a738-3a872a616002 tempest-CinderUnicodeTest-691955740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-21ec4473-b979-4c52-a0e5-f8875be1e77b" returned: 0 in 0.522s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:45 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4e912050-6172-4173-a738-3a872a616002 tempest-CinderUnicodeTest-691955740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-21ec4473-b979-4c52-a0e5-f8875be1e77b {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:45 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-0d41e259-1f89-41d8-9348-02fb90448ba5 tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Lock "cinder-quobyte-e3934ecd-13e1-4858-bdb6-232441c78b40" released by "_delete_snapshot" :: held 2.149s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:58:45 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-0d41e259-1f89-41d8-9348-02fb90448ba5 tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Lock "cinder-quobyte-3dfad17a-85d1-4d53-961d-50fbb90e17e7" released by "delete_snapshot" :: held 2.163s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:58:45 devstack sudo[89041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-21ec4473-b979-4c52-a0e5-f8875be1e77b
Apr 15 15:58:45 devstack sudo[89041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:45 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-0d41e259-1f89-41d8-9348-02fb90448ba5 tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Created reservations ['b5779bad-f58d-4816-8e0f-dc8dcff227da', '761abf56-754e-45d7-a786-1659cd29d6b6', '629fc688-7e9d-4b40-a0f4-a0f5e5824998', '5cc9f8ad-1a33-439a-8ac8-d599dcdd06f5'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:58:45 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-0d41e259-1f89-41d8-9348-02fb90448ba5 tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Delete snapshot completed successfully.
Apr 15 15:58:45 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-0d41e259-1f89-41d8-9348-02fb90448ba5 tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Lock "cinder-e3934ecd-13e1-4858-bdb6-232441c78b40-delete_snapshot" released by "delete_snapshot" :: held 2.251s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:58:45 devstack sudo[89041]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:45 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4e912050-6172-4173-a738-3a872a616002 tempest-CinderUnicodeTest-691955740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-21ec4473-b979-4c52-a0e5-f8875be1e77b" returned: 0 in 0.399s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:45 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-4e912050-6172-4173-a738-3a872a616002 tempest-CinderUnicodeTest-691955740 None] Lock "cinder-quobyte-21ec4473-b979-4c52-a0e5-f8875be1e77b" released by "delete_volume" :: held 0.940s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:58:45 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-4e912050-6172-4173-a738-3a872a616002 tempest-CinderUnicodeTest-691955740 None] Created reservations ['96b684db-2929-4e9c-974c-76b59c36a3d1', '245d77a7-36a5-4a05-8eae-4a303d7c613c', '189e3697-b1a6-4537-982a-66d3f6f45d8c', 'dff3558c-9747-432a-8d7b-84457c26f51d'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:58:45 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-4e912050-6172-4173-a738-3a872a616002 tempest-CinderUnicodeTest-691955740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:58:45 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-4e912050-6172-4173-a738-3a872a616002 tempest-CinderUnicodeTest-691955740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:58:45 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-4e912050-6172-4173-a738-3a872a616002 tempest-CinderUnicodeTest-691955740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:58:45 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-4e912050-6172-4173-a738-3a872a616002 tempest-CinderUnicodeTest-691955740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:58:45 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-4e912050-6172-4173-a738-3a872a616002 tempest-CinderUnicodeTest-691955740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:58:45 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4e912050-6172-4173-a738-3a872a616002 tempest-CinderUnicodeTest-691955740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:45 devstack sudo[89044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:58:45 devstack sudo[89044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:46 devstack sudo[89044]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:46 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4e912050-6172-4173-a738-3a872a616002 tempest-CinderUnicodeTest-691955740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.449s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:46 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-4e912050-6172-4173-a738-3a872a616002 tempest-CinderUnicodeTest-691955740 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:58:46 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-4e912050-6172-4173-a738-3a872a616002 tempest-CinderUnicodeTest-691955740 None] Deleted volume successfully.
Apr 15 15:58:46 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-4e912050-6172-4173-a738-3a872a616002 tempest-CinderUnicodeTest-691955740 None] Lock "cinder-21ec4473-b979-4c52-a0e5-f8875be1e77b-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:58:46 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-f42eac1b-8ced-48d1-8988-895aa35f304c tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Acquiring lock "cinder-3dfad17a-85d1-4d53-961d-50fbb90e17e7-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:58:46 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-f42eac1b-8ced-48d1-8988-895aa35f304c tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Lock "cinder-3dfad17a-85d1-4d53-961d-50fbb90e17e7-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:58:46 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-f42eac1b-8ced-48d1-8988-895aa35f304c tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Acquiring lock "cinder-quobyte-3dfad17a-85d1-4d53-961d-50fbb90e17e7" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:58:46 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-f42eac1b-8ced-48d1-8988-895aa35f304c tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Lock "cinder-quobyte-3dfad17a-85d1-4d53-961d-50fbb90e17e7" acquired by "delete_volume" :: waited 0.010s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:58:46 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a548ce4-8b1e-4511-a7b4-5f8503ba5ea6]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:58:46 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-f42eac1b-8ced-48d1-8988-895aa35f304c tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3dfad17a-85d1-4d53-961d-50fbb90e17e7 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:46 devstack sudo[89047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3dfad17a-85d1-4d53-961d-50fbb90e17e7
Apr 15 15:58:46 devstack sudo[89047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:46 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac272039-35a2-46a5-a57b-8ed59d76b1bc tempest-VolumesListAdminTestJSON-1168971102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:58:46 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-ac272039-35a2-46a5-a57b-8ed59d76b1bc tempest-VolumesListAdminTestJSON-1168971102 None] Flow 'volume_create_manager' (67e7b121-24e2-4a1b-8cd5-c7c03662da07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:58:46 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-ac272039-35a2-46a5-a57b-8ed59d76b1bc tempest-VolumesListAdminTestJSON-1168971102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (857f295f-db49-48c4-98ce-f83fcca63b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:46 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-ac272039-35a2-46a5-a57b-8ed59d76b1bc tempest-VolumesListAdminTestJSON-1168971102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (857f295f-db49-48c4-98ce-f83fcca63b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:58:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1364773257',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7305a13-7da4-4a27-b384-b117b762be90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52ba462e76a148158336e08a9ec0852c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:58:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:58:46Z,use_quota=True,user_id='097a63b0e3784e0c9bfadf98a3562ecf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:46 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-ac272039-35a2-46a5-a57b-8ed59d76b1bc tempest-VolumesListAdminTestJSON-1168971102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c7cccfe-7a01-459e-af4b-39b7029a4a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:46 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-ac272039-35a2-46a5-a57b-8ed59d76b1bc tempest-VolumesListAdminTestJSON-1168971102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c7cccfe-7a01-459e-af4b-39b7029a4a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:46 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-ac272039-35a2-46a5-a57b-8ed59d76b1bc tempest-VolumesListAdminTestJSON-1168971102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2b202a8-202f-49b7-b6bd-096894305ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:46 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-ac272039-35a2-46a5-a57b-8ed59d76b1bc tempest-VolumesListAdminTestJSON-1168971102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2b202a8-202f-49b7-b6bd-096894305ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7305a13-7da4-4a27-b384-b117b762be90', 'volume_name': 'volume-b7305a13-7da4-4a27-b384-b117b762be90', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:46 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-ac272039-35a2-46a5-a57b-8ed59d76b1bc tempest-VolumesListAdminTestJSON-1168971102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f567427-3f38-41df-b102-c296da5e9cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:46 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-ac272039-35a2-46a5-a57b-8ed59d76b1bc tempest-VolumesListAdminTestJSON-1168971102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f567427-3f38-41df-b102-c296da5e9cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:46 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-ac272039-35a2-46a5-a57b-8ed59d76b1bc tempest-VolumesListAdminTestJSON-1168971102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2eb6ad7-773e-40a2-9dc1-94784ae13191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:46 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-ac272039-35a2-46a5-a57b-8ed59d76b1bc tempest-VolumesListAdminTestJSON-1168971102 None] Volume b7305a13-7da4-4a27-b384-b117b762be90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7305a13-7da4-4a27-b384-b117b762be90', 'volume_size': 1}
Apr 15 15:58:46 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-ac272039-35a2-46a5-a57b-8ed59d76b1bc tempest-VolumesListAdminTestJSON-1168971102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:58:46 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-ac272039-35a2-46a5-a57b-8ed59d76b1bc tempest-VolumesListAdminTestJSON-1168971102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:58:46 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-ac272039-35a2-46a5-a57b-8ed59d76b1bc tempest-VolumesListAdminTestJSON-1168971102 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:58:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1364773257',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7305a13-7da4-4a27-b384-b117b762be90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52ba462e76a148158336e08a9ec0852c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:58:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:58:46Z,use_quota=True,user_id='097a63b0e3784e0c9bfadf98a3562ecf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:58:46 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-ac272039-35a2-46a5-a57b-8ed59d76b1bc tempest-VolumesListAdminTestJSON-1168971102 None] Creating volume b7305a13-7da4-4a27-b384-b117b762be90 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:58:46 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-ac272039-35a2-46a5-a57b-8ed59d76b1bc tempest-VolumesListAdminTestJSON-1168971102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:58:46 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-ac272039-35a2-46a5-a57b-8ed59d76b1bc tempest-VolumesListAdminTestJSON-1168971102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:58:46 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-ac272039-35a2-46a5-a57b-8ed59d76b1bc tempest-VolumesListAdminTestJSON-1168971102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:58:46 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-ac272039-35a2-46a5-a57b-8ed59d76b1bc tempest-VolumesListAdminTestJSON-1168971102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:58:46 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-ac272039-35a2-46a5-a57b-8ed59d76b1bc tempest-VolumesListAdminTestJSON-1168971102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:58:46 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-ac272039-35a2-46a5-a57b-8ed59d76b1bc tempest-VolumesListAdminTestJSON-1168971102 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:58:46 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-ac272039-35a2-46a5-a57b-8ed59d76b1bc tempest-VolumesListAdminTestJSON-1168971102 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:58:46 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ac272039-35a2-46a5-a57b-8ed59d76b1bc tempest-VolumesListAdminTestJSON-1168971102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b7305a13-7da4-4a27-b384-b117b762be90 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:46 devstack sudo[89049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b7305a13-7da4-4a27-b384-b117b762be90 1073741824
Apr 15 15:58:46 devstack sudo[89049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:46 devstack sudo[89047]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:46 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-f42eac1b-8ced-48d1-8988-895aa35f304c tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3dfad17a-85d1-4d53-961d-50fbb90e17e7" returned: 0 in 0.512s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:46 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-f42eac1b-8ced-48d1-8988-895aa35f304c tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3dfad17a-85d1-4d53-961d-50fbb90e17e7 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:46 devstack sudo[89054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3dfad17a-85d1-4d53-961d-50fbb90e17e7
Apr 15 15:58:46 devstack sudo[89054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:47 devstack sudo[89049]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:47 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ac272039-35a2-46a5-a57b-8ed59d76b1bc tempest-VolumesListAdminTestJSON-1168971102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b7305a13-7da4-4a27-b384-b117b762be90 1073741824" returned: 0 in 0.510s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:47 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ac272039-35a2-46a5-a57b-8ed59d76b1bc tempest-VolumesListAdminTestJSON-1168971102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b7305a13-7da4-4a27-b384-b117b762be90 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:47 devstack sudo[89059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b7305a13-7da4-4a27-b384-b117b762be90
Apr 15 15:58:47 devstack sudo[89059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:47 devstack sudo[89054]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:47 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-f42eac1b-8ced-48d1-8988-895aa35f304c tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-3dfad17a-85d1-4d53-961d-50fbb90e17e7" returned: 0 in 0.422s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:47 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-f42eac1b-8ced-48d1-8988-895aa35f304c tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Lock "cinder-quobyte-3dfad17a-85d1-4d53-961d-50fbb90e17e7" released by "delete_volume" :: held 0.976s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:58:47 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-f42eac1b-8ced-48d1-8988-895aa35f304c tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Created reservations ['3b2bb94b-b1ad-4368-be6a-2c8422d1ba71', 'ea425c04-9ad2-49ab-a5b0-aa2b6d461404', 'da8d19d2-146f-4bbd-9589-90ecece405e4', '8ca397a7-2ebe-4a5c-a6cc-9a544cc11a17'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:58:47 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-f42eac1b-8ced-48d1-8988-895aa35f304c tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:58:47 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-f42eac1b-8ced-48d1-8988-895aa35f304c tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:58:47 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-f42eac1b-8ced-48d1-8988-895aa35f304c tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:58:47 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-f42eac1b-8ced-48d1-8988-895aa35f304c tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:58:47 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-f42eac1b-8ced-48d1-8988-895aa35f304c tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:58:47 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-f42eac1b-8ced-48d1-8988-895aa35f304c tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:47 devstack sudo[89062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:58:47 devstack sudo[89062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:47 devstack sudo[89059]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:47 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ac272039-35a2-46a5-a57b-8ed59d76b1bc tempest-VolumesListAdminTestJSON-1168971102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b7305a13-7da4-4a27-b384-b117b762be90" returned: 0 in 0.438s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:47 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-ac272039-35a2-46a5-a57b-8ed59d76b1bc tempest-VolumesListAdminTestJSON-1168971102 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:58:47 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-ac272039-35a2-46a5-a57b-8ed59d76b1bc tempest-VolumesListAdminTestJSON-1168971102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:58:47 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-ac272039-35a2-46a5-a57b-8ed59d76b1bc tempest-VolumesListAdminTestJSON-1168971102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2eb6ad7-773e-40a2-9dc1-94784ae13191) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7305a13-7da4-4a27-b384-b117b762be90', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:47 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-ac272039-35a2-46a5-a57b-8ed59d76b1bc tempest-VolumesListAdminTestJSON-1168971102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6c4b7a9-043c-4a07-b810-56599146e034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:47 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-ac272039-35a2-46a5-a57b-8ed59d76b1bc tempest-VolumesListAdminTestJSON-1168971102 None] Volume volume-b7305a13-7da4-4a27-b384-b117b762be90 (b7305a13-7da4-4a27-b384-b117b762be90): created successfully
Apr 15 15:58:47 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-ac272039-35a2-46a5-a57b-8ed59d76b1bc tempest-VolumesListAdminTestJSON-1168971102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6c4b7a9-043c-4a07-b810-56599146e034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:47 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-ac272039-35a2-46a5-a57b-8ed59d76b1bc tempest-VolumesListAdminTestJSON-1168971102 None] Flow 'volume_create_manager' (67e7b121-24e2-4a1b-8cd5-c7c03662da07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:58:47 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-ac272039-35a2-46a5-a57b-8ed59d76b1bc tempest-VolumesListAdminTestJSON-1168971102 None] Created volume successfully.
Apr 15 15:58:47 devstack sudo[89062]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:47 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-f42eac1b-8ced-48d1-8988-895aa35f304c tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.500s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:47 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-f42eac1b-8ced-48d1-8988-895aa35f304c tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:58:47 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-f42eac1b-8ced-48d1-8988-895aa35f304c tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Deleted volume successfully.
Apr 15 15:58:47 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-f42eac1b-8ced-48d1-8988-895aa35f304c tempest-VolumesSnapshotNegativeTestJSON-1013856624 None] Lock "cinder-3dfad17a-85d1-4d53-961d-50fbb90e17e7-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:58:48 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-77b2b299-dbe5-49d6-b992-bfbcaa0fbe1f tempest-VolumesListAdminTestJSON-1168971102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:58:48 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-77b2b299-dbe5-49d6-b992-bfbcaa0fbe1f tempest-VolumesListAdminTestJSON-1168971102 None] Flow 'volume_create_manager' (8e5ea504-610a-41b2-a2bb-9f3dcdca6191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:58:48 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-77b2b299-dbe5-49d6-b992-bfbcaa0fbe1f tempest-VolumesListAdminTestJSON-1168971102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f202fd9-979a-4a28-879c-c648a2c6a64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:48 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-77b2b299-dbe5-49d6-b992-bfbcaa0fbe1f tempest-VolumesListAdminTestJSON-1168971102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f202fd9-979a-4a28-879c-c648a2c6a64f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:58:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1261392238',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=191061af-b3e8-4230-94c4-c9653e56f4f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52ba462e76a148158336e08a9ec0852c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:58:49Z,use_quota=True,user_id='097a63b0e3784e0c9bfadf98a3562ecf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:48 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-77b2b299-dbe5-49d6-b992-bfbcaa0fbe1f tempest-VolumesListAdminTestJSON-1168971102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (161e16ae-5a9e-498f-b5a7-4de06ecb3531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:48 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-77b2b299-dbe5-49d6-b992-bfbcaa0fbe1f tempest-VolumesListAdminTestJSON-1168971102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (161e16ae-5a9e-498f-b5a7-4de06ecb3531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:48 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-77b2b299-dbe5-49d6-b992-bfbcaa0fbe1f tempest-VolumesListAdminTestJSON-1168971102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d38cb194-7680-42c2-ae0b-58c1f7d953c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:48 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-77b2b299-dbe5-49d6-b992-bfbcaa0fbe1f tempest-VolumesListAdminTestJSON-1168971102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d38cb194-7680-42c2-ae0b-58c1f7d953c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '191061af-b3e8-4230-94c4-c9653e56f4f3', 'volume_name': 'volume-191061af-b3e8-4230-94c4-c9653e56f4f3', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:48 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-77b2b299-dbe5-49d6-b992-bfbcaa0fbe1f tempest-VolumesListAdminTestJSON-1168971102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30f8cead-41a0-4472-a8de-7f956007fdb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:48 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-77b2b299-dbe5-49d6-b992-bfbcaa0fbe1f tempest-VolumesListAdminTestJSON-1168971102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30f8cead-41a0-4472-a8de-7f956007fdb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:48 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-77b2b299-dbe5-49d6-b992-bfbcaa0fbe1f tempest-VolumesListAdminTestJSON-1168971102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58ce054c-438c-4899-a59e-8411f8840cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:48 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-77b2b299-dbe5-49d6-b992-bfbcaa0fbe1f tempest-VolumesListAdminTestJSON-1168971102 None] Volume 191061af-b3e8-4230-94c4-c9653e56f4f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-191061af-b3e8-4230-94c4-c9653e56f4f3', 'volume_size': 1}
Apr 15 15:58:48 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-77b2b299-dbe5-49d6-b992-bfbcaa0fbe1f tempest-VolumesListAdminTestJSON-1168971102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:58:48 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-77b2b299-dbe5-49d6-b992-bfbcaa0fbe1f tempest-VolumesListAdminTestJSON-1168971102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:58:48 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-77b2b299-dbe5-49d6-b992-bfbcaa0fbe1f tempest-VolumesListAdminTestJSON-1168971102 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:58:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1261392238',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=191061af-b3e8-4230-94c4-c9653e56f4f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52ba462e76a148158336e08a9ec0852c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:58:49Z,use_quota=True,user_id='097a63b0e3784e0c9bfadf98a3562ecf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:58:48 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-77b2b299-dbe5-49d6-b992-bfbcaa0fbe1f tempest-VolumesListAdminTestJSON-1168971102 None] Creating volume 191061af-b3e8-4230-94c4-c9653e56f4f3 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:58:48 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-77b2b299-dbe5-49d6-b992-bfbcaa0fbe1f tempest-VolumesListAdminTestJSON-1168971102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:58:48 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-77b2b299-dbe5-49d6-b992-bfbcaa0fbe1f tempest-VolumesListAdminTestJSON-1168971102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:58:48 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-77b2b299-dbe5-49d6-b992-bfbcaa0fbe1f tempest-VolumesListAdminTestJSON-1168971102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:58:48 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-77b2b299-dbe5-49d6-b992-bfbcaa0fbe1f tempest-VolumesListAdminTestJSON-1168971102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:58:48 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-77b2b299-dbe5-49d6-b992-bfbcaa0fbe1f tempest-VolumesListAdminTestJSON-1168971102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:58:48 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-77b2b299-dbe5-49d6-b992-bfbcaa0fbe1f tempest-VolumesListAdminTestJSON-1168971102 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:58:48 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-77b2b299-dbe5-49d6-b992-bfbcaa0fbe1f tempest-VolumesListAdminTestJSON-1168971102 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:58:48 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-77b2b299-dbe5-49d6-b992-bfbcaa0fbe1f tempest-VolumesListAdminTestJSON-1168971102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-191061af-b3e8-4230-94c4-c9653e56f4f3 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:48 devstack sudo[89066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-191061af-b3e8-4230-94c4-c9653e56f4f3 1073741824
Apr 15 15:58:48 devstack sudo[89066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:48 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-946a583b-ad48-4f82-a6ab-ba012d2e975a tempest-VolumeDependencyTests-1015146606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:58:48 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-946a583b-ad48-4f82-a6ab-ba012d2e975a tempest-VolumeDependencyTests-1015146606 None] Flow 'volume_create_manager' (ed2db1b4-becd-4a19-bde9-0dfad24aff3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:58:48 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-946a583b-ad48-4f82-a6ab-ba012d2e975a tempest-VolumeDependencyTests-1015146606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be2c6fd3-7015-4da9-863d-e4c4896fde53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:48 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-946a583b-ad48-4f82-a6ab-ba012d2e975a tempest-VolumeDependencyTests-1015146606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be2c6fd3-7015-4da9-863d-e4c4896fde53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:58:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-836356679',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff014832-04d9-491b-91a2-1ec931ec5954,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='763d02579b334f69bb3cd648af9f23e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:58:49Z,use_quota=True,user_id='323c7dd322ea450493760c8a485511dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:48 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-946a583b-ad48-4f82-a6ab-ba012d2e975a tempest-VolumeDependencyTests-1015146606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ee4278c-93b9-4e27-bc95-26531361382f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:49 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-946a583b-ad48-4f82-a6ab-ba012d2e975a tempest-VolumeDependencyTests-1015146606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ee4278c-93b9-4e27-bc95-26531361382f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:49 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-946a583b-ad48-4f82-a6ab-ba012d2e975a tempest-VolumeDependencyTests-1015146606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc3636a4-9785-4776-bb3d-f6dde597585a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:49 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-946a583b-ad48-4f82-a6ab-ba012d2e975a tempest-VolumeDependencyTests-1015146606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc3636a4-9785-4776-bb3d-f6dde597585a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff014832-04d9-491b-91a2-1ec931ec5954', 'volume_name': 'volume-ff014832-04d9-491b-91a2-1ec931ec5954', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:49 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-946a583b-ad48-4f82-a6ab-ba012d2e975a tempest-VolumeDependencyTests-1015146606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25422708-a26a-4e87-9a38-1e7395d5aede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:49 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-946a583b-ad48-4f82-a6ab-ba012d2e975a tempest-VolumeDependencyTests-1015146606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25422708-a26a-4e87-9a38-1e7395d5aede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:49 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-946a583b-ad48-4f82-a6ab-ba012d2e975a tempest-VolumeDependencyTests-1015146606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02650432-9d7d-4731-a83d-1dd71b8969c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:49 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-946a583b-ad48-4f82-a6ab-ba012d2e975a tempest-VolumeDependencyTests-1015146606 None] Volume ff014832-04d9-491b-91a2-1ec931ec5954: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff014832-04d9-491b-91a2-1ec931ec5954', 'volume_size': 1}
Apr 15 15:58:49 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-946a583b-ad48-4f82-a6ab-ba012d2e975a tempest-VolumeDependencyTests-1015146606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:58:49 devstack sudo[89066]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:49 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-77b2b299-dbe5-49d6-b992-bfbcaa0fbe1f tempest-VolumesListAdminTestJSON-1168971102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-191061af-b3e8-4230-94c4-c9653e56f4f3 1073741824" returned: 0 in 0.481s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:49 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-77b2b299-dbe5-49d6-b992-bfbcaa0fbe1f tempest-VolumesListAdminTestJSON-1168971102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-191061af-b3e8-4230-94c4-c9653e56f4f3 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:49 devstack sudo[89071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-191061af-b3e8-4230-94c4-c9653e56f4f3
Apr 15 15:58:49 devstack sudo[89071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:49 devstack sudo[89071]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:49 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-77b2b299-dbe5-49d6-b992-bfbcaa0fbe1f tempest-VolumesListAdminTestJSON-1168971102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-191061af-b3e8-4230-94c4-c9653e56f4f3" returned: 0 in 0.403s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:49 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-77b2b299-dbe5-49d6-b992-bfbcaa0fbe1f tempest-VolumesListAdminTestJSON-1168971102 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:58:49 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-77b2b299-dbe5-49d6-b992-bfbcaa0fbe1f tempest-VolumesListAdminTestJSON-1168971102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:58:49 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-946a583b-ad48-4f82-a6ab-ba012d2e975a tempest-VolumeDependencyTests-1015146606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.798s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:58:49 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-946a583b-ad48-4f82-a6ab-ba012d2e975a tempest-VolumeDependencyTests-1015146606 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:58:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-836356679',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff014832-04d9-491b-91a2-1ec931ec5954,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='763d02579b334f69bb3cd648af9f23e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:58:49Z,use_quota=True,user_id='323c7dd322ea450493760c8a485511dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:58:49 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-946a583b-ad48-4f82-a6ab-ba012d2e975a tempest-VolumeDependencyTests-1015146606 None] Creating volume ff014832-04d9-491b-91a2-1ec931ec5954 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:58:49 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-946a583b-ad48-4f82-a6ab-ba012d2e975a tempest-VolumeDependencyTests-1015146606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:58:49 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-946a583b-ad48-4f82-a6ab-ba012d2e975a tempest-VolumeDependencyTests-1015146606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:58:49 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-946a583b-ad48-4f82-a6ab-ba012d2e975a tempest-VolumeDependencyTests-1015146606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:58:49 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-946a583b-ad48-4f82-a6ab-ba012d2e975a tempest-VolumeDependencyTests-1015146606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:58:49 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-946a583b-ad48-4f82-a6ab-ba012d2e975a tempest-VolumeDependencyTests-1015146606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:58:49 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-946a583b-ad48-4f82-a6ab-ba012d2e975a tempest-VolumeDependencyTests-1015146606 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:58:49 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-946a583b-ad48-4f82-a6ab-ba012d2e975a tempest-VolumeDependencyTests-1015146606 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:58:49 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-946a583b-ad48-4f82-a6ab-ba012d2e975a tempest-VolumeDependencyTests-1015146606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ff014832-04d9-491b-91a2-1ec931ec5954 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:49 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-77b2b299-dbe5-49d6-b992-bfbcaa0fbe1f tempest-VolumesListAdminTestJSON-1168971102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58ce054c-438c-4899-a59e-8411f8840cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-191061af-b3e8-4230-94c4-c9653e56f4f3', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:49 devstack sudo[89074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ff014832-04d9-491b-91a2-1ec931ec5954 1073741824
Apr 15 15:58:49 devstack sudo[89074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:49 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-77b2b299-dbe5-49d6-b992-bfbcaa0fbe1f tempest-VolumesListAdminTestJSON-1168971102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (451e046b-9b63-45f7-8b00-730fa34b5789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:49 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-77b2b299-dbe5-49d6-b992-bfbcaa0fbe1f tempest-VolumesListAdminTestJSON-1168971102 None] Volume volume-191061af-b3e8-4230-94c4-c9653e56f4f3 (191061af-b3e8-4230-94c4-c9653e56f4f3): created successfully
Apr 15 15:58:49 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-77b2b299-dbe5-49d6-b992-bfbcaa0fbe1f tempest-VolumesListAdminTestJSON-1168971102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (451e046b-9b63-45f7-8b00-730fa34b5789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:49 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-77b2b299-dbe5-49d6-b992-bfbcaa0fbe1f tempest-VolumesListAdminTestJSON-1168971102 None] Flow 'volume_create_manager' (8e5ea504-610a-41b2-a2bb-9f3dcdca6191) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:58:49 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-77b2b299-dbe5-49d6-b992-bfbcaa0fbe1f tempest-VolumesListAdminTestJSON-1168971102 None] Created volume successfully.
Apr 15 15:58:50 devstack sudo[89074]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:50 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-946a583b-ad48-4f82-a6ab-ba012d2e975a tempest-VolumeDependencyTests-1015146606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ff014832-04d9-491b-91a2-1ec931ec5954 1073741824" returned: 0 in 0.464s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:50 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-946a583b-ad48-4f82-a6ab-ba012d2e975a tempest-VolumeDependencyTests-1015146606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ff014832-04d9-491b-91a2-1ec931ec5954 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:50 devstack sudo[89079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ff014832-04d9-491b-91a2-1ec931ec5954
Apr 15 15:58:50 devstack sudo[89079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:50 devstack sudo[89079]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:50 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-946a583b-ad48-4f82-a6ab-ba012d2e975a tempest-VolumeDependencyTests-1015146606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ff014832-04d9-491b-91a2-1ec931ec5954" returned: 0 in 0.389s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:50 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-946a583b-ad48-4f82-a6ab-ba012d2e975a tempest-VolumeDependencyTests-1015146606 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:58:50 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-946a583b-ad48-4f82-a6ab-ba012d2e975a tempest-VolumeDependencyTests-1015146606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:58:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-946a583b-ad48-4f82-a6ab-ba012d2e975a tempest-VolumeDependencyTests-1015146606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02650432-9d7d-4731-a83d-1dd71b8969c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff014832-04d9-491b-91a2-1ec931ec5954', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-946a583b-ad48-4f82-a6ab-ba012d2e975a tempest-VolumeDependencyTests-1015146606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d2cdeb4-7a00-4c3a-91a4-f0dc35a94926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:50 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-946a583b-ad48-4f82-a6ab-ba012d2e975a tempest-VolumeDependencyTests-1015146606 None] Volume volume-ff014832-04d9-491b-91a2-1ec931ec5954 (ff014832-04d9-491b-91a2-1ec931ec5954): created successfully
Apr 15 15:58:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-946a583b-ad48-4f82-a6ab-ba012d2e975a tempest-VolumeDependencyTests-1015146606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d2cdeb4-7a00-4c3a-91a4-f0dc35a94926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-946a583b-ad48-4f82-a6ab-ba012d2e975a tempest-VolumeDependencyTests-1015146606 None] Flow 'volume_create_manager' (ed2db1b4-becd-4a19-bde9-0dfad24aff3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:58:50 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-946a583b-ad48-4f82-a6ab-ba012d2e975a tempest-VolumeDependencyTests-1015146606 None] Created volume successfully.
Apr 15 15:58:51 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-e2e86420-cc81-4f43-9ea7-901380be6526 tempest-VolumeDependencyTests-1015146606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:58:51 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-e2e86420-cc81-4f43-9ea7-901380be6526 tempest-VolumeDependencyTests-1015146606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:58:51 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-e2e86420-cc81-4f43-9ea7-901380be6526 tempest-VolumeDependencyTests-1015146606 None] Creating offline snapshot f420fa31-a107-42fb-a0d8-f010565acbd7 of volume ff014832-04d9-491b-91a2-1ec931ec5954 {{(pid=82485) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 15:58:51 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae7d9d7-b710-4333-bd8b-26aafbb37ffb]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:58:51 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-e2e86420-cc81-4f43-9ea7-901380be6526 tempest-VolumeDependencyTests-1015146606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ff014832-04d9-491b-91a2-1ec931ec5954 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:51 devstack sudo[89082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ff014832-04d9-491b-91a2-1ec931ec5954
Apr 15 15:58:51 devstack sudo[89082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:51 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-a04358c4-d8fd-4816-8914-558f0a361ff4 tempest-VolumesListAdminTestJSON-627352274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:58:51 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-a04358c4-d8fd-4816-8914-558f0a361ff4 tempest-VolumesListAdminTestJSON-627352274 None] Flow 'volume_create_manager' (3a337e9f-8f64-40c8-a54b-cb2c0bd53c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:58:51 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-a04358c4-d8fd-4816-8914-558f0a361ff4 tempest-VolumesListAdminTestJSON-627352274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (832e5da9-f2d4-4b9d-8e0d-425a91593102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:51 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-a04358c4-d8fd-4816-8914-558f0a361ff4 tempest-VolumesListAdminTestJSON-627352274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (832e5da9-f2d4-4b9d-8e0d-425a91593102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:58:51Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2f4494e-89aa-41ac-b160-20230441ae2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9095fcad42264330b3cb2afd541eb328',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:58:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:58:51Z,use_quota=True,user_id='58754a883ca44d4c9cf948512e5ce733',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:51 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-a04358c4-d8fd-4816-8914-558f0a361ff4 tempest-VolumesListAdminTestJSON-627352274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a996d62-1d41-4c66-b0f6-14a151f47a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:51 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-a04358c4-d8fd-4816-8914-558f0a361ff4 tempest-VolumesListAdminTestJSON-627352274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a996d62-1d41-4c66-b0f6-14a151f47a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:51 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-a04358c4-d8fd-4816-8914-558f0a361ff4 tempest-VolumesListAdminTestJSON-627352274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f63615b6-97e2-4c28-a0bd-e11646c6ebff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:51 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-a04358c4-d8fd-4816-8914-558f0a361ff4 tempest-VolumesListAdminTestJSON-627352274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f63615b6-97e2-4c28-a0bd-e11646c6ebff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2f4494e-89aa-41ac-b160-20230441ae2a', 'volume_name': 'volume-c2f4494e-89aa-41ac-b160-20230441ae2a', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:51 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-a04358c4-d8fd-4816-8914-558f0a361ff4 tempest-VolumesListAdminTestJSON-627352274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (694e3078-5792-4528-bdbc-31d3cd855199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:51 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-a04358c4-d8fd-4816-8914-558f0a361ff4 tempest-VolumesListAdminTestJSON-627352274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (694e3078-5792-4528-bdbc-31d3cd855199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:51 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-a04358c4-d8fd-4816-8914-558f0a361ff4 tempest-VolumesListAdminTestJSON-627352274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2856560f-88b3-4848-b350-adafc93c428d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:51 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-a04358c4-d8fd-4816-8914-558f0a361ff4 tempest-VolumesListAdminTestJSON-627352274 None] Volume c2f4494e-89aa-41ac-b160-20230441ae2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2f4494e-89aa-41ac-b160-20230441ae2a', 'volume_size': 1}
Apr 15 15:58:51 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-a04358c4-d8fd-4816-8914-558f0a361ff4 tempest-VolumesListAdminTestJSON-627352274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:58:51 devstack sudo[89082]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:51 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-e2e86420-cc81-4f43-9ea7-901380be6526 tempest-VolumeDependencyTests-1015146606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ff014832-04d9-491b-91a2-1ec931ec5954" returned: 0 in 0.466s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:51 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-e2e86420-cc81-4f43-9ea7-901380be6526 tempest-VolumeDependencyTests-1015146606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ff014832-04d9-491b-91a2-1ec931ec5954,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ff014832-04d9-491b-91a2-1ec931ec5954.f420fa31-a107-42fb-a0d8-f010565acbd7 1G {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:51 devstack sudo[89087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ff014832-04d9-491b-91a2-1ec931ec5954,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ff014832-04d9-491b-91a2-1ec931ec5954.f420fa31-a107-42fb-a0d8-f010565acbd7 1G
Apr 15 15:58:51 devstack sudo[89087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:52 devstack sudo[89087]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:52 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-e2e86420-cc81-4f43-9ea7-901380be6526 tempest-VolumeDependencyTests-1015146606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ff014832-04d9-491b-91a2-1ec931ec5954,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ff014832-04d9-491b-91a2-1ec931ec5954.f420fa31-a107-42fb-a0d8-f010565acbd7 1G" returned: 0 in 0.467s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:52 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-e2e86420-cc81-4f43-9ea7-901380be6526 tempest-VolumeDependencyTests-1015146606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff014832-04d9-491b-91a2-1ec931ec5954 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ff014832-04d9-491b-91a2-1ec931ec5954.f420fa31-a107-42fb-a0d8-f010565acbd7 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:52 devstack sudo[89092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff014832-04d9-491b-91a2-1ec931ec5954 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ff014832-04d9-491b-91a2-1ec931ec5954.f420fa31-a107-42fb-a0d8-f010565acbd7
Apr 15 15:58:52 devstack sudo[89092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:52 devstack sudo[89092]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:52 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-e2e86420-cc81-4f43-9ea7-901380be6526 tempest-VolumeDependencyTests-1015146606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff014832-04d9-491b-91a2-1ec931ec5954 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ff014832-04d9-491b-91a2-1ec931ec5954.f420fa31-a107-42fb-a0d8-f010565acbd7" returned: 0 in 0.421s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:52 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-e2e86420-cc81-4f43-9ea7-901380be6526 tempest-VolumeDependencyTests-1015146606 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ff014832-04d9-491b-91a2-1ec931ec5954.f420fa31-a107-42fb-a0d8-f010565acbd7 is being set with open permissions: ugo+rw
Apr 15 15:58:52 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-e2e86420-cc81-4f43-9ea7-901380be6526 tempest-VolumeDependencyTests-1015146606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ff014832-04d9-491b-91a2-1ec931ec5954.f420fa31-a107-42fb-a0d8-f010565acbd7 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:52 devstack sudo[89097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ff014832-04d9-491b-91a2-1ec931ec5954.f420fa31-a107-42fb-a0d8-f010565acbd7
Apr 15 15:58:52 devstack sudo[89097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:52 devstack sudo[89097]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:52 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-e2e86420-cc81-4f43-9ea7-901380be6526 tempest-VolumeDependencyTests-1015146606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ff014832-04d9-491b-91a2-1ec931ec5954.f420fa31-a107-42fb-a0d8-f010565acbd7" returned: 0 in 0.393s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:52 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-e2e86420-cc81-4f43-9ea7-901380be6526 tempest-VolumeDependencyTests-1015146606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ff014832-04d9-491b-91a2-1ec931ec5954.info {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:53 devstack sudo[89100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ff014832-04d9-491b-91a2-1ec931ec5954.info
Apr 15 15:58:53 devstack sudo[89100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:53 devstack sudo[89100]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:53 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-e2e86420-cc81-4f43-9ea7-901380be6526 tempest-VolumeDependencyTests-1015146606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ff014832-04d9-491b-91a2-1ec931ec5954.info" returned: 0 in 0.409s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:53 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-e2e86420-cc81-4f43-9ea7-901380be6526 tempest-VolumeDependencyTests-1015146606 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ff014832-04d9-491b-91a2-1ec931ec5954.info is being set with open permissions: ugo+rw
Apr 15 15:58:53 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-e2e86420-cc81-4f43-9ea7-901380be6526 tempest-VolumeDependencyTests-1015146606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ff014832-04d9-491b-91a2-1ec931ec5954.info {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:53 devstack sudo[89103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ff014832-04d9-491b-91a2-1ec931ec5954.info
Apr 15 15:58:53 devstack sudo[89103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:53 devstack sudo[89103]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:53 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-e2e86420-cc81-4f43-9ea7-901380be6526 tempest-VolumeDependencyTests-1015146606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ff014832-04d9-491b-91a2-1ec931ec5954.info" returned: 0 in 0.389s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:53 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-e2e86420-cc81-4f43-9ea7-901380be6526 tempest-VolumeDependencyTests-1015146606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.597s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:58:53 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-a04358c4-d8fd-4816-8914-558f0a361ff4 tempest-VolumesListAdminTestJSON-627352274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.410s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:58:53 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-a04358c4-d8fd-4816-8914-558f0a361ff4 tempest-VolumesListAdminTestJSON-627352274 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:58:51Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2f4494e-89aa-41ac-b160-20230441ae2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9095fcad42264330b3cb2afd541eb328',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:58:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:58:51Z,use_quota=True,user_id='58754a883ca44d4c9cf948512e5ce733',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:58:53 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-a04358c4-d8fd-4816-8914-558f0a361ff4 tempest-VolumesListAdminTestJSON-627352274 None] Creating volume c2f4494e-89aa-41ac-b160-20230441ae2a {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:58:53 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-a04358c4-d8fd-4816-8914-558f0a361ff4 tempest-VolumesListAdminTestJSON-627352274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:58:53 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-a04358c4-d8fd-4816-8914-558f0a361ff4 tempest-VolumesListAdminTestJSON-627352274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:58:53 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-a04358c4-d8fd-4816-8914-558f0a361ff4 tempest-VolumesListAdminTestJSON-627352274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:58:53 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-a04358c4-d8fd-4816-8914-558f0a361ff4 tempest-VolumesListAdminTestJSON-627352274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:58:53 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-a04358c4-d8fd-4816-8914-558f0a361ff4 tempest-VolumesListAdminTestJSON-627352274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:58:53 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-a04358c4-d8fd-4816-8914-558f0a361ff4 tempest-VolumesListAdminTestJSON-627352274 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:58:53 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-a04358c4-d8fd-4816-8914-558f0a361ff4 tempest-VolumesListAdminTestJSON-627352274 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:58:53 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-a04358c4-d8fd-4816-8914-558f0a361ff4 tempest-VolumesListAdminTestJSON-627352274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c2f4494e-89aa-41ac-b160-20230441ae2a 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:53 devstack sudo[89106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c2f4494e-89aa-41ac-b160-20230441ae2a 1073741824
Apr 15 15:58:53 devstack sudo[89106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:53 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-e2e86420-cc81-4f43-9ea7-901380be6526 tempest-VolumeDependencyTests-1015146606 None] Create snapshot completed successfully
Apr 15 15:58:54 devstack sudo[89106]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-a04358c4-d8fd-4816-8914-558f0a361ff4 tempest-VolumesListAdminTestJSON-627352274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c2f4494e-89aa-41ac-b160-20230441ae2a 1073741824" returned: 0 in 0.482s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-a04358c4-d8fd-4816-8914-558f0a361ff4 tempest-VolumesListAdminTestJSON-627352274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c2f4494e-89aa-41ac-b160-20230441ae2a {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:54 devstack sudo[89111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c2f4494e-89aa-41ac-b160-20230441ae2a
Apr 15 15:58:54 devstack sudo[89111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:54 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-57285c5a-81ee-404f-afe1-0375fc43906d tempest-VolumeDependencyTests-1015146606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:58:54 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-57285c5a-81ee-404f-afe1-0375fc43906d tempest-VolumeDependencyTests-1015146606 None] Flow 'volume_create_manager' (3779070a-6ecf-4751-ae11-090008806008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:58:54 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-57285c5a-81ee-404f-afe1-0375fc43906d tempest-VolumeDependencyTests-1015146606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e808109e-fb1b-420b-94ec-cb387c7ee5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:54 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-57285c5a-81ee-404f-afe1-0375fc43906d tempest-VolumeDependencyTests-1015146606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e808109e-fb1b-420b-94ec-cb387c7ee5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:58:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-312041453',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3442355-2c5a-4d30-8928-739d2683a8c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='763d02579b334f69bb3cd648af9f23e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:58:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f420fa31-a107-42fb-a0d8-f010565acbd7,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:58:55Z,use_quota=True,user_id='323c7dd322ea450493760c8a485511dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:54 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-57285c5a-81ee-404f-afe1-0375fc43906d tempest-VolumeDependencyTests-1015146606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e7722e6-f7a7-4371-ab02-ebc0432c7ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:54 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-57285c5a-81ee-404f-afe1-0375fc43906d tempest-VolumeDependencyTests-1015146606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e7722e6-f7a7-4371-ab02-ebc0432c7ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:54 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-57285c5a-81ee-404f-afe1-0375fc43906d tempest-VolumeDependencyTests-1015146606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (859451ca-2045-4823-8f6c-eace2ce968d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:54 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-57285c5a-81ee-404f-afe1-0375fc43906d tempest-VolumeDependencyTests-1015146606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (859451ca-2045-4823-8f6c-eace2ce968d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b3442355-2c5a-4d30-8928-739d2683a8c0', 'volume_name': 'volume-b3442355-2c5a-4d30-8928-739d2683a8c0', 'volume_size': 1, 'snapshot_id': 'f420fa31-a107-42fb-a0d8-f010565acbd7'}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:54 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-57285c5a-81ee-404f-afe1-0375fc43906d tempest-VolumeDependencyTests-1015146606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0b5244e-9471-4af8-bdce-8ff40f3bd98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:54 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-57285c5a-81ee-404f-afe1-0375fc43906d tempest-VolumeDependencyTests-1015146606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0b5244e-9471-4af8-bdce-8ff40f3bd98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:54 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-57285c5a-81ee-404f-afe1-0375fc43906d tempest-VolumeDependencyTests-1015146606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51d2e533-09ce-4d59-8701-86bd485e3bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:54 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-57285c5a-81ee-404f-afe1-0375fc43906d tempest-VolumeDependencyTests-1015146606 None] Volume b3442355-2c5a-4d30-8928-739d2683a8c0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b3442355-2c5a-4d30-8928-739d2683a8c0', 'volume_size': 1, 'snapshot_id': 'f420fa31-a107-42fb-a0d8-f010565acbd7'}
Apr 15 15:58:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-57285c5a-81ee-404f-afe1-0375fc43906d tempest-VolumeDependencyTests-1015146606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:58:54 devstack sudo[89111]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-a04358c4-d8fd-4816-8914-558f0a361ff4 tempest-VolumesListAdminTestJSON-627352274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c2f4494e-89aa-41ac-b160-20230441ae2a" returned: 0 in 0.442s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:54 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-a04358c4-d8fd-4816-8914-558f0a361ff4 tempest-VolumesListAdminTestJSON-627352274 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:58:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-a04358c4-d8fd-4816-8914-558f0a361ff4 tempest-VolumesListAdminTestJSON-627352274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:58:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-57285c5a-81ee-404f-afe1-0375fc43906d tempest-VolumeDependencyTests-1015146606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.090s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:58:54 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-57285c5a-81ee-404f-afe1-0375fc43906d tempest-VolumeDependencyTests-1015146606 None] Acquiring lock "cinder-quobyte-f420fa31-a107-42fb-a0d8-f010565acbd7-b3442355-2c5a-4d30-8928-739d2683a8c0" by "_create_volume_from_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:58:54 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-a04358c4-d8fd-4816-8914-558f0a361ff4 tempest-VolumesListAdminTestJSON-627352274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2856560f-88b3-4848-b350-adafc93c428d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2f4494e-89aa-41ac-b160-20230441ae2a', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:54 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-a04358c4-d8fd-4816-8914-558f0a361ff4 tempest-VolumesListAdminTestJSON-627352274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae78bc20-0c6a-47ad-b543-a22ce9208d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:54 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-57285c5a-81ee-404f-afe1-0375fc43906d tempest-VolumeDependencyTests-1015146606 None] Lock "cinder-quobyte-f420fa31-a107-42fb-a0d8-f010565acbd7-b3442355-2c5a-4d30-8928-739d2683a8c0" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:58:54 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-57285c5a-81ee-404f-afe1-0375fc43906d tempest-VolumeDependencyTests-1015146606 None] Creating volume b3442355-2c5a-4d30-8928-739d2683a8c0 from snapshot f420fa31-a107-42fb-a0d8-f010565acbd7 {{(pid=82485) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 15 15:58:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-57285c5a-81ee-404f-afe1-0375fc43906d tempest-VolumeDependencyTests-1015146606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:58:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-57285c5a-81ee-404f-afe1-0375fc43906d tempest-VolumeDependencyTests-1015146606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:58:54 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-57285c5a-81ee-404f-afe1-0375fc43906d tempest-VolumeDependencyTests-1015146606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:58:54 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-57285c5a-81ee-404f-afe1-0375fc43906d tempest-VolumeDependencyTests-1015146606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:58:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-57285c5a-81ee-404f-afe1-0375fc43906d tempest-VolumeDependencyTests-1015146606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:58:54 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-57285c5a-81ee-404f-afe1-0375fc43906d tempest-VolumeDependencyTests-1015146606 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:58:54 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-57285c5a-81ee-404f-afe1-0375fc43906d tempest-VolumeDependencyTests-1015146606 None] Acquiring lock "cinder-quobyte-b3442355-2c5a-4d30-8928-739d2683a8c0" by "_copy_volume_from_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:58:54 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-a04358c4-d8fd-4816-8914-558f0a361ff4 tempest-VolumesListAdminTestJSON-627352274 None] Volume volume-c2f4494e-89aa-41ac-b160-20230441ae2a (c2f4494e-89aa-41ac-b160-20230441ae2a): created successfully
Apr 15 15:58:54 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-a04358c4-d8fd-4816-8914-558f0a361ff4 tempest-VolumesListAdminTestJSON-627352274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae78bc20-0c6a-47ad-b543-a22ce9208d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:54 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-a04358c4-d8fd-4816-8914-558f0a361ff4 tempest-VolumesListAdminTestJSON-627352274 None] Flow 'volume_create_manager' (3a337e9f-8f64-40c8-a54b-cb2c0bd53c4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:58:54 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-57285c5a-81ee-404f-afe1-0375fc43906d tempest-VolumeDependencyTests-1015146606 None] Lock "cinder-quobyte-b3442355-2c5a-4d30-8928-739d2683a8c0" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:58:54 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-57285c5a-81ee-404f-afe1-0375fc43906d tempest-VolumeDependencyTests-1015146606 None] snapshot: f420fa31-a107-42fb-a0d8-f010565acbd7, volume: b3442355-2c5a-4d30-8928-739d2683a8c0,  {{(pid=82485) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 15 15:58:54 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-a04358c4-d8fd-4816-8914-558f0a361ff4 tempest-VolumesListAdminTestJSON-627352274 None] Created volume successfully.
Apr 15 15:58:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-57285c5a-81ee-404f-afe1-0375fc43906d tempest-VolumeDependencyTests-1015146606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:58:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-57285c5a-81ee-404f-afe1-0375fc43906d tempest-VolumeDependencyTests-1015146606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:58:54 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-57285c5a-81ee-404f-afe1-0375fc43906d tempest-VolumeDependencyTests-1015146606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:58:54 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-57285c5a-81ee-404f-afe1-0375fc43906d tempest-VolumeDependencyTests-1015146606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:58:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-57285c5a-81ee-404f-afe1-0375fc43906d tempest-VolumeDependencyTests-1015146606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:58:54 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed754377-2e65-4c93-ad2d-3debdd0ad947]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:58:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-57285c5a-81ee-404f-afe1-0375fc43906d tempest-VolumeDependencyTests-1015146606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ff014832-04d9-491b-91a2-1ec931ec5954.f420fa31-a107-42fb-a0d8-f010565acbd7 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:54 devstack sudo[89115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ff014832-04d9-491b-91a2-1ec931ec5954.f420fa31-a107-42fb-a0d8-f010565acbd7
Apr 15 15:58:54 devstack sudo[89115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:55 devstack sudo[89115]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:55 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-57285c5a-81ee-404f-afe1-0375fc43906d tempest-VolumeDependencyTests-1015146606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ff014832-04d9-491b-91a2-1ec931ec5954.f420fa31-a107-42fb-a0d8-f010565acbd7" returned: 0 in 0.466s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:55 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-57285c5a-81ee-404f-afe1-0375fc43906d tempest-VolumeDependencyTests-1015146606 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff014832-04d9-491b-91a2-1ec931ec5954(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82485) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 15:58:55 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-57285c5a-81ee-404f-afe1-0375fc43906d tempest-VolumeDependencyTests-1015146606 None] will copy from snapshot at /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ff014832-04d9-491b-91a2-1ec931ec5954 {{(pid=82485) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 15 15:58:55 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-57285c5a-81ee-404f-afe1-0375fc43906d tempest-VolumeDependencyTests-1015146606 None] Creating direct copy from snapshot {{(pid=82485) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 15 15:58:55 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[700bcda8-b93b-4560-b4e6-17d58531faa9]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:58:55 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-57285c5a-81ee-404f-afe1-0375fc43906d tempest-VolumeDependencyTests-1015146606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ff014832-04d9-491b-91a2-1ec931ec5954 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:55 devstack sudo[89120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ff014832-04d9-491b-91a2-1ec931ec5954
Apr 15 15:58:55 devstack sudo[89120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:55 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-f6b8da7c-dad7-44fa-820e-782f57925e2a tempest-VolumesListAdminTestJSON-627352274 None] Acquiring lock "cinder-c2f4494e-89aa-41ac-b160-20230441ae2a-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:58:55 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-f6b8da7c-dad7-44fa-820e-782f57925e2a tempest-VolumesListAdminTestJSON-627352274 None] Lock "cinder-c2f4494e-89aa-41ac-b160-20230441ae2a-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:58:55 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-f6b8da7c-dad7-44fa-820e-782f57925e2a tempest-VolumesListAdminTestJSON-627352274 None] Acquiring lock "cinder-quobyte-c2f4494e-89aa-41ac-b160-20230441ae2a" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:58:55 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-f6b8da7c-dad7-44fa-820e-782f57925e2a tempest-VolumesListAdminTestJSON-627352274 None] Lock "cinder-quobyte-c2f4494e-89aa-41ac-b160-20230441ae2a" acquired by "delete_volume" :: waited 0.008s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:58:55 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[50aa2d4a-932c-42fb-972a-adf76b1ffca9]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:58:55 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-f6b8da7c-dad7-44fa-820e-782f57925e2a tempest-VolumesListAdminTestJSON-627352274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c2f4494e-89aa-41ac-b160-20230441ae2a {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:55 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-0921b05c-ae91-4a62-adaf-3dabd6670cf7 tempest-VolumesListAdminTestJSON-1168971102 None] Acquiring lock "cinder-191061af-b3e8-4230-94c4-c9653e56f4f3-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:58:55 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-0921b05c-ae91-4a62-adaf-3dabd6670cf7 tempest-VolumesListAdminTestJSON-1168971102 None] Lock "cinder-191061af-b3e8-4230-94c4-c9653e56f4f3-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:58:55 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-0921b05c-ae91-4a62-adaf-3dabd6670cf7 tempest-VolumesListAdminTestJSON-1168971102 None] Acquiring lock "cinder-quobyte-191061af-b3e8-4230-94c4-c9653e56f4f3" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:58:55 devstack sudo[89124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c2f4494e-89aa-41ac-b160-20230441ae2a
Apr 15 15:58:55 devstack sudo[89124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:55 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-0921b05c-ae91-4a62-adaf-3dabd6670cf7 tempest-VolumesListAdminTestJSON-1168971102 None] Lock "cinder-quobyte-191061af-b3e8-4230-94c4-c9653e56f4f3" acquired by "delete_volume" :: waited 0.010s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:58:55 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[76828df6-8276-4c07-b984-fbd5eb642957]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:58:55 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-0921b05c-ae91-4a62-adaf-3dabd6670cf7 tempest-VolumesListAdminTestJSON-1168971102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-191061af-b3e8-4230-94c4-c9653e56f4f3 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:55 devstack sudo[89120]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:55 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-57285c5a-81ee-404f-afe1-0375fc43906d tempest-VolumeDependencyTests-1015146606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ff014832-04d9-491b-91a2-1ec931ec5954" returned: 0 in 0.537s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:55 devstack cinder-volume[82485]: DEBUG cinder.utils [None req-57285c5a-81ee-404f-afe1-0375fc43906d tempest-VolumeDependencyTests-1015146606 None] Path /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b3442355-2c5a-4d30-8928-739d2683a8c0 not found in is_blk_device check {{(pid=82485) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 15 15:58:55 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-57285c5a-81ee-404f-afe1-0375fc43906d tempest-VolumeDependencyTests-1015146606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ff014832-04d9-491b-91a2-1ec931ec5954 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b3442355-2c5a-4d30-8928-739d2683a8c0 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:55 devstack sudo[89129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-191061af-b3e8-4230-94c4-c9653e56f4f3
Apr 15 15:58:55 devstack sudo[89129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:55 devstack sudo[89131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ff014832-04d9-491b-91a2-1ec931ec5954 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b3442355-2c5a-4d30-8928-739d2683a8c0
Apr 15 15:58:55 devstack sudo[89131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:56 devstack sudo[89124]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:56 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-f6b8da7c-dad7-44fa-820e-782f57925e2a tempest-VolumesListAdminTestJSON-627352274 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c2f4494e-89aa-41ac-b160-20230441ae2a" returned: 0 in 0.497s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:56 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-f6b8da7c-dad7-44fa-820e-782f57925e2a tempest-VolumesListAdminTestJSON-627352274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c2f4494e-89aa-41ac-b160-20230441ae2a {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:56 devstack sudo[89139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c2f4494e-89aa-41ac-b160-20230441ae2a
Apr 15 15:58:56 devstack sudo[89139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:56 devstack sudo[89129]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:56 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-0921b05c-ae91-4a62-adaf-3dabd6670cf7 tempest-VolumesListAdminTestJSON-1168971102 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-191061af-b3e8-4230-94c4-c9653e56f4f3" returned: 0 in 0.503s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:56 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-0921b05c-ae91-4a62-adaf-3dabd6670cf7 tempest-VolumesListAdminTestJSON-1168971102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-191061af-b3e8-4230-94c4-c9653e56f4f3 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:56 devstack sudo[89144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-191061af-b3e8-4230-94c4-c9653e56f4f3
Apr 15 15:58:56 devstack sudo[89144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:57 devstack sudo[89139]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-f6b8da7c-dad7-44fa-820e-782f57925e2a tempest-VolumesListAdminTestJSON-627352274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c2f4494e-89aa-41ac-b160-20230441ae2a" returned: 0 in 0.895s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:57 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-f6b8da7c-dad7-44fa-820e-782f57925e2a tempest-VolumesListAdminTestJSON-627352274 None] Lock "cinder-quobyte-c2f4494e-89aa-41ac-b160-20230441ae2a" released by "delete_volume" :: held 1.439s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:58:57 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-f6b8da7c-dad7-44fa-820e-782f57925e2a tempest-VolumesListAdminTestJSON-627352274 None] Created reservations ['4d4828a6-4f69-4102-a71e-7532c2973e20', '8301850b-cad1-48e7-be41-b1b17caf6671', '23ba90dd-24f3-4eeb-bd91-8bd8fa33df46', '91f053b2-67dc-42c0-ae9e-1d1b8a67d191'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:58:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-f6b8da7c-dad7-44fa-820e-782f57925e2a tempest-VolumesListAdminTestJSON-627352274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:58:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-f6b8da7c-dad7-44fa-820e-782f57925e2a tempest-VolumesListAdminTestJSON-627352274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:58:57 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-f6b8da7c-dad7-44fa-820e-782f57925e2a tempest-VolumesListAdminTestJSON-627352274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:58:57 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-f6b8da7c-dad7-44fa-820e-782f57925e2a tempest-VolumesListAdminTestJSON-627352274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:58:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-f6b8da7c-dad7-44fa-820e-782f57925e2a tempest-VolumesListAdminTestJSON-627352274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:58:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-f6b8da7c-dad7-44fa-820e-782f57925e2a tempest-VolumesListAdminTestJSON-627352274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:57 devstack sudo[89154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:58:57 devstack sudo[89154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:57 devstack sudo[89131]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:57 devstack sudo[89144]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-57285c5a-81ee-404f-afe1-0375fc43906d tempest-VolumeDependencyTests-1015146606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ff014832-04d9-491b-91a2-1ec931ec5954 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b3442355-2c5a-4d30-8928-739d2683a8c0" returned: 0 in 2.083s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-0921b05c-ae91-4a62-adaf-3dabd6670cf7 tempest-VolumesListAdminTestJSON-1168971102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-191061af-b3e8-4230-94c4-c9653e56f4f3" returned: 0 in 1.647s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:57 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[8edbd3bb-27ef-402a-957b-832bd24cdf81]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:58:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-57285c5a-81ee-404f-afe1-0375fc43906d tempest-VolumeDependencyTests-1015146606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ff014832-04d9-491b-91a2-1ec931ec5954 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:57 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-0921b05c-ae91-4a62-adaf-3dabd6670cf7 tempest-VolumesListAdminTestJSON-1168971102 None] Lock "cinder-quobyte-191061af-b3e8-4230-94c4-c9653e56f4f3" released by "delete_volume" :: held 2.183s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:58:58 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-0921b05c-ae91-4a62-adaf-3dabd6670cf7 tempest-VolumesListAdminTestJSON-1168971102 None] Created reservations ['e69a2915-36da-45c3-81fd-e5be415d25b5', '6d89347a-219e-401b-b13f-0b2344dde420', '3ef39a60-09ad-4dbd-b07b-a0b99c6affaf', '0afeeafe-f596-475d-aff3-29ef591d17c4'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:58:58 devstack sudo[89157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ff014832-04d9-491b-91a2-1ec931ec5954
Apr 15 15:58:58 devstack sudo[89157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-0921b05c-ae91-4a62-adaf-3dabd6670cf7 tempest-VolumesListAdminTestJSON-1168971102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:58:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-0921b05c-ae91-4a62-adaf-3dabd6670cf7 tempest-VolumesListAdminTestJSON-1168971102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:58:58 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-0921b05c-ae91-4a62-adaf-3dabd6670cf7 tempest-VolumesListAdminTestJSON-1168971102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:58:58 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-0921b05c-ae91-4a62-adaf-3dabd6670cf7 tempest-VolumesListAdminTestJSON-1168971102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:58:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-0921b05c-ae91-4a62-adaf-3dabd6670cf7 tempest-VolumesListAdminTestJSON-1168971102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:58:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-0921b05c-ae91-4a62-adaf-3dabd6670cf7 tempest-VolumesListAdminTestJSON-1168971102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:58 devstack sudo[89159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:58:58 devstack sudo[89159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:58 devstack sudo[89154]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-f6b8da7c-dad7-44fa-820e-782f57925e2a tempest-VolumesListAdminTestJSON-627352274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.849s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:58 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-f6b8da7c-dad7-44fa-820e-782f57925e2a tempest-VolumesListAdminTestJSON-627352274 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:58:58 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-f6b8da7c-dad7-44fa-820e-782f57925e2a tempest-VolumesListAdminTestJSON-627352274 None] Deleted volume successfully.
Apr 15 15:58:58 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-f6b8da7c-dad7-44fa-820e-782f57925e2a tempest-VolumesListAdminTestJSON-627352274 None] Lock "cinder-c2f4494e-89aa-41ac-b160-20230441ae2a-delete_volume" released by "delete_volume" :: held 2.588s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:58:58 devstack sudo[89159]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-0921b05c-ae91-4a62-adaf-3dabd6670cf7 tempest-VolumesListAdminTestJSON-1168971102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.413s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:58 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-0921b05c-ae91-4a62-adaf-3dabd6670cf7 tempest-VolumesListAdminTestJSON-1168971102 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:58:58 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-0921b05c-ae91-4a62-adaf-3dabd6670cf7 tempest-VolumesListAdminTestJSON-1168971102 None] Deleted volume successfully.
Apr 15 15:58:58 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-0921b05c-ae91-4a62-adaf-3dabd6670cf7 tempest-VolumesListAdminTestJSON-1168971102 None] Lock "cinder-191061af-b3e8-4230-94c4-c9653e56f4f3-delete_volume" released by "delete_volume" :: held 2.756s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:58:58 devstack sudo[89157]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-57285c5a-81ee-404f-afe1-0375fc43906d tempest-VolumeDependencyTests-1015146606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ff014832-04d9-491b-91a2-1ec931ec5954" returned: 0 in 0.630s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:58 devstack cinder-volume[82485]: DEBUG cinder.image.image_utils [None req-57285c5a-81ee-404f-afe1-0375fc43906d tempest-VolumeDependencyTests-1015146606 None] Image conversion details: src /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ff014832-04d9-491b-91a2-1ec931ec5954, size 1024.00 MB, duration 2.09 sec, destination /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b3442355-2c5a-4d30-8928-739d2683a8c0 {{(pid=82485) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 15:58:58 devstack cinder-volume[82485]: INFO cinder.image.image_utils [None req-57285c5a-81ee-404f-afe1-0375fc43906d tempest-VolumeDependencyTests-1015146606 None] Converted 1024.00 MB image at 491.08 MB/s
Apr 15 15:58:58 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-57285c5a-81ee-404f-afe1-0375fc43906d tempest-VolumeDependencyTests-1015146606 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b3442355-2c5a-4d30-8928-739d2683a8c0 is being set with open permissions: ugo+rw
Apr 15 15:58:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-57285c5a-81ee-404f-afe1-0375fc43906d tempest-VolumeDependencyTests-1015146606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b3442355-2c5a-4d30-8928-739d2683a8c0 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:58 devstack sudo[89166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b3442355-2c5a-4d30-8928-739d2683a8c0
Apr 15 15:58:58 devstack sudo[89166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:59 devstack sudo[89166]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:59 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-57285c5a-81ee-404f-afe1-0375fc43906d tempest-VolumeDependencyTests-1015146606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b3442355-2c5a-4d30-8928-739d2683a8c0" returned: 0 in 0.451s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:59 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-57285c5a-81ee-404f-afe1-0375fc43906d tempest-VolumeDependencyTests-1015146606 None] Lock "cinder-quobyte-b3442355-2c5a-4d30-8928-739d2683a8c0" released by "_copy_volume_from_snapshot" :: held 4.221s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:58:59 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-57285c5a-81ee-404f-afe1-0375fc43906d tempest-VolumeDependencyTests-1015146606 None] Lock "cinder-quobyte-f420fa31-a107-42fb-a0d8-f010565acbd7-b3442355-2c5a-4d30-8928-739d2683a8c0" released by "_create_volume_from_snapshot" :: held 4.247s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:58:59 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-57285c5a-81ee-404f-afe1-0375fc43906d tempest-VolumeDependencyTests-1015146606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.268s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:58:59 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-57285c5a-81ee-404f-afe1-0375fc43906d tempest-VolumeDependencyTests-1015146606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51d2e533-09ce-4d59-8701-86bd485e3bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3442355-2c5a-4d30-8928-739d2683a8c0', 'volume_size': 1, 'snapshot_id': 'f420fa31-a107-42fb-a0d8-f010565acbd7'}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:59 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-57285c5a-81ee-404f-afe1-0375fc43906d tempest-VolumeDependencyTests-1015146606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3086d047-3b74-459a-baea-26790692c393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:58:59 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-57285c5a-81ee-404f-afe1-0375fc43906d tempest-VolumeDependencyTests-1015146606 None] Volume volume-b3442355-2c5a-4d30-8928-739d2683a8c0 (b3442355-2c5a-4d30-8928-739d2683a8c0): created successfully
Apr 15 15:58:59 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-57285c5a-81ee-404f-afe1-0375fc43906d tempest-VolumeDependencyTests-1015146606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3086d047-3b74-459a-baea-26790692c393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:58:59 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-57285c5a-81ee-404f-afe1-0375fc43906d tempest-VolumeDependencyTests-1015146606 None] Flow 'volume_create_manager' (3779070a-6ecf-4751-ae11-090008806008) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:58:59 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-57285c5a-81ee-404f-afe1-0375fc43906d tempest-VolumeDependencyTests-1015146606 None] Created volume successfully.
Apr 15 15:58:59 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-583a9e44-6b92-4719-98a6-e5cabf721421 tempest-VolumesListAdminTestJSON-1168971102 None] Acquiring lock "cinder-b7305a13-7da4-4a27-b384-b117b762be90-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:58:59 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-583a9e44-6b92-4719-98a6-e5cabf721421 tempest-VolumesListAdminTestJSON-1168971102 None] Lock "cinder-b7305a13-7da4-4a27-b384-b117b762be90-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:58:59 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-583a9e44-6b92-4719-98a6-e5cabf721421 tempest-VolumesListAdminTestJSON-1168971102 None] Acquiring lock "cinder-quobyte-b7305a13-7da4-4a27-b384-b117b762be90" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:58:59 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-583a9e44-6b92-4719-98a6-e5cabf721421 tempest-VolumesListAdminTestJSON-1168971102 None] Lock "cinder-quobyte-b7305a13-7da4-4a27-b384-b117b762be90" acquired by "delete_volume" :: waited 0.009s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:58:59 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dfaa247-804f-4c15-8272-63b0d569bff6]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:58:59 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-583a9e44-6b92-4719-98a6-e5cabf721421 tempest-VolumesListAdminTestJSON-1168971102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b7305a13-7da4-4a27-b384-b117b762be90 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:59 devstack sudo[89169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b7305a13-7da4-4a27-b384-b117b762be90
Apr 15 15:58:59 devstack sudo[89169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:58:59 devstack sudo[89169]: pam_unix(sudo:session): session closed for user root
Apr 15 15:58:59 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-583a9e44-6b92-4719-98a6-e5cabf721421 tempest-VolumesListAdminTestJSON-1168971102 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b7305a13-7da4-4a27-b384-b117b762be90" returned: 0 in 0.465s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:58:59 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-583a9e44-6b92-4719-98a6-e5cabf721421 tempest-VolumesListAdminTestJSON-1168971102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b7305a13-7da4-4a27-b384-b117b762be90 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:58:59 devstack sudo[89174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b7305a13-7da4-4a27-b384-b117b762be90
Apr 15 15:58:59 devstack sudo[89174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:00 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-867d5819-fca3-4220-a3db-21b0b1161d4c tempest-VolumeDependencyTests-1015146606 None] Acquiring lock "cinder-f420fa31-a107-42fb-a0d8-f010565acbd7-delete_snapshot" by "delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:59:00 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-867d5819-fca3-4220-a3db-21b0b1161d4c tempest-VolumeDependencyTests-1015146606 None] Lock "cinder-f420fa31-a107-42fb-a0d8-f010565acbd7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:59:00 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-867d5819-fca3-4220-a3db-21b0b1161d4c tempest-VolumeDependencyTests-1015146606 None] Acquiring lock "cinder-quobyte-ff014832-04d9-491b-91a2-1ec931ec5954" by "delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:59:00 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-867d5819-fca3-4220-a3db-21b0b1161d4c tempest-VolumeDependencyTests-1015146606 None] Lock "cinder-quobyte-ff014832-04d9-491b-91a2-1ec931ec5954" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:59:00 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-867d5819-fca3-4220-a3db-21b0b1161d4c tempest-VolumeDependencyTests-1015146606 None] Acquiring lock "cinder-quobyte-f420fa31-a107-42fb-a0d8-f010565acbd7" by "_delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:59:00 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-867d5819-fca3-4220-a3db-21b0b1161d4c tempest-VolumeDependencyTests-1015146606 None] Lock "cinder-quobyte-f420fa31-a107-42fb-a0d8-f010565acbd7" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:59:00 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-867d5819-fca3-4220-a3db-21b0b1161d4c tempest-VolumeDependencyTests-1015146606 None] Deleting offline snapshot f420fa31-a107-42fb-a0d8-f010565acbd7 of volume ff014832-04d9-491b-91a2-1ec931ec5954 {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 15:59:00 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-867d5819-fca3-4220-a3db-21b0b1161d4c tempest-VolumeDependencyTests-1015146606 None] snapshot_file for this snap is: volume-ff014832-04d9-491b-91a2-1ec931ec5954.f420fa31-a107-42fb-a0d8-f010565acbd7 {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 15:59:00 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e5d19d1-6d32-4c51-8519-79c3d3899ae1]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:59:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-867d5819-fca3-4220-a3db-21b0b1161d4c tempest-VolumeDependencyTests-1015146606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ff014832-04d9-491b-91a2-1ec931ec5954.f420fa31-a107-42fb-a0d8-f010565acbd7 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:00 devstack sudo[89174]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-583a9e44-6b92-4719-98a6-e5cabf721421 tempest-VolumesListAdminTestJSON-1168971102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b7305a13-7da4-4a27-b384-b117b762be90" returned: 0 in 0.455s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:00 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-583a9e44-6b92-4719-98a6-e5cabf721421 tempest-VolumesListAdminTestJSON-1168971102 None] Lock "cinder-quobyte-b7305a13-7da4-4a27-b384-b117b762be90" released by "delete_volume" :: held 0.949s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:59:00 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-583a9e44-6b92-4719-98a6-e5cabf721421 tempest-VolumesListAdminTestJSON-1168971102 None] Created reservations ['0d7a7846-42d2-4e17-a5ea-338c8a870e74', 'ed917049-6096-43d8-adc1-75c60fa7253f', '1322fd6f-d359-472f-a1f6-ed335fd34807', '2d9f1bfa-024c-403b-94ce-3dda4026be2a'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:59:00 devstack sudo[89177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ff014832-04d9-491b-91a2-1ec931ec5954.f420fa31-a107-42fb-a0d8-f010565acbd7
Apr 15 15:59:00 devstack sudo[89177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-583a9e44-6b92-4719-98a6-e5cabf721421 tempest-VolumesListAdminTestJSON-1168971102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:59:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-583a9e44-6b92-4719-98a6-e5cabf721421 tempest-VolumesListAdminTestJSON-1168971102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:59:00 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-583a9e44-6b92-4719-98a6-e5cabf721421 tempest-VolumesListAdminTestJSON-1168971102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:59:00 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-583a9e44-6b92-4719-98a6-e5cabf721421 tempest-VolumesListAdminTestJSON-1168971102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:59:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-583a9e44-6b92-4719-98a6-e5cabf721421 tempest-VolumesListAdminTestJSON-1168971102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:59:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-583a9e44-6b92-4719-98a6-e5cabf721421 tempest-VolumesListAdminTestJSON-1168971102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:00 devstack sudo[89179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:59:00 devstack sudo[89179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:00 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-2a9fa192-b5e0-4432-bf25-734d72aa57a6 tempest-VolumesListAdminTestJSON-1168971102 None] Acquiring lock "cinder-8abb057d-1cbc-41b2-84dc-28a763d1d5da-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:59:00 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-2a9fa192-b5e0-4432-bf25-734d72aa57a6 tempest-VolumesListAdminTestJSON-1168971102 None] Lock "cinder-8abb057d-1cbc-41b2-84dc-28a763d1d5da-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:59:00 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-2a9fa192-b5e0-4432-bf25-734d72aa57a6 tempest-VolumesListAdminTestJSON-1168971102 None] Acquiring lock "cinder-quobyte-8abb057d-1cbc-41b2-84dc-28a763d1d5da" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:59:00 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-2a9fa192-b5e0-4432-bf25-734d72aa57a6 tempest-VolumesListAdminTestJSON-1168971102 None] Lock "cinder-quobyte-8abb057d-1cbc-41b2-84dc-28a763d1d5da" acquired by "delete_volume" :: waited 0.009s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:59:00 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[202a389c-7a79-4ec0-809e-d4ff5bd80d28]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:59:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-2a9fa192-b5e0-4432-bf25-734d72aa57a6 tempest-VolumesListAdminTestJSON-1168971102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8abb057d-1cbc-41b2-84dc-28a763d1d5da {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:00 devstack sudo[89181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8abb057d-1cbc-41b2-84dc-28a763d1d5da
Apr 15 15:59:00 devstack sudo[89181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:00 devstack sudo[89177]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-867d5819-fca3-4220-a3db-21b0b1161d4c tempest-VolumeDependencyTests-1015146606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ff014832-04d9-491b-91a2-1ec931ec5954.f420fa31-a107-42fb-a0d8-f010565acbd7" returned: 0 in 0.536s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:00 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-867d5819-fca3-4220-a3db-21b0b1161d4c tempest-VolumeDependencyTests-1015146606 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff014832-04d9-491b-91a2-1ec931ec5954(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82485) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 15:59:00 devstack sudo[89179]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-583a9e44-6b92-4719-98a6-e5cabf721421 tempest-VolumesListAdminTestJSON-1168971102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.446s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:00 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-583a9e44-6b92-4719-98a6-e5cabf721421 tempest-VolumesListAdminTestJSON-1168971102 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:59:00 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-583a9e44-6b92-4719-98a6-e5cabf721421 tempest-VolumesListAdminTestJSON-1168971102 None] Deleted volume successfully.
Apr 15 15:59:00 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc600c9-2060-4861-bd40-f6f50df9394e]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:59:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-867d5819-fca3-4220-a3db-21b0b1161d4c tempest-VolumeDependencyTests-1015146606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ff014832-04d9-491b-91a2-1ec931ec5954 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:00 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-583a9e44-6b92-4719-98a6-e5cabf721421 tempest-VolumesListAdminTestJSON-1168971102 None] Lock "cinder-b7305a13-7da4-4a27-b384-b117b762be90-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:59:00 devstack sudo[89187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ff014832-04d9-491b-91a2-1ec931ec5954
Apr 15 15:59:00 devstack sudo[89187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:00 devstack sudo[89181]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-2a9fa192-b5e0-4432-bf25-734d72aa57a6 tempest-VolumesListAdminTestJSON-1168971102 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8abb057d-1cbc-41b2-84dc-28a763d1d5da" returned: 0 in 0.515s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-2a9fa192-b5e0-4432-bf25-734d72aa57a6 tempest-VolumesListAdminTestJSON-1168971102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8abb057d-1cbc-41b2-84dc-28a763d1d5da {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:00 devstack sudo[89192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8abb057d-1cbc-41b2-84dc-28a763d1d5da
Apr 15 15:59:00 devstack sudo[89192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:01 devstack sudo[89187]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:01 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-867d5819-fca3-4220-a3db-21b0b1161d4c tempest-VolumeDependencyTests-1015146606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ff014832-04d9-491b-91a2-1ec931ec5954" returned: 0 in 0.475s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:01 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-867d5819-fca3-4220-a3db-21b0b1161d4c tempest-VolumeDependencyTests-1015146606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ff014832-04d9-491b-91a2-1ec931ec5954.f420fa31-a107-42fb-a0d8-f010565acbd7 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:01 devstack sudo[89197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ff014832-04d9-491b-91a2-1ec931ec5954.f420fa31-a107-42fb-a0d8-f010565acbd7
Apr 15 15:59:01 devstack sudo[89197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:01 devstack sudo[89192]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:01 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-2a9fa192-b5e0-4432-bf25-734d72aa57a6 tempest-VolumesListAdminTestJSON-1168971102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8abb057d-1cbc-41b2-84dc-28a763d1d5da" returned: 0 in 0.437s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:01 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-2a9fa192-b5e0-4432-bf25-734d72aa57a6 tempest-VolumesListAdminTestJSON-1168971102 None] Lock "cinder-quobyte-8abb057d-1cbc-41b2-84dc-28a763d1d5da" released by "delete_volume" :: held 0.975s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:59:01 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-2a9fa192-b5e0-4432-bf25-734d72aa57a6 tempest-VolumesListAdminTestJSON-1168971102 None] Created reservations ['684d9c2e-43fe-4784-b071-1086643bccab', '70da277f-c44a-42e2-bfdd-0973dbc0ce61', '1aff39cc-1d0f-40b4-bd91-49a998d1a821', 'fbf1abb0-205f-489a-aaf3-8634ca883c10'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:59:01 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-2a9fa192-b5e0-4432-bf25-734d72aa57a6 tempest-VolumesListAdminTestJSON-1168971102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:59:01 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-2a9fa192-b5e0-4432-bf25-734d72aa57a6 tempest-VolumesListAdminTestJSON-1168971102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:59:01 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-2a9fa192-b5e0-4432-bf25-734d72aa57a6 tempest-VolumesListAdminTestJSON-1168971102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:59:01 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-2a9fa192-b5e0-4432-bf25-734d72aa57a6 tempest-VolumesListAdminTestJSON-1168971102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:59:01 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-2a9fa192-b5e0-4432-bf25-734d72aa57a6 tempest-VolumesListAdminTestJSON-1168971102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:59:01 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-2a9fa192-b5e0-4432-bf25-734d72aa57a6 tempest-VolumesListAdminTestJSON-1168971102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:01 devstack sudo[89200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:59:01 devstack sudo[89200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:01 devstack sudo[89197]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:01 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-867d5819-fca3-4220-a3db-21b0b1161d4c tempest-VolumeDependencyTests-1015146606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ff014832-04d9-491b-91a2-1ec931ec5954.f420fa31-a107-42fb-a0d8-f010565acbd7" returned: 0 in 0.494s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:01 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-867d5819-fca3-4220-a3db-21b0b1161d4c tempest-VolumeDependencyTests-1015146606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ff014832-04d9-491b-91a2-1ec931ec5954.f420fa31-a107-42fb-a0d8-f010565acbd7 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:01 devstack sudo[89205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ff014832-04d9-491b-91a2-1ec931ec5954.f420fa31-a107-42fb-a0d8-f010565acbd7
Apr 15 15:59:01 devstack sudo[89205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:01 devstack sudo[89200]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:01 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-2a9fa192-b5e0-4432-bf25-734d72aa57a6 tempest-VolumesListAdminTestJSON-1168971102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.458s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:01 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-2a9fa192-b5e0-4432-bf25-734d72aa57a6 tempest-VolumesListAdminTestJSON-1168971102 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:59:01 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-2a9fa192-b5e0-4432-bf25-734d72aa57a6 tempest-VolumesListAdminTestJSON-1168971102 None] Deleted volume successfully.
Apr 15 15:59:01 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-2a9fa192-b5e0-4432-bf25-734d72aa57a6 tempest-VolumesListAdminTestJSON-1168971102 None] Lock "cinder-8abb057d-1cbc-41b2-84dc-28a763d1d5da-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:59:02 devstack sudo[89205]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:02 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-867d5819-fca3-4220-a3db-21b0b1161d4c tempest-VolumeDependencyTests-1015146606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ff014832-04d9-491b-91a2-1ec931ec5954.f420fa31-a107-42fb-a0d8-f010565acbd7" returned: 0 in 0.451s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:02 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-867d5819-fca3-4220-a3db-21b0b1161d4c tempest-VolumeDependencyTests-1015146606 None] Lock "cinder-quobyte-f420fa31-a107-42fb-a0d8-f010565acbd7" released by "_delete_snapshot" :: held 2.035s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:59:02 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-867d5819-fca3-4220-a3db-21b0b1161d4c tempest-VolumeDependencyTests-1015146606 None] Lock "cinder-quobyte-ff014832-04d9-491b-91a2-1ec931ec5954" released by "delete_snapshot" :: held 2.047s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:59:02 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-867d5819-fca3-4220-a3db-21b0b1161d4c tempest-VolumeDependencyTests-1015146606 None] Created reservations ['d59bad09-edfc-44a3-afb0-4088a8d0465b', 'fd3d4da2-044a-4731-afcd-b0f153adb212', '99dfe30b-941b-4314-b5a8-7377d2bb1cf5', '19ac3d81-574b-4d17-a4f2-19e5faa4234b'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:59:02 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-867d5819-fca3-4220-a3db-21b0b1161d4c tempest-VolumeDependencyTests-1015146606 None] Delete snapshot completed successfully.
Apr 15 15:59:02 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-867d5819-fca3-4220-a3db-21b0b1161d4c tempest-VolumeDependencyTests-1015146606 None] Lock "cinder-f420fa31-a107-42fb-a0d8-f010565acbd7-delete_snapshot" released by "delete_snapshot" :: held 2.139s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:59:03 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-64b6f78b-af1c-4a3b-9639-2cc633554bb9 tempest-VolumeDependencyTests-1015146606 None] Acquiring lock "cinder-ff014832-04d9-491b-91a2-1ec931ec5954-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:59:03 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-64b6f78b-af1c-4a3b-9639-2cc633554bb9 tempest-VolumeDependencyTests-1015146606 None] Lock "cinder-ff014832-04d9-491b-91a2-1ec931ec5954-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:59:03 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-64b6f78b-af1c-4a3b-9639-2cc633554bb9 tempest-VolumeDependencyTests-1015146606 None] Acquiring lock "cinder-quobyte-ff014832-04d9-491b-91a2-1ec931ec5954" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:59:03 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-64b6f78b-af1c-4a3b-9639-2cc633554bb9 tempest-VolumeDependencyTests-1015146606 None] Lock "cinder-quobyte-ff014832-04d9-491b-91a2-1ec931ec5954" acquired by "delete_volume" :: waited 0.009s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:59:03 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[01070c5b-c071-4696-871f-b00144751253]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:59:03 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-64b6f78b-af1c-4a3b-9639-2cc633554bb9 tempest-VolumeDependencyTests-1015146606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ff014832-04d9-491b-91a2-1ec931ec5954 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:03 devstack sudo[89209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ff014832-04d9-491b-91a2-1ec931ec5954
Apr 15 15:59:03 devstack sudo[89209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:03 devstack sudo[89209]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:03 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-64b6f78b-af1c-4a3b-9639-2cc633554bb9 tempest-VolumeDependencyTests-1015146606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ff014832-04d9-491b-91a2-1ec931ec5954" returned: 0 in 0.635s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:03 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-64b6f78b-af1c-4a3b-9639-2cc633554bb9 tempest-VolumeDependencyTests-1015146606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ff014832-04d9-491b-91a2-1ec931ec5954 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:03 devstack sudo[89214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ff014832-04d9-491b-91a2-1ec931ec5954
Apr 15 15:59:03 devstack sudo[89214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:04 devstack sudo[89214]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:04 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-64b6f78b-af1c-4a3b-9639-2cc633554bb9 tempest-VolumeDependencyTests-1015146606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ff014832-04d9-491b-91a2-1ec931ec5954" returned: 0 in 0.471s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:04 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-64b6f78b-af1c-4a3b-9639-2cc633554bb9 tempest-VolumeDependencyTests-1015146606 None] Lock "cinder-quobyte-ff014832-04d9-491b-91a2-1ec931ec5954" released by "delete_volume" :: held 1.147s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:59:04 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-64b6f78b-af1c-4a3b-9639-2cc633554bb9 tempest-VolumeDependencyTests-1015146606 None] Created reservations ['e00f2398-06da-4b17-afae-0e33a8d78d28', 'acbc866a-6909-4e40-bf8a-190938c34273', '9dfbef2b-e106-48cf-9921-3059021048d7', '5e0e6adb-bc24-4f95-8e65-0db0bc87e8bc'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:59:04 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-64b6f78b-af1c-4a3b-9639-2cc633554bb9 tempest-VolumeDependencyTests-1015146606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:59:04 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-64b6f78b-af1c-4a3b-9639-2cc633554bb9 tempest-VolumeDependencyTests-1015146606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:59:04 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-64b6f78b-af1c-4a3b-9639-2cc633554bb9 tempest-VolumeDependencyTests-1015146606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:59:04 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-64b6f78b-af1c-4a3b-9639-2cc633554bb9 tempest-VolumeDependencyTests-1015146606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:59:04 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-64b6f78b-af1c-4a3b-9639-2cc633554bb9 tempest-VolumeDependencyTests-1015146606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:59:04 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-64b6f78b-af1c-4a3b-9639-2cc633554bb9 tempest-VolumeDependencyTests-1015146606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:04 devstack sudo[89217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:59:04 devstack sudo[89217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:04 devstack sudo[89217]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:04 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-64b6f78b-af1c-4a3b-9639-2cc633554bb9 tempest-VolumeDependencyTests-1015146606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.477s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:04 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-64b6f78b-af1c-4a3b-9639-2cc633554bb9 tempest-VolumeDependencyTests-1015146606 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:59:04 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-64b6f78b-af1c-4a3b-9639-2cc633554bb9 tempest-VolumeDependencyTests-1015146606 None] Deleted volume successfully.
Apr 15 15:59:04 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-64b6f78b-af1c-4a3b-9639-2cc633554bb9 tempest-VolumeDependencyTests-1015146606 None] Lock "cinder-ff014832-04d9-491b-91a2-1ec931ec5954-delete_volume" released by "delete_volume" :: held 1.770s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:59:05 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-b049048f-759c-4f3d-95da-28ac8b748855 tempest-VolumeDependencyTests-1015146606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:59:05 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b049048f-759c-4f3d-95da-28ac8b748855 tempest-VolumeDependencyTests-1015146606 None] Flow 'volume_create_manager' (ac2dc308-3be1-430b-9452-f4c496ac1884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:59:05 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b049048f-759c-4f3d-95da-28ac8b748855 tempest-VolumeDependencyTests-1015146606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a62b10e1-d658-4209-85fd-f3e9bdf1ead6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:59:05 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b049048f-759c-4f3d-95da-28ac8b748855 tempest-VolumeDependencyTests-1015146606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a62b10e1-d658-4209-85fd-f3e9bdf1ead6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:59:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1853153798',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8440b2e-272f-4896-82fe-51e1f82435a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='763d02579b334f69bb3cd648af9f23e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:59:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:59:06Z,use_quota=True,user_id='323c7dd322ea450493760c8a485511dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:59:05 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b049048f-759c-4f3d-95da-28ac8b748855 tempest-VolumeDependencyTests-1015146606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10dfd79c-cc2d-4d45-a609-af94cadc2612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:59:05 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b049048f-759c-4f3d-95da-28ac8b748855 tempest-VolumeDependencyTests-1015146606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10dfd79c-cc2d-4d45-a609-af94cadc2612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:59:05 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b049048f-759c-4f3d-95da-28ac8b748855 tempest-VolumeDependencyTests-1015146606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3abaddd-f439-4c75-9bbf-399bacd11bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:59:05 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b049048f-759c-4f3d-95da-28ac8b748855 tempest-VolumeDependencyTests-1015146606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3abaddd-f439-4c75-9bbf-399bacd11bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8440b2e-272f-4896-82fe-51e1f82435a5', 'volume_name': 'volume-b8440b2e-272f-4896-82fe-51e1f82435a5', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:59:05 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b049048f-759c-4f3d-95da-28ac8b748855 tempest-VolumeDependencyTests-1015146606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa572dbe-a0b9-4316-af6a-f26cbca44600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:59:05 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b049048f-759c-4f3d-95da-28ac8b748855 tempest-VolumeDependencyTests-1015146606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa572dbe-a0b9-4316-af6a-f26cbca44600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:59:05 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b049048f-759c-4f3d-95da-28ac8b748855 tempest-VolumeDependencyTests-1015146606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5306557e-46be-4345-9674-dd945538e562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:59:05 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-b049048f-759c-4f3d-95da-28ac8b748855 tempest-VolumeDependencyTests-1015146606 None] Volume b8440b2e-272f-4896-82fe-51e1f82435a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8440b2e-272f-4896-82fe-51e1f82435a5', 'volume_size': 1}
Apr 15 15:59:05 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-b049048f-759c-4f3d-95da-28ac8b748855 tempest-VolumeDependencyTests-1015146606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:59:05 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-b049048f-759c-4f3d-95da-28ac8b748855 tempest-VolumeDependencyTests-1015146606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:59:05 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-b049048f-759c-4f3d-95da-28ac8b748855 tempest-VolumeDependencyTests-1015146606 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:59:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1853153798',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8440b2e-272f-4896-82fe-51e1f82435a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='763d02579b334f69bb3cd648af9f23e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:59:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:59:06Z,use_quota=True,user_id='323c7dd322ea450493760c8a485511dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:59:05 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-b049048f-759c-4f3d-95da-28ac8b748855 tempest-VolumeDependencyTests-1015146606 None] Creating volume b8440b2e-272f-4896-82fe-51e1f82435a5 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:59:05 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-b049048f-759c-4f3d-95da-28ac8b748855 tempest-VolumeDependencyTests-1015146606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:59:05 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-b049048f-759c-4f3d-95da-28ac8b748855 tempest-VolumeDependencyTests-1015146606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:59:05 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-b049048f-759c-4f3d-95da-28ac8b748855 tempest-VolumeDependencyTests-1015146606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:59:05 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-b049048f-759c-4f3d-95da-28ac8b748855 tempest-VolumeDependencyTests-1015146606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:59:05 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-b049048f-759c-4f3d-95da-28ac8b748855 tempest-VolumeDependencyTests-1015146606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:59:05 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-b049048f-759c-4f3d-95da-28ac8b748855 tempest-VolumeDependencyTests-1015146606 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:59:05 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-b049048f-759c-4f3d-95da-28ac8b748855 tempest-VolumeDependencyTests-1015146606 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:59:05 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b049048f-759c-4f3d-95da-28ac8b748855 tempest-VolumeDependencyTests-1015146606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8440b2e-272f-4896-82fe-51e1f82435a5 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:05 devstack sudo[89221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8440b2e-272f-4896-82fe-51e1f82435a5 1073741824
Apr 15 15:59:05 devstack sudo[89221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:06 devstack sudo[89221]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:06 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b049048f-759c-4f3d-95da-28ac8b748855 tempest-VolumeDependencyTests-1015146606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8440b2e-272f-4896-82fe-51e1f82435a5 1073741824" returned: 0 in 0.583s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:06 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b049048f-759c-4f3d-95da-28ac8b748855 tempest-VolumeDependencyTests-1015146606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8440b2e-272f-4896-82fe-51e1f82435a5 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:06 devstack sudo[89226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8440b2e-272f-4896-82fe-51e1f82435a5
Apr 15 15:59:06 devstack sudo[89226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:06 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:59:06 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] Flow 'volume_create_manager' (4e3615b0-b909-4d18-862c-4a3f7662fe4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:59:06 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9b397d8-e7b2-4c9d-92f4-d632076beb02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:59:06 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9b397d8-e7b2-4c9d-92f4-d632076beb02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:59:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1225882042',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f466d321-8fa9-4ede-b49c-acbdeb460bb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a7c2819283448b9a05a6ee7a532040e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:59:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:59:06Z,use_quota=True,user_id='319d619b84104ab4ba1cc1559acb30d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:59:06 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16c3dd6c-7957-47f3-97c1-28cdb35ec103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:59:06 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16c3dd6c-7957-47f3-97c1-28cdb35ec103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:59:06 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f06b7a88-0c22-436e-bc8a-eab48d173946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:59:06 devstack cinder-volume[82485]: DEBUG cinder.image.glance [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] Creating Keystone auth plugin from conf {{(pid=82485) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 15 15:59:06 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f06b7a88-0c22-436e-bc8a-eab48d173946) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f466d321-8fa9-4ede-b49c-acbdeb460bb8', 'volume_name': 'volume-f466d321-8fa9-4ede-b49c-acbdeb460bb8', 'volume_size': 1, 'image_id': '0fe37db8-916e-4521-8f72-73003c13994a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0fe37db8-916e-4521-8f72-73003c13994a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '57491fc0e71d4fad9011d017ccefe515', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0fe37db8-916e-4521-8f72-73003c13994a', 'created_at': datetime.datetime(2026, 4, 15, 13, 47, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 13, 47, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0fe37db8-916e-4521-8f72-73003c13994a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f153f006710>}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:59:06 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64687cf4-67e9-47f6-be82-0e41ae0dd6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:59:06 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64687cf4-67e9-47f6-be82-0e41ae0dd6f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:59:06 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9135156-345a-4c72-8b6b-2523f9094e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:59:06 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] Volume f466d321-8fa9-4ede-b49c-acbdeb460bb8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f466d321-8fa9-4ede-b49c-acbdeb460bb8', 'volume_size': 1, 'image_id': '0fe37db8-916e-4521-8f72-73003c13994a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0fe37db8-916e-4521-8f72-73003c13994a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '57491fc0e71d4fad9011d017ccefe515', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0fe37db8-916e-4521-8f72-73003c13994a', 'created_at': datetime.datetime(2026, 4, 15, 13, 47, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 13, 47, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0fe37db8-916e-4521-8f72-73003c13994a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f153f006710>}
Apr 15 15:59:06 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] Trying to clone f466d321-8fa9-4ede-b49c-acbdeb460bb8 from image 0fe37db8-916e-4521-8f72-73003c13994a at location (None, [{'url': 'file:///opt/stack/data/glance/images/0fe37db8-916e-4521-8f72-73003c13994a', 'metadata': {}}]). {{(pid=82485) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 15 15:59:06 devstack sudo[89226]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:06 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b049048f-759c-4f3d-95da-28ac8b748855 tempest-VolumeDependencyTests-1015146606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8440b2e-272f-4896-82fe-51e1f82435a5" returned: 0 in 0.547s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:06 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-b049048f-759c-4f3d-95da-28ac8b748855 tempest-VolumeDependencyTests-1015146606 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:59:06 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-b049048f-759c-4f3d-95da-28ac8b748855 tempest-VolumeDependencyTests-1015146606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.161s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:59:06 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b049048f-759c-4f3d-95da-28ac8b748855 tempest-VolumeDependencyTests-1015146606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5306557e-46be-4345-9674-dd945538e562) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8440b2e-272f-4896-82fe-51e1f82435a5', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:59:06 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b049048f-759c-4f3d-95da-28ac8b748855 tempest-VolumeDependencyTests-1015146606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4742aa8b-41ad-4538-bdf8-0532af02e2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:59:06 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-b049048f-759c-4f3d-95da-28ac8b748855 tempest-VolumeDependencyTests-1015146606 None] Volume volume-b8440b2e-272f-4896-82fe-51e1f82435a5 (b8440b2e-272f-4896-82fe-51e1f82435a5): created successfully
Apr 15 15:59:06 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b049048f-759c-4f3d-95da-28ac8b748855 tempest-VolumeDependencyTests-1015146606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4742aa8b-41ad-4538-bdf8-0532af02e2c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:59:06 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-b049048f-759c-4f3d-95da-28ac8b748855 tempest-VolumeDependencyTests-1015146606 None] Flow 'volume_create_manager' (ac2dc308-3be1-430b-9452-f4c496ac1884) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:59:06 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-b049048f-759c-4f3d-95da-28ac8b748855 tempest-VolumeDependencyTests-1015146606 None] Created volume successfully.
Apr 15 15:59:06 devstack cinder-volume[82485]: DEBUG cinder.image.image_utils [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0fe37db8-916e-4521-8f72-73003c13994a_946ir6g2devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82485) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 15 15:59:06 devstack cinder-volume[82485]: INFO cinder.image.image_utils [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] Image download 20.69 MB at 20.69 MB/s
Apr 15 15:59:07 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97d267d-b021-40b7-9f7d-49e3818bb7a9]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:59:07 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fe37db8-916e-4521-8f72-73003c13994a_946ir6g2devstack@QuobyteHD {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:07 devstack sudo[89230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fe37db8-916e-4521-8f72-73003c13994a_946ir6g2devstack@QuobyteHD
Apr 15 15:59:07 devstack sudo[89230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:07 devstack sudo[89230]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:07 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fe37db8-916e-4521-8f72-73003c13994a_946ir6g2devstack@QuobyteHD" returned: 0 in 0.471s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:07 devstack cinder-volume[82485]: DEBUG cinder.image.image_utils [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] Temporary image 0fe37db8-916e-4521-8f72-73003c13994a is fetched for user 319d619b84104ab4ba1cc1559acb30d7. {{(pid=82485) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 15 15:59:07 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cbccca7-4c8a-4721-a250-877193c1a1a6]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:59:07 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fe37db8-916e-4521-8f72-73003c13994a_946ir6g2devstack@QuobyteHD {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:07 devstack sudo[89235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fe37db8-916e-4521-8f72-73003c13994a_946ir6g2devstack@QuobyteHD
Apr 15 15:59:07 devstack sudo[89235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:08 devstack sudo[89235]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:08 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fe37db8-916e-4521-8f72-73003c13994a_946ir6g2devstack@QuobyteHD" returned: 0 in 0.500s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:08 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:59:08 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:59:08 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:59:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1225882042',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f466d321-8fa9-4ede-b49c-acbdeb460bb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a7c2819283448b9a05a6ee7a532040e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:59:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:59:06Z,use_quota=True,user_id='319d619b84104ab4ba1cc1559acb30d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:59:08 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] Creating volume f466d321-8fa9-4ede-b49c-acbdeb460bb8 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:59:08 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:59:08 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:59:08 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:59:08 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:59:08 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:59:08 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:59:08 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:59:08 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f466d321-8fa9-4ede-b49c-acbdeb460bb8 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:08 devstack sudo[89240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f466d321-8fa9-4ede-b49c-acbdeb460bb8 1073741824
Apr 15 15:59:08 devstack sudo[89240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:08 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:59:08 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] Flow 'volume_create_manager' (97317f42-77fb-4ec2-b631-096eab27f59a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:59:08 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (473bc53a-7c74-429d-998d-686392a46c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:59:08 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (473bc53a-7c74-429d-998d-686392a46c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:59:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1697284712',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=599a359d-a5dc-46ff-b82c-c7ecc0dd5a28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='763d02579b334f69bb3cd648af9f23e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:59:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=b8440b2e-272f-4896-82fe-51e1f82435a5,status='creating',terminated_at=None,updated_at=2026-04-15T13:59:08Z,use_quota=True,user_id='323c7dd322ea450493760c8a485511dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:59:08 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b16d6e03-fd15-40a1-aefe-dcdbd7dc45d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:59:08 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b16d6e03-fd15-40a1-aefe-dcdbd7dc45d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:59:08 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f461e13-b084-4fb2-80df-46a368f15889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:59:08 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f461e13-b084-4fb2-80df-46a368f15889) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '599a359d-a5dc-46ff-b82c-c7ecc0dd5a28', 'volume_name': 'volume-599a359d-a5dc-46ff-b82c-c7ecc0dd5a28', 'volume_size': 1, 'source_volid': 'b8440b2e-272f-4896-82fe-51e1f82435a5', 'source_volstatus': 'available'}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:59:08 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d49a032c-7e61-4077-905b-c90a1e247a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:59:08 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d49a032c-7e61-4077-905b-c90a1e247a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:59:08 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e1c77a0-d86b-4a4e-a89a-5783de310b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:59:08 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] Volume 599a359d-a5dc-46ff-b82c-c7ecc0dd5a28: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-599a359d-a5dc-46ff-b82c-c7ecc0dd5a28', 'volume_size': 1, 'source_volid': 'b8440b2e-272f-4896-82fe-51e1f82435a5', 'source_volstatus': 'available'}
Apr 15 15:59:08 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:59:08 devstack sudo[89240]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:08 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f466d321-8fa9-4ede-b49c-acbdeb460bb8 1073741824" returned: 0 in 0.527s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:08 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f466d321-8fa9-4ede-b49c-acbdeb460bb8 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:08 devstack sudo[89245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f466d321-8fa9-4ede-b49c-acbdeb460bb8
Apr 15 15:59:08 devstack sudo[89245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:09 devstack sudo[89245]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:09 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f466d321-8fa9-4ede-b49c-acbdeb460bb8" returned: 0 in 0.428s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:09 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:59:09 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:59:09 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.856s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:59:09 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] Cloning volume b8440b2e-272f-4896-82fe-51e1f82435a5 to volume 599a359d-a5dc-46ff-b82c-c7ecc0dd5a28
Apr 15 15:59:09 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] Creating offline snapshot 7f5b9c07-d167-404b-9c8b-0f9ccd86d591 of volume b8440b2e-272f-4896-82fe-51e1f82435a5 {{(pid=82485) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 15:59:09 devstack cinder-volume[82485]: DEBUG cinder.volume.volume_utils [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] Attempting download of 0fe37db8-916e-4521-8f72-73003c13994a ((None, [{'url': 'file:///opt/stack/data/glance/images/0fe37db8-916e-4521-8f72-73003c13994a', 'metadata': {}}])) to volume f466d321-8fa9-4ede-b49c-acbdeb460bb8. {{(pid=82485) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 15 15:59:09 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa40fbe-f65b-4857-b9aa-4e5e096e2ed1]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:59:09 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8440b2e-272f-4896-82fe-51e1f82435a5 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:09 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bef579f-148c-45fe-9d8a-202716614f73]: (4, 'raw') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:59:09 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0fe37db8-916e-4521-8f72-73003c13994a_nq46ybf9 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:09 devstack sudo[89248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8440b2e-272f-4896-82fe-51e1f82435a5
Apr 15 15:59:09 devstack sudo[89248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:09 devstack sudo[89249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0fe37db8-916e-4521-8f72-73003c13994a_nq46ybf9
Apr 15 15:59:09 devstack sudo[89249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:09 devstack sudo[89248]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:09 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8440b2e-272f-4896-82fe-51e1f82435a5" returned: 0 in 0.486s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:09 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8440b2e-272f-4896-82fe-51e1f82435a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8440b2e-272f-4896-82fe-51e1f82435a5.7f5b9c07-d167-404b-9c8b-0f9ccd86d591 1G {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:09 devstack sudo[89257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8440b2e-272f-4896-82fe-51e1f82435a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8440b2e-272f-4896-82fe-51e1f82435a5.7f5b9c07-d167-404b-9c8b-0f9ccd86d591 1G
Apr 15 15:59:09 devstack sudo[89257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:09 devstack sudo[89249]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:09 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0fe37db8-916e-4521-8f72-73003c13994a_nq46ybf9" returned: 0 in 0.485s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:09 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0fe37db8-916e-4521-8f72-73003c13994a_nq46ybf9 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:09 devstack sudo[89259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0fe37db8-916e-4521-8f72-73003c13994a_nq46ybf9
Apr 15 15:59:09 devstack sudo[89259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:10 devstack sudo[89257]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8440b2e-272f-4896-82fe-51e1f82435a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8440b2e-272f-4896-82fe-51e1f82435a5.7f5b9c07-d167-404b-9c8b-0f9ccd86d591 1G" returned: 0 in 0.494s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8440b2e-272f-4896-82fe-51e1f82435a5 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8440b2e-272f-4896-82fe-51e1f82435a5.7f5b9c07-d167-404b-9c8b-0f9ccd86d591 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:10 devstack sudo[89259]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0fe37db8-916e-4521-8f72-73003c13994a_nq46ybf9" returned: 1 in 0.475s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0fe37db8-916e-4521-8f72-73003c13994a_nq46ybf9' failed. Not Retrying. {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 15:59:10 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[e462de8e-7398-42b2-8eda-c3b73188a795]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:59:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fe37db8-916e-4521-8f72-73003c13994a_946ir6g2devstack@QuobyteHD {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:10 devstack sudo[89266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8440b2e-272f-4896-82fe-51e1f82435a5 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8440b2e-272f-4896-82fe-51e1f82435a5.7f5b9c07-d167-404b-9c8b-0f9ccd86d591
Apr 15 15:59:10 devstack sudo[89266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:10 devstack sudo[89267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fe37db8-916e-4521-8f72-73003c13994a_946ir6g2devstack@QuobyteHD
Apr 15 15:59:10 devstack sudo[89267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:10 devstack sudo[89266]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8440b2e-272f-4896-82fe-51e1f82435a5 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8440b2e-272f-4896-82fe-51e1f82435a5.7f5b9c07-d167-404b-9c8b-0f9ccd86d591" returned: 0 in 0.498s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:10 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8440b2e-272f-4896-82fe-51e1f82435a5.7f5b9c07-d167-404b-9c8b-0f9ccd86d591 is being set with open permissions: ugo+rw
Apr 15 15:59:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8440b2e-272f-4896-82fe-51e1f82435a5.7f5b9c07-d167-404b-9c8b-0f9ccd86d591 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:10 devstack sudo[89276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8440b2e-272f-4896-82fe-51e1f82435a5.7f5b9c07-d167-404b-9c8b-0f9ccd86d591
Apr 15 15:59:10 devstack sudo[89276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:10 devstack sudo[89267]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fe37db8-916e-4521-8f72-73003c13994a_946ir6g2devstack@QuobyteHD" returned: 0 in 0.506s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:10 devstack cinder-volume[82485]: DEBUG cinder.image.image_utils [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] 0fe37db8-916e-4521-8f72-73003c13994a was qcow2, converting to raw {{(pid=82485) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 15 15:59:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0fe37db8-916e-4521-8f72-73003c13994a_946ir6g2devstack@QuobyteHD /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f466d321-8fa9-4ede-b49c-acbdeb460bb8 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:10 devstack sudo[89278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0fe37db8-916e-4521-8f72-73003c13994a_946ir6g2devstack@QuobyteHD /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f466d321-8fa9-4ede-b49c-acbdeb460bb8
Apr 15 15:59:10 devstack sudo[89278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:10 devstack sudo[89276]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:11 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8440b2e-272f-4896-82fe-51e1f82435a5.7f5b9c07-d167-404b-9c8b-0f9ccd86d591" returned: 0 in 0.434s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:11 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8440b2e-272f-4896-82fe-51e1f82435a5.info {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:11 devstack sudo[89297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8440b2e-272f-4896-82fe-51e1f82435a5.info
Apr 15 15:59:11 devstack sudo[89297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:11 devstack sudo[89278]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:11 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0fe37db8-916e-4521-8f72-73003c13994a_946ir6g2devstack@QuobyteHD /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f466d321-8fa9-4ede-b49c-acbdeb460bb8" returned: 0 in 0.942s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:11 devstack cinder-volume[82485]: DEBUG cinder.image.image_utils [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0fe37db8-916e-4521-8f72-73003c13994a_946ir6g2devstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f466d321-8fa9-4ede-b49c-acbdeb460bb8 {{(pid=82485) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 15:59:11 devstack cinder-volume[82485]: INFO cinder.image.image_utils [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] Converted 112.00 MB image at 112.00 MB/s
Apr 15 15:59:11 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f466d321-8fa9-4ede-b49c-acbdeb460bb8 1G {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:11 devstack sudo[89297]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:11 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8440b2e-272f-4896-82fe-51e1f82435a5.info" returned: 0 in 0.528s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:11 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8440b2e-272f-4896-82fe-51e1f82435a5.info is being set with open permissions: ugo+rw
Apr 15 15:59:11 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8440b2e-272f-4896-82fe-51e1f82435a5.info {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:11 devstack sudo[89300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f466d321-8fa9-4ede-b49c-acbdeb460bb8 1G
Apr 15 15:59:11 devstack sudo[89300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:11 devstack sudo[89301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8440b2e-272f-4896-82fe-51e1f82435a5.info
Apr 15 15:59:11 devstack sudo[89301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:11 devstack sudo[89301]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:11 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8440b2e-272f-4896-82fe-51e1f82435a5.info" returned: 0 in 0.422s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:11 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] Acquiring lock "cinder-quobyte-599a359d-a5dc-46ff-b82c-c7ecc0dd5a28" by "_copy_volume_from_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:59:11 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] Lock "cinder-quobyte-599a359d-a5dc-46ff-b82c-c7ecc0dd5a28" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:59:11 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] snapshot: 7f5b9c07-d167-404b-9c8b-0f9ccd86d591, volume: 599a359d-a5dc-46ff-b82c-c7ecc0dd5a28,  {{(pid=82485) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 15 15:59:11 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:59:11 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:59:11 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:59:12 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:59:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:59:12 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[73215a45-88c6-40a7-a363-acd2cc286180]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:59:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8440b2e-272f-4896-82fe-51e1f82435a5.7f5b9c07-d167-404b-9c8b-0f9ccd86d591 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:12 devstack sudo[89300]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f466d321-8fa9-4ede-b49c-acbdeb460bb8 1G" returned: 0 in 0.481s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:12 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[409356a2-062e-4bcb-bd0d-824ecb7f43dd]: (4, 'raw') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:59:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f466d321-8fa9-4ede-b49c-acbdeb460bb8 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:12 devstack sudo[89308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8440b2e-272f-4896-82fe-51e1f82435a5.7f5b9c07-d167-404b-9c8b-0f9ccd86d591
Apr 15 15:59:12 devstack sudo[89308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:12 devstack sudo[89309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f466d321-8fa9-4ede-b49c-acbdeb460bb8
Apr 15 15:59:12 devstack sudo[89309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:12 devstack sudo[89308]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8440b2e-272f-4896-82fe-51e1f82435a5.7f5b9c07-d167-404b-9c8b-0f9ccd86d591" returned: 0 in 0.483s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:12 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b8440b2e-272f-4896-82fe-51e1f82435a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82485) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 15:59:12 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] will copy from snapshot at /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8440b2e-272f-4896-82fe-51e1f82435a5 {{(pid=82485) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 15 15:59:12 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] Creating direct copy from snapshot {{(pid=82485) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 15 15:59:12 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[751e13e7-5507-44a2-a9e9-ffbbaa7b33e5]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:59:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8440b2e-272f-4896-82fe-51e1f82435a5 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:12 devstack sudo[89309]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f466d321-8fa9-4ede-b49c-acbdeb460bb8" returned: 0 in 0.491s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f466d321-8fa9-4ede-b49c-acbdeb460bb8 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:12 devstack sudo[89317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8440b2e-272f-4896-82fe-51e1f82435a5
Apr 15 15:59:12 devstack sudo[89317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:12 devstack sudo[89318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f466d321-8fa9-4ede-b49c-acbdeb460bb8
Apr 15 15:59:12 devstack sudo[89318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:12 devstack sudo[89317]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8440b2e-272f-4896-82fe-51e1f82435a5" returned: 0 in 0.481s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:12 devstack cinder-volume[82485]: DEBUG cinder.utils [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] Path /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-599a359d-a5dc-46ff-b82c-c7ecc0dd5a28 not found in is_blk_device check {{(pid=82485) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 15 15:59:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8440b2e-272f-4896-82fe-51e1f82435a5 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-599a359d-a5dc-46ff-b82c-c7ecc0dd5a28 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:13 devstack sudo[89327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8440b2e-272f-4896-82fe-51e1f82435a5 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-599a359d-a5dc-46ff-b82c-c7ecc0dd5a28
Apr 15 15:59:13 devstack sudo[89327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:13 devstack sudo[89318]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:13 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f466d321-8fa9-4ede-b49c-acbdeb460bb8" returned: 1 in 0.505s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:13 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f466d321-8fa9-4ede-b49c-acbdeb460bb8' failed. Not Retrying. {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 15:59:13 devstack cinder-volume[82485]: DEBUG cinder.volume.volume_utils [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] Downloaded image 0fe37db8-916e-4521-8f72-73003c13994a ((None, [{'url': 'file:///opt/stack/data/glance/images/0fe37db8-916e-4521-8f72-73003c13994a', 'metadata': {}}])) to volume f466d321-8fa9-4ede-b49c-acbdeb460bb8 successfully. {{(pid=82485) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 15 15:59:13 devstack cinder-volume[82485]: DEBUG cinder.image.image_utils [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] Temporary image 0fe37db8-916e-4521-8f72-73003c13994a for user 319d619b84104ab4ba1cc1559acb30d7 is deleted. {{(pid=82485) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 15 15:59:13 devstack cinder-volume[82485]: DEBUG cinder.volume.volume_utils [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] Marking volume f466d321-8fa9-4ede-b49c-acbdeb460bb8 as bootable. {{(pid=82485) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 15 15:59:13 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] Copying metadata from image 0fe37db8-916e-4521-8f72-73003c13994a to f466d321-8fa9-4ede-b49c-acbdeb460bb8. {{(pid=82485) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 15 15:59:13 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] Creating volume glance metadata for volume f466d321-8fa9-4ede-b49c-acbdeb460bb8 backed by image 0fe37db8-916e-4521-8f72-73003c13994a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0fe37db8-916e-4521-8f72-73003c13994a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82485) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 15 15:59:13 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9135156-345a-4c72-8b6b-2523f9094e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f466d321-8fa9-4ede-b49c-acbdeb460bb8', 'volume_size': 1, 'image_id': '0fe37db8-916e-4521-8f72-73003c13994a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0fe37db8-916e-4521-8f72-73003c13994a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '57491fc0e71d4fad9011d017ccefe515', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0fe37db8-916e-4521-8f72-73003c13994a', 'created_at': datetime.datetime(2026, 4, 15, 13, 47, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 13, 47, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0fe37db8-916e-4521-8f72-73003c13994a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f153f006710>}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:59:13 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bd66332-4741-457c-a33b-fd90ca366735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:59:13 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] Volume volume-f466d321-8fa9-4ede-b49c-acbdeb460bb8 (f466d321-8fa9-4ede-b49c-acbdeb460bb8): created successfully
Apr 15 15:59:13 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bd66332-4741-457c-a33b-fd90ca366735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:59:13 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] Flow 'volume_create_manager' (4e3615b0-b909-4d18-862c-4a3f7662fe4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:59:13 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-3a591913-3a00-443c-8c6b-ff56b163af1d tempest-VolumesImageMetadata-200896685 None] Created volume successfully.
Apr 15 15:59:14 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-20950989-a6c3-452d-b028-a186d13a2221 tempest-VolumesImageMetadata-200896685 None] Acquiring lock "cinder-f466d321-8fa9-4ede-b49c-acbdeb460bb8-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:59:14 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-20950989-a6c3-452d-b028-a186d13a2221 tempest-VolumesImageMetadata-200896685 None] Lock "cinder-f466d321-8fa9-4ede-b49c-acbdeb460bb8-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:59:14 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-20950989-a6c3-452d-b028-a186d13a2221 tempest-VolumesImageMetadata-200896685 None] Acquiring lock "cinder-quobyte-f466d321-8fa9-4ede-b49c-acbdeb460bb8" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:59:14 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-20950989-a6c3-452d-b028-a186d13a2221 tempest-VolumesImageMetadata-200896685 None] Lock "cinder-quobyte-f466d321-8fa9-4ede-b49c-acbdeb460bb8" acquired by "delete_volume" :: waited 0.009s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:59:14 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[48504f7c-c762-4483-b7f9-e03ab0d65398]: (4, 'raw') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:59:14 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-20950989-a6c3-452d-b028-a186d13a2221 tempest-VolumesImageMetadata-200896685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f466d321-8fa9-4ede-b49c-acbdeb460bb8 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:15 devstack sudo[89341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f466d321-8fa9-4ede-b49c-acbdeb460bb8
Apr 15 15:59:15 devstack sudo[89341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:15 devstack sudo[89327]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:15 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8440b2e-272f-4896-82fe-51e1f82435a5 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-599a359d-a5dc-46ff-b82c-c7ecc0dd5a28" returned: 0 in 2.253s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:15 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d24a165-8ebe-4869-91a4-1f3cd8cdc0ce]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:59:15 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8440b2e-272f-4896-82fe-51e1f82435a5 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:15 devstack sudo[89343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8440b2e-272f-4896-82fe-51e1f82435a5
Apr 15 15:59:15 devstack sudo[89343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:15 devstack sudo[89341]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:15 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-20950989-a6c3-452d-b028-a186d13a2221 tempest-VolumesImageMetadata-200896685 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f466d321-8fa9-4ede-b49c-acbdeb460bb8" returned: 0 in 0.621s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:15 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-20950989-a6c3-452d-b028-a186d13a2221 tempest-VolumesImageMetadata-200896685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f466d321-8fa9-4ede-b49c-acbdeb460bb8 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:15 devstack sudo[89347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f466d321-8fa9-4ede-b49c-acbdeb460bb8
Apr 15 15:59:15 devstack sudo[89347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:15 devstack sudo[89343]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:15 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8440b2e-272f-4896-82fe-51e1f82435a5" returned: 0 in 0.635s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:15 devstack cinder-volume[82485]: DEBUG cinder.image.image_utils [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] Image conversion details: src /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8440b2e-272f-4896-82fe-51e1f82435a5, size 1024.00 MB, duration 2.25 sec, destination /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-599a359d-a5dc-46ff-b82c-c7ecc0dd5a28 {{(pid=82485) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 15:59:15 devstack cinder-volume[82485]: INFO cinder.image.image_utils [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] Converted 1024.00 MB image at 454.19 MB/s
Apr 15 15:59:15 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-599a359d-a5dc-46ff-b82c-c7ecc0dd5a28 is being set with open permissions: ugo+rw
Apr 15 15:59:15 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-599a359d-a5dc-46ff-b82c-c7ecc0dd5a28 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:15 devstack sudo[89352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-599a359d-a5dc-46ff-b82c-c7ecc0dd5a28
Apr 15 15:59:15 devstack sudo[89352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:16 devstack sudo[89347]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:16 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-20950989-a6c3-452d-b028-a186d13a2221 tempest-VolumesImageMetadata-200896685 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f466d321-8fa9-4ede-b49c-acbdeb460bb8" returned: 1 in 0.479s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:16 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-20950989-a6c3-452d-b028-a186d13a2221 tempest-VolumesImageMetadata-200896685 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f466d321-8fa9-4ede-b49c-acbdeb460bb8' failed. Not Retrying. {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 15:59:16 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-20950989-a6c3-452d-b028-a186d13a2221 tempest-VolumesImageMetadata-200896685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f466d321-8fa9-4ede-b49c-acbdeb460bb8 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:16 devstack sudo[89357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f466d321-8fa9-4ede-b49c-acbdeb460bb8
Apr 15 15:59:16 devstack sudo[89357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:16 devstack sudo[89352]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:16 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-599a359d-a5dc-46ff-b82c-c7ecc0dd5a28" returned: 0 in 0.424s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:16 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] Lock "cinder-quobyte-599a359d-a5dc-46ff-b82c-c7ecc0dd5a28" released by "_copy_volume_from_snapshot" :: held 4.322s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:59:16 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] Acquiring lock "cinder-quobyte-7f5b9c07-d167-404b-9c8b-0f9ccd86d591" by "_delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:59:16 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] Lock "cinder-quobyte-7f5b9c07-d167-404b-9c8b-0f9ccd86d591" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:59:16 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] Deleting offline snapshot 7f5b9c07-d167-404b-9c8b-0f9ccd86d591 of volume b8440b2e-272f-4896-82fe-51e1f82435a5 {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 15:59:16 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] snapshot_file for this snap is: volume-b8440b2e-272f-4896-82fe-51e1f82435a5.7f5b9c07-d167-404b-9c8b-0f9ccd86d591 {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 15:59:16 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[809b0040-d511-4f05-ab2f-4be7d1d8ee1f]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:59:16 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8440b2e-272f-4896-82fe-51e1f82435a5.7f5b9c07-d167-404b-9c8b-0f9ccd86d591 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:16 devstack sudo[89360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8440b2e-272f-4896-82fe-51e1f82435a5.7f5b9c07-d167-404b-9c8b-0f9ccd86d591
Apr 15 15:59:16 devstack sudo[89360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:16 devstack sudo[89357]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:16 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-20950989-a6c3-452d-b028-a186d13a2221 tempest-VolumesImageMetadata-200896685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f466d321-8fa9-4ede-b49c-acbdeb460bb8" returned: 0 in 0.445s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:16 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-20950989-a6c3-452d-b028-a186d13a2221 tempest-VolumesImageMetadata-200896685 None] Lock "cinder-quobyte-f466d321-8fa9-4ede-b49c-acbdeb460bb8" released by "delete_volume" :: held 1.612s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:59:16 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-20950989-a6c3-452d-b028-a186d13a2221 tempest-VolumesImageMetadata-200896685 None] Created reservations ['ee58b196-4cfc-4421-8ee1-c8d971c35f5d', '6710774b-d10f-497f-87e6-8a874811ad89', 'a20b0673-e846-41e2-983a-9a8ca5459c1e', 'ef619d9e-5cbb-4f61-9efc-ee83f187ca6b'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:59:16 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-20950989-a6c3-452d-b028-a186d13a2221 tempest-VolumesImageMetadata-200896685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:59:16 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-20950989-a6c3-452d-b028-a186d13a2221 tempest-VolumesImageMetadata-200896685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:59:16 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-20950989-a6c3-452d-b028-a186d13a2221 tempest-VolumesImageMetadata-200896685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:59:16 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-20950989-a6c3-452d-b028-a186d13a2221 tempest-VolumesImageMetadata-200896685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:59:16 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-20950989-a6c3-452d-b028-a186d13a2221 tempest-VolumesImageMetadata-200896685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:59:16 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-20950989-a6c3-452d-b028-a186d13a2221 tempest-VolumesImageMetadata-200896685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:16 devstack sudo[89363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:59:16 devstack sudo[89363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:16 devstack sudo[89360]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:16 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8440b2e-272f-4896-82fe-51e1f82435a5.7f5b9c07-d167-404b-9c8b-0f9ccd86d591" returned: 0 in 0.498s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:16 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b8440b2e-272f-4896-82fe-51e1f82435a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82485) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 15:59:16 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f78eed-3986-4e15-9abd-c434b627a882]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:59:16 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8440b2e-272f-4896-82fe-51e1f82435a5 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:16 devstack sudo[89368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8440b2e-272f-4896-82fe-51e1f82435a5
Apr 15 15:59:16 devstack sudo[89368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:17 devstack sudo[89363]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:17 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-20950989-a6c3-452d-b028-a186d13a2221 tempest-VolumesImageMetadata-200896685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.428s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:17 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-20950989-a6c3-452d-b028-a186d13a2221 tempest-VolumesImageMetadata-200896685 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:59:17 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-20950989-a6c3-452d-b028-a186d13a2221 tempest-VolumesImageMetadata-200896685 None] Deleted volume successfully.
Apr 15 15:59:17 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-20950989-a6c3-452d-b028-a186d13a2221 tempest-VolumesImageMetadata-200896685 None] Lock "cinder-f466d321-8fa9-4ede-b49c-acbdeb460bb8-delete_volume" released by "delete_volume" :: held 2.215s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:59:17 devstack sudo[89368]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:17 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8440b2e-272f-4896-82fe-51e1f82435a5" returned: 0 in 0.530s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:17 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8440b2e-272f-4896-82fe-51e1f82435a5.7f5b9c07-d167-404b-9c8b-0f9ccd86d591 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:17 devstack sudo[89374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8440b2e-272f-4896-82fe-51e1f82435a5.7f5b9c07-d167-404b-9c8b-0f9ccd86d591
Apr 15 15:59:17 devstack sudo[89374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:17 devstack sudo[89374]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:17 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8440b2e-272f-4896-82fe-51e1f82435a5.7f5b9c07-d167-404b-9c8b-0f9ccd86d591" returned: 0 in 0.531s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:17 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8440b2e-272f-4896-82fe-51e1f82435a5.7f5b9c07-d167-404b-9c8b-0f9ccd86d591 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:17 devstack sudo[89379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8440b2e-272f-4896-82fe-51e1f82435a5.7f5b9c07-d167-404b-9c8b-0f9ccd86d591
Apr 15 15:59:17 devstack sudo[89379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:18 devstack sudo[89379]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8440b2e-272f-4896-82fe-51e1f82435a5.7f5b9c07-d167-404b-9c8b-0f9ccd86d591" returned: 0 in 0.453s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:18 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] Lock "cinder-quobyte-7f5b9c07-d167-404b-9c8b-0f9ccd86d591" released by "_delete_snapshot" :: held 2.070s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:59:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.388s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:59:18 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e1c77a0-d86b-4a4e-a89a-5783de310b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-599a359d-a5dc-46ff-b82c-c7ecc0dd5a28', 'volume_size': 1, 'source_volid': 'b8440b2e-272f-4896-82fe-51e1f82435a5', 'source_volstatus': 'available'}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:59:18 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d17a26e7-3d21-471f-a248-8832b94542c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:59:18 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] Volume volume-599a359d-a5dc-46ff-b82c-c7ecc0dd5a28 (599a359d-a5dc-46ff-b82c-c7ecc0dd5a28): created successfully
Apr 15 15:59:18 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d17a26e7-3d21-471f-a248-8832b94542c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:59:18 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] Flow 'volume_create_manager' (97317f42-77fb-4ec2-b631-096eab27f59a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:59:18 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-6b67226c-09b1-4c32-b4a0-d05b519045a8 tempest-VolumeDependencyTests-1015146606 None] Created volume successfully.
Apr 15 15:59:18 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-aa37e0fc-d991-4e03-9f11-6aa57490e446 tempest-VolumeDependencyTests-1015146606 None] Acquiring lock "cinder-b8440b2e-272f-4896-82fe-51e1f82435a5-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:59:18 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-aa37e0fc-d991-4e03-9f11-6aa57490e446 tempest-VolumeDependencyTests-1015146606 None] Lock "cinder-b8440b2e-272f-4896-82fe-51e1f82435a5-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:59:18 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-aa37e0fc-d991-4e03-9f11-6aa57490e446 tempest-VolumeDependencyTests-1015146606 None] Acquiring lock "cinder-quobyte-b8440b2e-272f-4896-82fe-51e1f82435a5" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:59:18 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-aa37e0fc-d991-4e03-9f11-6aa57490e446 tempest-VolumeDependencyTests-1015146606 None] Lock "cinder-quobyte-b8440b2e-272f-4896-82fe-51e1f82435a5" acquired by "delete_volume" :: waited 0.009s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:59:18 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[a69cebb5-a53d-448c-ab5a-8c9221b90f47]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:59:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-aa37e0fc-d991-4e03-9f11-6aa57490e446 tempest-VolumeDependencyTests-1015146606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8440b2e-272f-4896-82fe-51e1f82435a5 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:18 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c5f2074-3014-4452-89e5-889229a7ab15 tempest-SnapshotMetadataTestJSON-1305785842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:59:18 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-5c5f2074-3014-4452-89e5-889229a7ab15 tempest-SnapshotMetadataTestJSON-1305785842 None] Flow 'volume_create_manager' (991dca60-65c2-4dd4-b6c0-5b7672ffde0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:59:18 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-5c5f2074-3014-4452-89e5-889229a7ab15 tempest-SnapshotMetadataTestJSON-1305785842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41dda3f0-99dc-4da0-b72b-5965bb7f8fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:59:18 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-5c5f2074-3014-4452-89e5-889229a7ab15 tempest-SnapshotMetadataTestJSON-1305785842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41dda3f0-99dc-4da0-b72b-5965bb7f8fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:59:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1716916386',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8b4cd4a-680d-4d50-8978-3dcdc6f86d02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='617693626a2a4e298faf65d6d7894974',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:59:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:59:19Z,use_quota=True,user_id='696184f8dcc245c2963975b1489cfcb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:59:18 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-5c5f2074-3014-4452-89e5-889229a7ab15 tempest-SnapshotMetadataTestJSON-1305785842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a42772d-978c-4d04-9429-f534bf76f922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:59:18 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-5c5f2074-3014-4452-89e5-889229a7ab15 tempest-SnapshotMetadataTestJSON-1305785842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a42772d-978c-4d04-9429-f534bf76f922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:59:18 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-5c5f2074-3014-4452-89e5-889229a7ab15 tempest-SnapshotMetadataTestJSON-1305785842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a7c7fa3-3de0-457e-80b8-f319c1d3338d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:59:18 devstack sudo[89382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8440b2e-272f-4896-82fe-51e1f82435a5
Apr 15 15:59:18 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-5c5f2074-3014-4452-89e5-889229a7ab15 tempest-SnapshotMetadataTestJSON-1305785842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a7c7fa3-3de0-457e-80b8-f319c1d3338d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8b4cd4a-680d-4d50-8978-3dcdc6f86d02', 'volume_name': 'volume-c8b4cd4a-680d-4d50-8978-3dcdc6f86d02', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:59:18 devstack sudo[89382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:18 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-5c5f2074-3014-4452-89e5-889229a7ab15 tempest-SnapshotMetadataTestJSON-1305785842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7a651a1-8bdb-42f1-ab73-12d8c6fd4bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:59:18 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-5c5f2074-3014-4452-89e5-889229a7ab15 tempest-SnapshotMetadataTestJSON-1305785842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7a651a1-8bdb-42f1-ab73-12d8c6fd4bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:59:18 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-5c5f2074-3014-4452-89e5-889229a7ab15 tempest-SnapshotMetadataTestJSON-1305785842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ace6511f-0185-4f6b-b078-22b41eadbba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:59:18 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-5c5f2074-3014-4452-89e5-889229a7ab15 tempest-SnapshotMetadataTestJSON-1305785842 None] Volume c8b4cd4a-680d-4d50-8978-3dcdc6f86d02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8b4cd4a-680d-4d50-8978-3dcdc6f86d02', 'volume_size': 1}
Apr 15 15:59:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-5c5f2074-3014-4452-89e5-889229a7ab15 tempest-SnapshotMetadataTestJSON-1305785842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:59:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-5c5f2074-3014-4452-89e5-889229a7ab15 tempest-SnapshotMetadataTestJSON-1305785842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:59:18 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-5c5f2074-3014-4452-89e5-889229a7ab15 tempest-SnapshotMetadataTestJSON-1305785842 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:59:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1716916386',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8b4cd4a-680d-4d50-8978-3dcdc6f86d02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='617693626a2a4e298faf65d6d7894974',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:59:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:59:19Z,use_quota=True,user_id='696184f8dcc245c2963975b1489cfcb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:59:18 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-5c5f2074-3014-4452-89e5-889229a7ab15 tempest-SnapshotMetadataTestJSON-1305785842 None] Creating volume c8b4cd4a-680d-4d50-8978-3dcdc6f86d02 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:59:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-5c5f2074-3014-4452-89e5-889229a7ab15 tempest-SnapshotMetadataTestJSON-1305785842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:59:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-5c5f2074-3014-4452-89e5-889229a7ab15 tempest-SnapshotMetadataTestJSON-1305785842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:59:18 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-5c5f2074-3014-4452-89e5-889229a7ab15 tempest-SnapshotMetadataTestJSON-1305785842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:59:18 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-5c5f2074-3014-4452-89e5-889229a7ab15 tempest-SnapshotMetadataTestJSON-1305785842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:59:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-5c5f2074-3014-4452-89e5-889229a7ab15 tempest-SnapshotMetadataTestJSON-1305785842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:59:18 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-5c5f2074-3014-4452-89e5-889229a7ab15 tempest-SnapshotMetadataTestJSON-1305785842 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:59:18 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-5c5f2074-3014-4452-89e5-889229a7ab15 tempest-SnapshotMetadataTestJSON-1305785842 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:59:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-5c5f2074-3014-4452-89e5-889229a7ab15 tempest-SnapshotMetadataTestJSON-1305785842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c8b4cd4a-680d-4d50-8978-3dcdc6f86d02 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:18 devstack sudo[89384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c8b4cd4a-680d-4d50-8978-3dcdc6f86d02 1073741824
Apr 15 15:59:18 devstack sudo[89384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:19 devstack sudo[89382]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-aa37e0fc-d991-4e03-9f11-6aa57490e446 tempest-VolumeDependencyTests-1015146606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8440b2e-272f-4896-82fe-51e1f82435a5" returned: 0 in 0.482s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-aa37e0fc-d991-4e03-9f11-6aa57490e446 tempest-VolumeDependencyTests-1015146606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8440b2e-272f-4896-82fe-51e1f82435a5 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:19 devstack sudo[89392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8440b2e-272f-4896-82fe-51e1f82435a5
Apr 15 15:59:19 devstack sudo[89392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:19 devstack sudo[89384]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-5c5f2074-3014-4452-89e5-889229a7ab15 tempest-SnapshotMetadataTestJSON-1305785842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c8b4cd4a-680d-4d50-8978-3dcdc6f86d02 1073741824" returned: 0 in 0.514s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-5c5f2074-3014-4452-89e5-889229a7ab15 tempest-SnapshotMetadataTestJSON-1305785842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c8b4cd4a-680d-4d50-8978-3dcdc6f86d02 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:19 devstack sudo[89394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c8b4cd4a-680d-4d50-8978-3dcdc6f86d02
Apr 15 15:59:19 devstack sudo[89394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:19 devstack sudo[89392]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-aa37e0fc-d991-4e03-9f11-6aa57490e446 tempest-VolumeDependencyTests-1015146606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8440b2e-272f-4896-82fe-51e1f82435a5" returned: 0 in 0.427s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:19 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-aa37e0fc-d991-4e03-9f11-6aa57490e446 tempest-VolumeDependencyTests-1015146606 None] Lock "cinder-quobyte-b8440b2e-272f-4896-82fe-51e1f82435a5" released by "delete_volume" :: held 0.959s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:59:19 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-aa37e0fc-d991-4e03-9f11-6aa57490e446 tempest-VolumeDependencyTests-1015146606 None] Created reservations ['1c0e043c-a72a-447d-a4d4-17c4eacf7970', '117500f1-ac4d-46e1-acc4-60b1e6034523', '1c9a027d-9fe1-4851-a113-dae9b5a68c91', '075a66b0-be19-4c50-b3b0-f7ae66184a5d'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:59:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-aa37e0fc-d991-4e03-9f11-6aa57490e446 tempest-VolumeDependencyTests-1015146606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:59:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-aa37e0fc-d991-4e03-9f11-6aa57490e446 tempest-VolumeDependencyTests-1015146606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:59:19 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-aa37e0fc-d991-4e03-9f11-6aa57490e446 tempest-VolumeDependencyTests-1015146606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:59:19 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-aa37e0fc-d991-4e03-9f11-6aa57490e446 tempest-VolumeDependencyTests-1015146606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:59:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-aa37e0fc-d991-4e03-9f11-6aa57490e446 tempest-VolumeDependencyTests-1015146606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:59:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-aa37e0fc-d991-4e03-9f11-6aa57490e446 tempest-VolumeDependencyTests-1015146606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:19 devstack sudo[89398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:59:19 devstack sudo[89398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:19 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-2b31d217-4a9b-4ebc-8ee6-593a2e2ad883 tempest-VolumeDependencyTests-1015146606 None] Acquiring lock "cinder-599a359d-a5dc-46ff-b82c-c7ecc0dd5a28-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:59:19 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-2b31d217-4a9b-4ebc-8ee6-593a2e2ad883 tempest-VolumeDependencyTests-1015146606 None] Lock "cinder-599a359d-a5dc-46ff-b82c-c7ecc0dd5a28-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:59:19 devstack sudo[89394]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-5c5f2074-3014-4452-89e5-889229a7ab15 tempest-SnapshotMetadataTestJSON-1305785842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c8b4cd4a-680d-4d50-8978-3dcdc6f86d02" returned: 0 in 0.447s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:19 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-5c5f2074-3014-4452-89e5-889229a7ab15 tempest-SnapshotMetadataTestJSON-1305785842 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:59:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-5c5f2074-3014-4452-89e5-889229a7ab15 tempest-SnapshotMetadataTestJSON-1305785842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:59:19 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-5c5f2074-3014-4452-89e5-889229a7ab15 tempest-SnapshotMetadataTestJSON-1305785842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ace6511f-0185-4f6b-b078-22b41eadbba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8b4cd4a-680d-4d50-8978-3dcdc6f86d02', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:59:19 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-5c5f2074-3014-4452-89e5-889229a7ab15 tempest-SnapshotMetadataTestJSON-1305785842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3263e706-1a00-4cf2-ab87-d567b3ad3c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:59:19 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-2b31d217-4a9b-4ebc-8ee6-593a2e2ad883 tempest-VolumeDependencyTests-1015146606 None] Acquiring lock "cinder-quobyte-599a359d-a5dc-46ff-b82c-c7ecc0dd5a28" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:59:19 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-5c5f2074-3014-4452-89e5-889229a7ab15 tempest-SnapshotMetadataTestJSON-1305785842 None] Volume volume-c8b4cd4a-680d-4d50-8978-3dcdc6f86d02 (c8b4cd4a-680d-4d50-8978-3dcdc6f86d02): created successfully
Apr 15 15:59:19 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-5c5f2074-3014-4452-89e5-889229a7ab15 tempest-SnapshotMetadataTestJSON-1305785842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3263e706-1a00-4cf2-ab87-d567b3ad3c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:59:19 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-5c5f2074-3014-4452-89e5-889229a7ab15 tempest-SnapshotMetadataTestJSON-1305785842 None] Flow 'volume_create_manager' (991dca60-65c2-4dd4-b6c0-5b7672ffde0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:59:19 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-2b31d217-4a9b-4ebc-8ee6-593a2e2ad883 tempest-VolumeDependencyTests-1015146606 None] Lock "cinder-quobyte-599a359d-a5dc-46ff-b82c-c7ecc0dd5a28" acquired by "delete_volume" :: waited 0.020s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:59:19 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-5c5f2074-3014-4452-89e5-889229a7ab15 tempest-SnapshotMetadataTestJSON-1305785842 None] Created volume successfully.
Apr 15 15:59:19 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5198be-6e22-4de3-8cef-3ca3cd159d0c]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:59:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-2b31d217-4a9b-4ebc-8ee6-593a2e2ad883 tempest-VolumeDependencyTests-1015146606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-599a359d-a5dc-46ff-b82c-c7ecc0dd5a28 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:19 devstack sudo[89400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-599a359d-a5dc-46ff-b82c-c7ecc0dd5a28
Apr 15 15:59:19 devstack sudo[89400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:20 devstack sudo[89398]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:20 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-aa37e0fc-d991-4e03-9f11-6aa57490e446 tempest-VolumeDependencyTests-1015146606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.423s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:20 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-aa37e0fc-d991-4e03-9f11-6aa57490e446 tempest-VolumeDependencyTests-1015146606 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:59:20 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-aa37e0fc-d991-4e03-9f11-6aa57490e446 tempest-VolumeDependencyTests-1015146606 None] Deleted volume successfully.
Apr 15 15:59:20 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-aa37e0fc-d991-4e03-9f11-6aa57490e446 tempest-VolumeDependencyTests-1015146606 None] Lock "cinder-b8440b2e-272f-4896-82fe-51e1f82435a5-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:59:20 devstack sudo[89400]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:20 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-2b31d217-4a9b-4ebc-8ee6-593a2e2ad883 tempest-VolumeDependencyTests-1015146606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-599a359d-a5dc-46ff-b82c-c7ecc0dd5a28" returned: 0 in 0.472s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:20 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-2b31d217-4a9b-4ebc-8ee6-593a2e2ad883 tempest-VolumeDependencyTests-1015146606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-599a359d-a5dc-46ff-b82c-c7ecc0dd5a28 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:20 devstack sudo[89406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-599a359d-a5dc-46ff-b82c-c7ecc0dd5a28
Apr 15 15:59:20 devstack sudo[89406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:20 devstack sudo[89406]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:20 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-2b31d217-4a9b-4ebc-8ee6-593a2e2ad883 tempest-VolumeDependencyTests-1015146606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-599a359d-a5dc-46ff-b82c-c7ecc0dd5a28" returned: 0 in 0.414s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:20 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-2b31d217-4a9b-4ebc-8ee6-593a2e2ad883 tempest-VolumeDependencyTests-1015146606 None] Lock "cinder-quobyte-599a359d-a5dc-46ff-b82c-c7ecc0dd5a28" released by "delete_volume" :: held 0.909s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:59:20 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-2b31d217-4a9b-4ebc-8ee6-593a2e2ad883 tempest-VolumeDependencyTests-1015146606 None] Created reservations ['a6a9e6ab-64d8-4a8b-aa3a-f0263c2ce582', '3451d54b-3cd4-4ebd-ae17-6b0c92c3c730', 'f02f6e61-4272-4f88-aee7-e1ac1712c36e', 'cd7dca04-99a2-4d00-bf0f-7523c1eb4430'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:59:20 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-2b31d217-4a9b-4ebc-8ee6-593a2e2ad883 tempest-VolumeDependencyTests-1015146606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:59:20 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-2b31d217-4a9b-4ebc-8ee6-593a2e2ad883 tempest-VolumeDependencyTests-1015146606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:59:20 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-2b31d217-4a9b-4ebc-8ee6-593a2e2ad883 tempest-VolumeDependencyTests-1015146606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:59:20 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-2b31d217-4a9b-4ebc-8ee6-593a2e2ad883 tempest-VolumeDependencyTests-1015146606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:59:20 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-2b31d217-4a9b-4ebc-8ee6-593a2e2ad883 tempest-VolumeDependencyTests-1015146606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:59:20 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-2b31d217-4a9b-4ebc-8ee6-593a2e2ad883 tempest-VolumeDependencyTests-1015146606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:20 devstack sudo[89409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:59:20 devstack sudo[89409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:21 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-a4dffdaa-8110-4bd8-ba90-9b6020c3db42 tempest-VolumeDependencyTests-1015146606 None] Acquiring lock "cinder-b3442355-2c5a-4d30-8928-739d2683a8c0-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:59:21 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-a4dffdaa-8110-4bd8-ba90-9b6020c3db42 tempest-VolumeDependencyTests-1015146606 None] Lock "cinder-b3442355-2c5a-4d30-8928-739d2683a8c0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:59:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-b3552dd5-ebd6-43c1-b0f7-e6f03734599d tempest-SnapshotMetadataTestJSON-1305785842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:59:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-b3552dd5-ebd6-43c1-b0f7-e6f03734599d tempest-SnapshotMetadataTestJSON-1305785842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:59:21 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-b3552dd5-ebd6-43c1-b0f7-e6f03734599d tempest-SnapshotMetadataTestJSON-1305785842 None] Creating offline snapshot c9c694df-eaff-44bd-a666-069303681ad4 of volume c8b4cd4a-680d-4d50-8978-3dcdc6f86d02 {{(pid=82485) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 15:59:21 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f59d7a-d5cc-42bf-85ac-055b1333dc19]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:59:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b3552dd5-ebd6-43c1-b0f7-e6f03734599d tempest-SnapshotMetadataTestJSON-1305785842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c8b4cd4a-680d-4d50-8978-3dcdc6f86d02 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:21 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-a4dffdaa-8110-4bd8-ba90-9b6020c3db42 tempest-VolumeDependencyTests-1015146606 None] Acquiring lock "cinder-quobyte-b3442355-2c5a-4d30-8928-739d2683a8c0" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:59:21 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-a4dffdaa-8110-4bd8-ba90-9b6020c3db42 tempest-VolumeDependencyTests-1015146606 None] Lock "cinder-quobyte-b3442355-2c5a-4d30-8928-739d2683a8c0" acquired by "delete_volume" :: waited 0.010s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:59:21 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6c2da5-c55c-4513-a98a-91777aaa0845]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:59:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-a4dffdaa-8110-4bd8-ba90-9b6020c3db42 tempest-VolumeDependencyTests-1015146606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b3442355-2c5a-4d30-8928-739d2683a8c0 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:21 devstack sudo[89411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c8b4cd4a-680d-4d50-8978-3dcdc6f86d02
Apr 15 15:59:21 devstack sudo[89411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:21 devstack sudo[89412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b3442355-2c5a-4d30-8928-739d2683a8c0
Apr 15 15:59:21 devstack sudo[89412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:21 devstack sudo[89409]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-2b31d217-4a9b-4ebc-8ee6-593a2e2ad883 tempest-VolumeDependencyTests-1015146606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.508s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:21 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-2b31d217-4a9b-4ebc-8ee6-593a2e2ad883 tempest-VolumeDependencyTests-1015146606 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:59:21 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-2b31d217-4a9b-4ebc-8ee6-593a2e2ad883 tempest-VolumeDependencyTests-1015146606 None] Deleted volume successfully.
Apr 15 15:59:21 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-2b31d217-4a9b-4ebc-8ee6-593a2e2ad883 tempest-VolumeDependencyTests-1015146606 None] Lock "cinder-599a359d-a5dc-46ff-b82c-c7ecc0dd5a28-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:59:21 devstack sudo[89411]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b3552dd5-ebd6-43c1-b0f7-e6f03734599d tempest-SnapshotMetadataTestJSON-1305785842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c8b4cd4a-680d-4d50-8978-3dcdc6f86d02" returned: 0 in 0.501s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b3552dd5-ebd6-43c1-b0f7-e6f03734599d tempest-SnapshotMetadataTestJSON-1305785842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c8b4cd4a-680d-4d50-8978-3dcdc6f86d02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c8b4cd4a-680d-4d50-8978-3dcdc6f86d02.c9c694df-eaff-44bd-a666-069303681ad4 1G {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:21 devstack sudo[89422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c8b4cd4a-680d-4d50-8978-3dcdc6f86d02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c8b4cd4a-680d-4d50-8978-3dcdc6f86d02.c9c694df-eaff-44bd-a666-069303681ad4 1G
Apr 15 15:59:21 devstack sudo[89422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:21 devstack sudo[89412]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-a4dffdaa-8110-4bd8-ba90-9b6020c3db42 tempest-VolumeDependencyTests-1015146606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b3442355-2c5a-4d30-8928-739d2683a8c0" returned: 0 in 0.492s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-a4dffdaa-8110-4bd8-ba90-9b6020c3db42 tempest-VolumeDependencyTests-1015146606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b3442355-2c5a-4d30-8928-739d2683a8c0 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:21 devstack sudo[89424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b3442355-2c5a-4d30-8928-739d2683a8c0
Apr 15 15:59:21 devstack sudo[89424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:22 devstack sudo[89424]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:22 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-a4dffdaa-8110-4bd8-ba90-9b6020c3db42 tempest-VolumeDependencyTests-1015146606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b3442355-2c5a-4d30-8928-739d2683a8c0" returned: 0 in 0.428s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:22 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-a4dffdaa-8110-4bd8-ba90-9b6020c3db42 tempest-VolumeDependencyTests-1015146606 None] Lock "cinder-quobyte-b3442355-2c5a-4d30-8928-739d2683a8c0" released by "delete_volume" :: held 0.946s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:59:22 devstack sudo[89422]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:22 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b3552dd5-ebd6-43c1-b0f7-e6f03734599d tempest-SnapshotMetadataTestJSON-1305785842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c8b4cd4a-680d-4d50-8978-3dcdc6f86d02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c8b4cd4a-680d-4d50-8978-3dcdc6f86d02.c9c694df-eaff-44bd-a666-069303681ad4 1G" returned: 0 in 0.482s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:22 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b3552dd5-ebd6-43c1-b0f7-e6f03734599d tempest-SnapshotMetadataTestJSON-1305785842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8b4cd4a-680d-4d50-8978-3dcdc6f86d02 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c8b4cd4a-680d-4d50-8978-3dcdc6f86d02.c9c694df-eaff-44bd-a666-069303681ad4 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:22 devstack sudo[89430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8b4cd4a-680d-4d50-8978-3dcdc6f86d02 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c8b4cd4a-680d-4d50-8978-3dcdc6f86d02.c9c694df-eaff-44bd-a666-069303681ad4
Apr 15 15:59:22 devstack sudo[89430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:22 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-a4dffdaa-8110-4bd8-ba90-9b6020c3db42 tempest-VolumeDependencyTests-1015146606 None] Created reservations ['7624a41d-f1cd-497c-8919-379b340826fc', 'a32b33b9-28e4-4758-8099-a3a67cdd85c1', 'fe54bb07-c438-481b-b613-1a84f271dcf4', '714a021d-8ac0-46d8-8a1d-8f3996e159c4'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:59:22 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-a4dffdaa-8110-4bd8-ba90-9b6020c3db42 tempest-VolumeDependencyTests-1015146606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:59:22 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-a4dffdaa-8110-4bd8-ba90-9b6020c3db42 tempest-VolumeDependencyTests-1015146606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:59:22 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-a4dffdaa-8110-4bd8-ba90-9b6020c3db42 tempest-VolumeDependencyTests-1015146606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:59:22 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-a4dffdaa-8110-4bd8-ba90-9b6020c3db42 tempest-VolumeDependencyTests-1015146606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:59:22 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-a4dffdaa-8110-4bd8-ba90-9b6020c3db42 tempest-VolumeDependencyTests-1015146606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:59:22 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-a4dffdaa-8110-4bd8-ba90-9b6020c3db42 tempest-VolumeDependencyTests-1015146606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:22 devstack sudo[89432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:59:22 devstack sudo[89432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:22 devstack sudo[89430]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:22 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b3552dd5-ebd6-43c1-b0f7-e6f03734599d tempest-SnapshotMetadataTestJSON-1305785842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8b4cd4a-680d-4d50-8978-3dcdc6f86d02 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c8b4cd4a-680d-4d50-8978-3dcdc6f86d02.c9c694df-eaff-44bd-a666-069303681ad4" returned: 0 in 0.452s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:22 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-b3552dd5-ebd6-43c1-b0f7-e6f03734599d tempest-SnapshotMetadataTestJSON-1305785842 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c8b4cd4a-680d-4d50-8978-3dcdc6f86d02.c9c694df-eaff-44bd-a666-069303681ad4 is being set with open permissions: ugo+rw
Apr 15 15:59:22 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b3552dd5-ebd6-43c1-b0f7-e6f03734599d tempest-SnapshotMetadataTestJSON-1305785842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c8b4cd4a-680d-4d50-8978-3dcdc6f86d02.c9c694df-eaff-44bd-a666-069303681ad4 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:22 devstack sudo[89438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c8b4cd4a-680d-4d50-8978-3dcdc6f86d02.c9c694df-eaff-44bd-a666-069303681ad4
Apr 15 15:59:22 devstack sudo[89438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:22 devstack sudo[89432]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:22 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-a4dffdaa-8110-4bd8-ba90-9b6020c3db42 tempest-VolumeDependencyTests-1015146606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.400s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:22 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-a4dffdaa-8110-4bd8-ba90-9b6020c3db42 tempest-VolumeDependencyTests-1015146606 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:59:22 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-a4dffdaa-8110-4bd8-ba90-9b6020c3db42 tempest-VolumeDependencyTests-1015146606 None] Deleted volume successfully.
Apr 15 15:59:22 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-a4dffdaa-8110-4bd8-ba90-9b6020c3db42 tempest-VolumeDependencyTests-1015146606 None] Lock "cinder-b3442355-2c5a-4d30-8928-739d2683a8c0-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:59:22 devstack sudo[89438]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:22 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b3552dd5-ebd6-43c1-b0f7-e6f03734599d tempest-SnapshotMetadataTestJSON-1305785842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c8b4cd4a-680d-4d50-8978-3dcdc6f86d02.c9c694df-eaff-44bd-a666-069303681ad4" returned: 0 in 0.404s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:22 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b3552dd5-ebd6-43c1-b0f7-e6f03734599d tempest-SnapshotMetadataTestJSON-1305785842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c8b4cd4a-680d-4d50-8978-3dcdc6f86d02.info {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:22 devstack sudo[89441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c8b4cd4a-680d-4d50-8978-3dcdc6f86d02.info
Apr 15 15:59:22 devstack sudo[89441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:23 devstack sudo[89441]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:23 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b3552dd5-ebd6-43c1-b0f7-e6f03734599d tempest-SnapshotMetadataTestJSON-1305785842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c8b4cd4a-680d-4d50-8978-3dcdc6f86d02.info" returned: 0 in 0.460s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:23 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-b3552dd5-ebd6-43c1-b0f7-e6f03734599d tempest-SnapshotMetadataTestJSON-1305785842 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c8b4cd4a-680d-4d50-8978-3dcdc6f86d02.info is being set with open permissions: ugo+rw
Apr 15 15:59:23 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b3552dd5-ebd6-43c1-b0f7-e6f03734599d tempest-SnapshotMetadataTestJSON-1305785842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c8b4cd4a-680d-4d50-8978-3dcdc6f86d02.info {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:23 devstack sudo[89444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c8b4cd4a-680d-4d50-8978-3dcdc6f86d02.info
Apr 15 15:59:23 devstack sudo[89444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:23 devstack sudo[89444]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:23 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b3552dd5-ebd6-43c1-b0f7-e6f03734599d tempest-SnapshotMetadataTestJSON-1305785842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c8b4cd4a-680d-4d50-8978-3dcdc6f86d02.info" returned: 0 in 0.454s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:23 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-b3552dd5-ebd6-43c1-b0f7-e6f03734599d tempest-SnapshotMetadataTestJSON-1305785842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.824s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:59:23 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-b3552dd5-ebd6-43c1-b0f7-e6f03734599d tempest-SnapshotMetadataTestJSON-1305785842 None] Create snapshot completed successfully
Apr 15 15:59:24 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-43d52375-9ffc-46ba-8fb3-e32ec566bef3 tempest-SnapshotMetadataTestJSON-1305785842 None] Acquiring lock "cinder-c9c694df-eaff-44bd-a666-069303681ad4-delete_snapshot" by "delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:59:24 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-43d52375-9ffc-46ba-8fb3-e32ec566bef3 tempest-SnapshotMetadataTestJSON-1305785842 None] Lock "cinder-c9c694df-eaff-44bd-a666-069303681ad4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:59:24 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-43d52375-9ffc-46ba-8fb3-e32ec566bef3 tempest-SnapshotMetadataTestJSON-1305785842 None] Acquiring lock "cinder-quobyte-c8b4cd4a-680d-4d50-8978-3dcdc6f86d02" by "delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:59:24 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-43d52375-9ffc-46ba-8fb3-e32ec566bef3 tempest-SnapshotMetadataTestJSON-1305785842 None] Lock "cinder-quobyte-c8b4cd4a-680d-4d50-8978-3dcdc6f86d02" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:59:24 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-43d52375-9ffc-46ba-8fb3-e32ec566bef3 tempest-SnapshotMetadataTestJSON-1305785842 None] Acquiring lock "cinder-quobyte-c9c694df-eaff-44bd-a666-069303681ad4" by "_delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:59:24 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-43d52375-9ffc-46ba-8fb3-e32ec566bef3 tempest-SnapshotMetadataTestJSON-1305785842 None] Lock "cinder-quobyte-c9c694df-eaff-44bd-a666-069303681ad4" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:59:24 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-43d52375-9ffc-46ba-8fb3-e32ec566bef3 tempest-SnapshotMetadataTestJSON-1305785842 None] Deleting offline snapshot c9c694df-eaff-44bd-a666-069303681ad4 of volume c8b4cd4a-680d-4d50-8978-3dcdc6f86d02 {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 15:59:24 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-43d52375-9ffc-46ba-8fb3-e32ec566bef3 tempest-SnapshotMetadataTestJSON-1305785842 None] snapshot_file for this snap is: volume-c8b4cd4a-680d-4d50-8978-3dcdc6f86d02.c9c694df-eaff-44bd-a666-069303681ad4 {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 15:59:24 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80c65e4-b0c0-400a-a6d8-b9d7a305ee79]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:59:24 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-43d52375-9ffc-46ba-8fb3-e32ec566bef3 tempest-SnapshotMetadataTestJSON-1305785842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c8b4cd4a-680d-4d50-8978-3dcdc6f86d02.c9c694df-eaff-44bd-a666-069303681ad4 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:24 devstack sudo[89449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c8b4cd4a-680d-4d50-8978-3dcdc6f86d02.c9c694df-eaff-44bd-a666-069303681ad4
Apr 15 15:59:24 devstack sudo[89449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:25 devstack sudo[89449]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:25 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-43d52375-9ffc-46ba-8fb3-e32ec566bef3 tempest-SnapshotMetadataTestJSON-1305785842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c8b4cd4a-680d-4d50-8978-3dcdc6f86d02.c9c694df-eaff-44bd-a666-069303681ad4" returned: 0 in 0.513s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:25 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-43d52375-9ffc-46ba-8fb3-e32ec566bef3 tempest-SnapshotMetadataTestJSON-1305785842 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c8b4cd4a-680d-4d50-8978-3dcdc6f86d02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82485) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 15:59:25 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[325dac7b-559f-4cc6-8d07-e3469ef00ac6]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:59:25 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-43d52375-9ffc-46ba-8fb3-e32ec566bef3 tempest-SnapshotMetadataTestJSON-1305785842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c8b4cd4a-680d-4d50-8978-3dcdc6f86d02 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:25 devstack sudo[89454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c8b4cd4a-680d-4d50-8978-3dcdc6f86d02
Apr 15 15:59:25 devstack sudo[89454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:25 devstack sudo[89454]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:25 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-43d52375-9ffc-46ba-8fb3-e32ec566bef3 tempest-SnapshotMetadataTestJSON-1305785842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c8b4cd4a-680d-4d50-8978-3dcdc6f86d02" returned: 0 in 0.555s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:25 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-43d52375-9ffc-46ba-8fb3-e32ec566bef3 tempest-SnapshotMetadataTestJSON-1305785842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c8b4cd4a-680d-4d50-8978-3dcdc6f86d02.c9c694df-eaff-44bd-a666-069303681ad4 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:25 devstack sudo[89459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c8b4cd4a-680d-4d50-8978-3dcdc6f86d02.c9c694df-eaff-44bd-a666-069303681ad4
Apr 15 15:59:25 devstack sudo[89459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:26 devstack sudo[89459]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-43d52375-9ffc-46ba-8fb3-e32ec566bef3 tempest-SnapshotMetadataTestJSON-1305785842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c8b4cd4a-680d-4d50-8978-3dcdc6f86d02.c9c694df-eaff-44bd-a666-069303681ad4" returned: 0 in 0.550s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-43d52375-9ffc-46ba-8fb3-e32ec566bef3 tempest-SnapshotMetadataTestJSON-1305785842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c8b4cd4a-680d-4d50-8978-3dcdc6f86d02.c9c694df-eaff-44bd-a666-069303681ad4 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:26 devstack sudo[89464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c8b4cd4a-680d-4d50-8978-3dcdc6f86d02.c9c694df-eaff-44bd-a666-069303681ad4
Apr 15 15:59:26 devstack sudo[89464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:26 devstack sudo[89464]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-43d52375-9ffc-46ba-8fb3-e32ec566bef3 tempest-SnapshotMetadataTestJSON-1305785842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c8b4cd4a-680d-4d50-8978-3dcdc6f86d02.c9c694df-eaff-44bd-a666-069303681ad4" returned: 0 in 0.482s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:26 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-43d52375-9ffc-46ba-8fb3-e32ec566bef3 tempest-SnapshotMetadataTestJSON-1305785842 None] Lock "cinder-quobyte-c9c694df-eaff-44bd-a666-069303681ad4" released by "_delete_snapshot" :: held 2.167s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:59:26 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-43d52375-9ffc-46ba-8fb3-e32ec566bef3 tempest-SnapshotMetadataTestJSON-1305785842 None] Lock "cinder-quobyte-c8b4cd4a-680d-4d50-8978-3dcdc6f86d02" released by "delete_snapshot" :: held 2.183s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:59:26 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-43d52375-9ffc-46ba-8fb3-e32ec566bef3 tempest-SnapshotMetadataTestJSON-1305785842 None] Created reservations ['82206d04-c4f6-499d-84f6-c01e9f82f20c', 'f0f8b573-0ad8-4613-878b-557a0abd8232', '08860893-8638-462f-8140-4dec51df55a0', '92769596-f47b-40fa-8a79-08d9ecbab64f'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:59:26 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-43d52375-9ffc-46ba-8fb3-e32ec566bef3 tempest-SnapshotMetadataTestJSON-1305785842 None] Delete snapshot completed successfully.
Apr 15 15:59:26 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-43d52375-9ffc-46ba-8fb3-e32ec566bef3 tempest-SnapshotMetadataTestJSON-1305785842 None] Lock "cinder-c9c694df-eaff-44bd-a666-069303681ad4-delete_snapshot" released by "delete_snapshot" :: held 2.298s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:59:27 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-6baccdd3-39de-4af9-b507-3b6d5ee27660 tempest-SnapshotMetadataTestJSON-1305785842 None] Acquiring lock "cinder-c8b4cd4a-680d-4d50-8978-3dcdc6f86d02-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:59:27 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-6baccdd3-39de-4af9-b507-3b6d5ee27660 tempest-SnapshotMetadataTestJSON-1305785842 None] Lock "cinder-c8b4cd4a-680d-4d50-8978-3dcdc6f86d02-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:59:27 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-6baccdd3-39de-4af9-b507-3b6d5ee27660 tempest-SnapshotMetadataTestJSON-1305785842 None] Acquiring lock "cinder-quobyte-c8b4cd4a-680d-4d50-8978-3dcdc6f86d02" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:59:27 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-6baccdd3-39de-4af9-b507-3b6d5ee27660 tempest-SnapshotMetadataTestJSON-1305785842 None] Lock "cinder-quobyte-c8b4cd4a-680d-4d50-8978-3dcdc6f86d02" acquired by "delete_volume" :: waited 0.006s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:59:27 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8816d5d-eef2-4d29-97a6-559d56c55486]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:59:27 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6baccdd3-39de-4af9-b507-3b6d5ee27660 tempest-SnapshotMetadataTestJSON-1305785842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c8b4cd4a-680d-4d50-8978-3dcdc6f86d02 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:27 devstack sudo[89468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c8b4cd4a-680d-4d50-8978-3dcdc6f86d02
Apr 15 15:59:27 devstack sudo[89468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:28 devstack sudo[89468]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:28 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6baccdd3-39de-4af9-b507-3b6d5ee27660 tempest-SnapshotMetadataTestJSON-1305785842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c8b4cd4a-680d-4d50-8978-3dcdc6f86d02" returned: 0 in 0.547s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:28 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6baccdd3-39de-4af9-b507-3b6d5ee27660 tempest-SnapshotMetadataTestJSON-1305785842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c8b4cd4a-680d-4d50-8978-3dcdc6f86d02 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:28 devstack sudo[89473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c8b4cd4a-680d-4d50-8978-3dcdc6f86d02
Apr 15 15:59:28 devstack sudo[89473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:28 devstack sudo[89473]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:28 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6baccdd3-39de-4af9-b507-3b6d5ee27660 tempest-SnapshotMetadataTestJSON-1305785842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c8b4cd4a-680d-4d50-8978-3dcdc6f86d02" returned: 0 in 0.452s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:28 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-6baccdd3-39de-4af9-b507-3b6d5ee27660 tempest-SnapshotMetadataTestJSON-1305785842 None] Lock "cinder-quobyte-c8b4cd4a-680d-4d50-8978-3dcdc6f86d02" released by "delete_volume" :: held 1.034s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:59:28 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-6baccdd3-39de-4af9-b507-3b6d5ee27660 tempest-SnapshotMetadataTestJSON-1305785842 None] Created reservations ['7e248aca-5af8-467d-be04-5fff8afc42ce', '752b7125-51fd-4031-951b-bffbaf87bb34', 'df1b7ea8-6643-4db9-bcac-1e580781f131', 'eadd37b6-b989-4b08-894e-4926e6fb2ad4'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:59:28 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-6baccdd3-39de-4af9-b507-3b6d5ee27660 tempest-SnapshotMetadataTestJSON-1305785842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:59:28 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-6baccdd3-39de-4af9-b507-3b6d5ee27660 tempest-SnapshotMetadataTestJSON-1305785842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:59:28 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-6baccdd3-39de-4af9-b507-3b6d5ee27660 tempest-SnapshotMetadataTestJSON-1305785842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:59:28 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-6baccdd3-39de-4af9-b507-3b6d5ee27660 tempest-SnapshotMetadataTestJSON-1305785842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:59:28 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-6baccdd3-39de-4af9-b507-3b6d5ee27660 tempest-SnapshotMetadataTestJSON-1305785842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:59:28 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6baccdd3-39de-4af9-b507-3b6d5ee27660 tempest-SnapshotMetadataTestJSON-1305785842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:28 devstack sudo[89476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:59:28 devstack sudo[89476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:29 devstack sudo[89476]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:29 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6baccdd3-39de-4af9-b507-3b6d5ee27660 tempest-SnapshotMetadataTestJSON-1305785842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.441s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:29 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-6baccdd3-39de-4af9-b507-3b6d5ee27660 tempest-SnapshotMetadataTestJSON-1305785842 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:59:29 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-6baccdd3-39de-4af9-b507-3b6d5ee27660 tempest-SnapshotMetadataTestJSON-1305785842 None] Deleted volume successfully.
Apr 15 15:59:29 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-6baccdd3-39de-4af9-b507-3b6d5ee27660 tempest-SnapshotMetadataTestJSON-1305785842 None] Lock "cinder-c8b4cd4a-680d-4d50-8978-3dcdc6f86d02-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:59:31 devstack cinder-volume[82485]: DEBUG dbcounter [-] [82485] Writing DB stats cinder:INSERT=54,cinder:UPDATE=194,cinder:SELECT=151,cinder:DELETE=21 {{(pid=82485) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 15:59:31 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c0c709e-9aee-4e31-abd9-b2a1bdec30bf tempest-VolumesDeleteCascade-2044992707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:59:31 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-5c0c709e-9aee-4e31-abd9-b2a1bdec30bf tempest-VolumesDeleteCascade-2044992707 None] Flow 'volume_create_manager' (a2676122-1a18-434c-a1d0-276b8e8f0e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:59:31 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-5c0c709e-9aee-4e31-abd9-b2a1bdec30bf tempest-VolumesDeleteCascade-2044992707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df30627f-b091-465c-8c14-d9824c637b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:59:31 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-5c0c709e-9aee-4e31-abd9-b2a1bdec30bf tempest-VolumesDeleteCascade-2044992707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df30627f-b091-465c-8c14-d9824c637b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:59:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-321562997',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dbe5946-dac7-46b0-8758-d3fefccfd5da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67e3e0dabdc048219cc8341ae456b6dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:59:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:59:32Z,use_quota=True,user_id='fde42d8564444314b033a2f5e30c6cc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:59:31 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-5c0c709e-9aee-4e31-abd9-b2a1bdec30bf tempest-VolumesDeleteCascade-2044992707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93fe49df-2500-40d9-9520-c78a27bacdce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:59:31 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-5c0c709e-9aee-4e31-abd9-b2a1bdec30bf tempest-VolumesDeleteCascade-2044992707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93fe49df-2500-40d9-9520-c78a27bacdce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:59:31 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-5c0c709e-9aee-4e31-abd9-b2a1bdec30bf tempest-VolumesDeleteCascade-2044992707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55321e42-c6af-4cc1-ac17-0921b4d5e7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:59:31 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-5c0c709e-9aee-4e31-abd9-b2a1bdec30bf tempest-VolumesDeleteCascade-2044992707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55321e42-c6af-4cc1-ac17-0921b4d5e7b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dbe5946-dac7-46b0-8758-d3fefccfd5da', 'volume_name': 'volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:59:32 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-5c0c709e-9aee-4e31-abd9-b2a1bdec30bf tempest-VolumesDeleteCascade-2044992707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87d81ba3-19c7-4b38-9c2c-bd92f5714195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:59:32 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-5c0c709e-9aee-4e31-abd9-b2a1bdec30bf tempest-VolumesDeleteCascade-2044992707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87d81ba3-19c7-4b38-9c2c-bd92f5714195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:59:32 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-5c0c709e-9aee-4e31-abd9-b2a1bdec30bf tempest-VolumesDeleteCascade-2044992707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c258348-1c91-4c35-bbe4-f879e8335250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:59:32 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-5c0c709e-9aee-4e31-abd9-b2a1bdec30bf tempest-VolumesDeleteCascade-2044992707 None] Volume 6dbe5946-dac7-46b0-8758-d3fefccfd5da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da', 'volume_size': 1}
Apr 15 15:59:32 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-5c0c709e-9aee-4e31-abd9-b2a1bdec30bf tempest-VolumesDeleteCascade-2044992707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:59:32 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-5c0c709e-9aee-4e31-abd9-b2a1bdec30bf tempest-VolumesDeleteCascade-2044992707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:59:32 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-5c0c709e-9aee-4e31-abd9-b2a1bdec30bf tempest-VolumesDeleteCascade-2044992707 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:59:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-321562997',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dbe5946-dac7-46b0-8758-d3fefccfd5da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67e3e0dabdc048219cc8341ae456b6dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:59:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:59:32Z,use_quota=True,user_id='fde42d8564444314b033a2f5e30c6cc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:59:32 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-5c0c709e-9aee-4e31-abd9-b2a1bdec30bf tempest-VolumesDeleteCascade-2044992707 None] Creating volume 6dbe5946-dac7-46b0-8758-d3fefccfd5da {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:59:32 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-5c0c709e-9aee-4e31-abd9-b2a1bdec30bf tempest-VolumesDeleteCascade-2044992707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:59:32 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-5c0c709e-9aee-4e31-abd9-b2a1bdec30bf tempest-VolumesDeleteCascade-2044992707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:59:32 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-5c0c709e-9aee-4e31-abd9-b2a1bdec30bf tempest-VolumesDeleteCascade-2044992707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:59:32 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-5c0c709e-9aee-4e31-abd9-b2a1bdec30bf tempest-VolumesDeleteCascade-2044992707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:59:32 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-5c0c709e-9aee-4e31-abd9-b2a1bdec30bf tempest-VolumesDeleteCascade-2044992707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:59:32 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-5c0c709e-9aee-4e31-abd9-b2a1bdec30bf tempest-VolumesDeleteCascade-2044992707 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:59:32 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-5c0c709e-9aee-4e31-abd9-b2a1bdec30bf tempest-VolumesDeleteCascade-2044992707 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:59:32 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-5c0c709e-9aee-4e31-abd9-b2a1bdec30bf tempest-VolumesDeleteCascade-2044992707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:32 devstack sudo[89479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da 1073741824
Apr 15 15:59:32 devstack sudo[89479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:32 devstack sudo[89479]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:32 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-5c0c709e-9aee-4e31-abd9-b2a1bdec30bf tempest-VolumesDeleteCascade-2044992707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da 1073741824" returned: 0 in 0.519s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:32 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-5c0c709e-9aee-4e31-abd9-b2a1bdec30bf tempest-VolumesDeleteCascade-2044992707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:32 devstack sudo[89484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da
Apr 15 15:59:32 devstack sudo[89484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:33 devstack sudo[89484]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:33 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-5c0c709e-9aee-4e31-abd9-b2a1bdec30bf tempest-VolumesDeleteCascade-2044992707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da" returned: 0 in 0.507s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:33 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-5c0c709e-9aee-4e31-abd9-b2a1bdec30bf tempest-VolumesDeleteCascade-2044992707 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:59:33 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-5c0c709e-9aee-4e31-abd9-b2a1bdec30bf tempest-VolumesDeleteCascade-2044992707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:59:33 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-5c0c709e-9aee-4e31-abd9-b2a1bdec30bf tempest-VolumesDeleteCascade-2044992707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c258348-1c91-4c35-bbe4-f879e8335250) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:59:33 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-5c0c709e-9aee-4e31-abd9-b2a1bdec30bf tempest-VolumesDeleteCascade-2044992707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f93e586-5186-4067-836f-3118c0e49cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:59:33 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-5c0c709e-9aee-4e31-abd9-b2a1bdec30bf tempest-VolumesDeleteCascade-2044992707 None] Volume volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da (6dbe5946-dac7-46b0-8758-d3fefccfd5da): created successfully
Apr 15 15:59:33 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-5c0c709e-9aee-4e31-abd9-b2a1bdec30bf tempest-VolumesDeleteCascade-2044992707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f93e586-5186-4067-836f-3118c0e49cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:59:33 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-5c0c709e-9aee-4e31-abd9-b2a1bdec30bf tempest-VolumesDeleteCascade-2044992707 None] Flow 'volume_create_manager' (a2676122-1a18-434c-a1d0-276b8e8f0e53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:59:33 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-5c0c709e-9aee-4e31-abd9-b2a1bdec30bf tempest-VolumesDeleteCascade-2044992707 None] Created volume successfully.
Apr 15 15:59:34 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-55e3ff38-23f5-4136-a4a4-a02ee6041cbe tempest-VolumesDeleteCascade-2044992707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:59:34 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-55e3ff38-23f5-4136-a4a4-a02ee6041cbe tempest-VolumesDeleteCascade-2044992707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:59:34 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-55e3ff38-23f5-4136-a4a4-a02ee6041cbe tempest-VolumesDeleteCascade-2044992707 None] Creating offline snapshot fa36739a-5028-4dd6-8203-6018bc1c64a1 of volume 6dbe5946-dac7-46b0-8758-d3fefccfd5da {{(pid=82485) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 15:59:34 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0acd66-fb48-4311-a865-7bd3871f0bc1]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:59:34 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-55e3ff38-23f5-4136-a4a4-a02ee6041cbe tempest-VolumesDeleteCascade-2044992707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:34 devstack sudo[89487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da
Apr 15 15:59:34 devstack sudo[89487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:34 devstack sudo[89487]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:34 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-55e3ff38-23f5-4136-a4a4-a02ee6041cbe tempest-VolumesDeleteCascade-2044992707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da" returned: 0 in 0.576s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:34 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-55e3ff38-23f5-4136-a4a4-a02ee6041cbe tempest-VolumesDeleteCascade-2044992707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da.fa36739a-5028-4dd6-8203-6018bc1c64a1 1G {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:34 devstack sudo[89493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da.fa36739a-5028-4dd6-8203-6018bc1c64a1 1G
Apr 15 15:59:34 devstack sudo[89493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:35 devstack sudo[89493]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:35 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-55e3ff38-23f5-4136-a4a4-a02ee6041cbe tempest-VolumesDeleteCascade-2044992707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da.fa36739a-5028-4dd6-8203-6018bc1c64a1 1G" returned: 0 in 0.623s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:35 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-55e3ff38-23f5-4136-a4a4-a02ee6041cbe tempest-VolumesDeleteCascade-2044992707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da.fa36739a-5028-4dd6-8203-6018bc1c64a1 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:35 devstack sudo[89504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da.fa36739a-5028-4dd6-8203-6018bc1c64a1
Apr 15 15:59:35 devstack sudo[89504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:35 devstack sudo[89504]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:35 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-55e3ff38-23f5-4136-a4a4-a02ee6041cbe tempest-VolumesDeleteCascade-2044992707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da.fa36739a-5028-4dd6-8203-6018bc1c64a1" returned: 0 in 0.495s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:35 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-55e3ff38-23f5-4136-a4a4-a02ee6041cbe tempest-VolumesDeleteCascade-2044992707 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da.fa36739a-5028-4dd6-8203-6018bc1c64a1 is being set with open permissions: ugo+rw
Apr 15 15:59:35 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-55e3ff38-23f5-4136-a4a4-a02ee6041cbe tempest-VolumesDeleteCascade-2044992707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da.fa36739a-5028-4dd6-8203-6018bc1c64a1 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:35 devstack sudo[89509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da.fa36739a-5028-4dd6-8203-6018bc1c64a1
Apr 15 15:59:35 devstack sudo[89509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:36 devstack sudo[89509]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:36 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-55e3ff38-23f5-4136-a4a4-a02ee6041cbe tempest-VolumesDeleteCascade-2044992707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da.fa36739a-5028-4dd6-8203-6018bc1c64a1" returned: 0 in 0.518s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:36 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-55e3ff38-23f5-4136-a4a4-a02ee6041cbe tempest-VolumesDeleteCascade-2044992707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da.info {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:36 devstack sudo[89512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da.info
Apr 15 15:59:36 devstack sudo[89512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:36 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-592f1b75-c49b-47a8-8f3c-37bca0e43a49 tempest-SnapshotDependencyTests-313489084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:59:36 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-592f1b75-c49b-47a8-8f3c-37bca0e43a49 tempest-SnapshotDependencyTests-313489084 None] Flow 'volume_create_manager' (65f09827-796d-4b56-8deb-58e723f41471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:59:36 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-592f1b75-c49b-47a8-8f3c-37bca0e43a49 tempest-SnapshotDependencyTests-313489084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc50a98b-e4b5-4f01-a3e1-31b147203ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:59:36 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-592f1b75-c49b-47a8-8f3c-37bca0e43a49 tempest-SnapshotDependencyTests-313489084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc50a98b-e4b5-4f01-a3e1-31b147203ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:59:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-561541344',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6764f8b1-9cd0-47e1-ae00-edab30cb3501,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c11e810fbd414cc69daa181450b144d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:59:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:59:37Z,use_quota=True,user_id='659bba96dc5c4ca9af77fb78c76c88a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:59:36 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-592f1b75-c49b-47a8-8f3c-37bca0e43a49 tempest-SnapshotDependencyTests-313489084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce42eb76-d3f3-4daf-aa97-1d504b27d86e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:59:36 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-592f1b75-c49b-47a8-8f3c-37bca0e43a49 tempest-SnapshotDependencyTests-313489084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce42eb76-d3f3-4daf-aa97-1d504b27d86e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:59:36 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-592f1b75-c49b-47a8-8f3c-37bca0e43a49 tempest-SnapshotDependencyTests-313489084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1e99516-7e86-462f-978a-6c6d9c19203c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:59:36 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-592f1b75-c49b-47a8-8f3c-37bca0e43a49 tempest-SnapshotDependencyTests-313489084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1e99516-7e86-462f-978a-6c6d9c19203c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6764f8b1-9cd0-47e1-ae00-edab30cb3501', 'volume_name': 'volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:59:36 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-592f1b75-c49b-47a8-8f3c-37bca0e43a49 tempest-SnapshotDependencyTests-313489084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3aa167f-7695-4034-8fb4-9de176ea870e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:59:36 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-592f1b75-c49b-47a8-8f3c-37bca0e43a49 tempest-SnapshotDependencyTests-313489084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3aa167f-7695-4034-8fb4-9de176ea870e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:59:36 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-592f1b75-c49b-47a8-8f3c-37bca0e43a49 tempest-SnapshotDependencyTests-313489084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1787ce2-464e-4740-8889-20257f3a8a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:59:36 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-592f1b75-c49b-47a8-8f3c-37bca0e43a49 tempest-SnapshotDependencyTests-313489084 None] Volume 6764f8b1-9cd0-47e1-ae00-edab30cb3501: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501', 'volume_size': 1}
Apr 15 15:59:36 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-592f1b75-c49b-47a8-8f3c-37bca0e43a49 tempest-SnapshotDependencyTests-313489084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:59:36 devstack sudo[89512]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:36 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-55e3ff38-23f5-4136-a4a4-a02ee6041cbe tempest-VolumesDeleteCascade-2044992707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da.info" returned: 0 in 0.476s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:36 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-55e3ff38-23f5-4136-a4a4-a02ee6041cbe tempest-VolumesDeleteCascade-2044992707 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da.info is being set with open permissions: ugo+rw
Apr 15 15:59:36 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-55e3ff38-23f5-4136-a4a4-a02ee6041cbe tempest-VolumesDeleteCascade-2044992707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da.info {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:36 devstack sudo[89515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da.info
Apr 15 15:59:36 devstack sudo[89515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:37 devstack sudo[89515]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:37 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-55e3ff38-23f5-4136-a4a4-a02ee6041cbe tempest-VolumesDeleteCascade-2044992707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da.info" returned: 0 in 0.431s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:37 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-55e3ff38-23f5-4136-a4a4-a02ee6041cbe tempest-VolumesDeleteCascade-2044992707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.190s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:59:37 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-592f1b75-c49b-47a8-8f3c-37bca0e43a49 tempest-SnapshotDependencyTests-313489084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.519s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:59:37 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-592f1b75-c49b-47a8-8f3c-37bca0e43a49 tempest-SnapshotDependencyTests-313489084 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:59:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-561541344',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6764f8b1-9cd0-47e1-ae00-edab30cb3501,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c11e810fbd414cc69daa181450b144d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:59:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:59:37Z,use_quota=True,user_id='659bba96dc5c4ca9af77fb78c76c88a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:59:37 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-592f1b75-c49b-47a8-8f3c-37bca0e43a49 tempest-SnapshotDependencyTests-313489084 None] Creating volume 6764f8b1-9cd0-47e1-ae00-edab30cb3501 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:59:37 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-592f1b75-c49b-47a8-8f3c-37bca0e43a49 tempest-SnapshotDependencyTests-313489084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:59:37 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-592f1b75-c49b-47a8-8f3c-37bca0e43a49 tempest-SnapshotDependencyTests-313489084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:59:37 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-592f1b75-c49b-47a8-8f3c-37bca0e43a49 tempest-SnapshotDependencyTests-313489084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:59:37 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-592f1b75-c49b-47a8-8f3c-37bca0e43a49 tempest-SnapshotDependencyTests-313489084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:59:37 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-592f1b75-c49b-47a8-8f3c-37bca0e43a49 tempest-SnapshotDependencyTests-313489084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:59:37 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-592f1b75-c49b-47a8-8f3c-37bca0e43a49 tempest-SnapshotDependencyTests-313489084 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:59:37 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-592f1b75-c49b-47a8-8f3c-37bca0e43a49 tempest-SnapshotDependencyTests-313489084 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:59:37 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-592f1b75-c49b-47a8-8f3c-37bca0e43a49 tempest-SnapshotDependencyTests-313489084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:37 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-55e3ff38-23f5-4136-a4a4-a02ee6041cbe tempest-VolumesDeleteCascade-2044992707 None] Create snapshot completed successfully
Apr 15 15:59:37 devstack sudo[89518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501 1073741824
Apr 15 15:59:37 devstack sudo[89518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:37 devstack sudo[89518]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:37 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-592f1b75-c49b-47a8-8f3c-37bca0e43a49 tempest-SnapshotDependencyTests-313489084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501 1073741824" returned: 0 in 0.524s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:37 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-592f1b75-c49b-47a8-8f3c-37bca0e43a49 tempest-SnapshotDependencyTests-313489084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:37 devstack sudo[89523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501
Apr 15 15:59:37 devstack sudo[89523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:38 devstack sudo[89523]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:38 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-592f1b75-c49b-47a8-8f3c-37bca0e43a49 tempest-SnapshotDependencyTests-313489084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501" returned: 0 in 0.436s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:38 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-592f1b75-c49b-47a8-8f3c-37bca0e43a49 tempest-SnapshotDependencyTests-313489084 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:59:38 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-592f1b75-c49b-47a8-8f3c-37bca0e43a49 tempest-SnapshotDependencyTests-313489084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:59:38 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-592f1b75-c49b-47a8-8f3c-37bca0e43a49 tempest-SnapshotDependencyTests-313489084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1787ce2-464e-4740-8889-20257f3a8a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:59:38 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-592f1b75-c49b-47a8-8f3c-37bca0e43a49 tempest-SnapshotDependencyTests-313489084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf31acef-de69-44ee-818f-1043a7573cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:59:38 devstack cinder-volume[82485]: DEBUG dbcounter [-] [82485] Writing DB stats cinder:SELECT=137,cinder:DELETE=10,cinder:UPDATE=173,cinder:INSERT=50 {{(pid=82485) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 15:59:38 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-592f1b75-c49b-47a8-8f3c-37bca0e43a49 tempest-SnapshotDependencyTests-313489084 None] Volume volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501 (6764f8b1-9cd0-47e1-ae00-edab30cb3501): created successfully
Apr 15 15:59:38 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-592f1b75-c49b-47a8-8f3c-37bca0e43a49 tempest-SnapshotDependencyTests-313489084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf31acef-de69-44ee-818f-1043a7573cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:59:38 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-592f1b75-c49b-47a8-8f3c-37bca0e43a49 tempest-SnapshotDependencyTests-313489084 None] Flow 'volume_create_manager' (65f09827-796d-4b56-8deb-58e723f41471) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:59:38 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-592f1b75-c49b-47a8-8f3c-37bca0e43a49 tempest-SnapshotDependencyTests-313489084 None] Created volume successfully.
Apr 15 15:59:38 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-3e8ce335-84b3-4c78-90e4-127fb6ffc00e tempest-VolumesDeleteCascade-2044992707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:59:38 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-3e8ce335-84b3-4c78-90e4-127fb6ffc00e tempest-VolumesDeleteCascade-2044992707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:59:38 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-3e8ce335-84b3-4c78-90e4-127fb6ffc00e tempest-VolumesDeleteCascade-2044992707 None] Creating offline snapshot 06a1d184-d93b-428d-ab6c-743ee05db35b of volume 6dbe5946-dac7-46b0-8758-d3fefccfd5da {{(pid=82485) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 15:59:38 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9c0731-48b1-4e11-a271-0e770e9d6387]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:59:38 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3e8ce335-84b3-4c78-90e4-127fb6ffc00e tempest-VolumesDeleteCascade-2044992707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da.fa36739a-5028-4dd6-8203-6018bc1c64a1 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:38 devstack sudo[89526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da.fa36739a-5028-4dd6-8203-6018bc1c64a1
Apr 15 15:59:38 devstack sudo[89526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:38 devstack sudo[89526]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:38 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3e8ce335-84b3-4c78-90e4-127fb6ffc00e tempest-VolumesDeleteCascade-2044992707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da.fa36739a-5028-4dd6-8203-6018bc1c64a1" returned: 0 in 0.492s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:38 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-3e8ce335-84b3-4c78-90e4-127fb6ffc00e tempest-VolumesDeleteCascade-2044992707 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82485) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 15:59:38 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3e8ce335-84b3-4c78-90e4-127fb6ffc00e tempest-VolumesDeleteCascade-2044992707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da.fa36739a-5028-4dd6-8203-6018bc1c64a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da.06a1d184-d93b-428d-ab6c-743ee05db35b 1G {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:38 devstack sudo[89531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da.fa36739a-5028-4dd6-8203-6018bc1c64a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da.06a1d184-d93b-428d-ab6c-743ee05db35b 1G
Apr 15 15:59:38 devstack sudo[89531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:39 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-6d994f8d-7f67-4f4f-ac53-6028fb917e02 tempest-SnapshotDependencyTests-313489084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:59:39 devstack sudo[89531]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:39 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3e8ce335-84b3-4c78-90e4-127fb6ffc00e tempest-VolumesDeleteCascade-2044992707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da.fa36739a-5028-4dd6-8203-6018bc1c64a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da.06a1d184-d93b-428d-ab6c-743ee05db35b 1G" returned: 0 in 0.523s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:39 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3e8ce335-84b3-4c78-90e4-127fb6ffc00e tempest-VolumesDeleteCascade-2044992707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da.fa36739a-5028-4dd6-8203-6018bc1c64a1 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da.06a1d184-d93b-428d-ab6c-743ee05db35b {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:39 devstack sudo[89536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da.fa36739a-5028-4dd6-8203-6018bc1c64a1 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da.06a1d184-d93b-428d-ab6c-743ee05db35b
Apr 15 15:59:39 devstack sudo[89536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:39 devstack sudo[89536]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:39 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3e8ce335-84b3-4c78-90e4-127fb6ffc00e tempest-VolumesDeleteCascade-2044992707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da.fa36739a-5028-4dd6-8203-6018bc1c64a1 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da.06a1d184-d93b-428d-ab6c-743ee05db35b" returned: 0 in 0.438s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:39 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-3e8ce335-84b3-4c78-90e4-127fb6ffc00e tempest-VolumesDeleteCascade-2044992707 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da.06a1d184-d93b-428d-ab6c-743ee05db35b is being set with open permissions: ugo+rw
Apr 15 15:59:39 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3e8ce335-84b3-4c78-90e4-127fb6ffc00e tempest-VolumesDeleteCascade-2044992707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da.06a1d184-d93b-428d-ab6c-743ee05db35b {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:39 devstack sudo[89541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da.06a1d184-d93b-428d-ab6c-743ee05db35b
Apr 15 15:59:39 devstack sudo[89541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:40 devstack sudo[89541]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:40 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3e8ce335-84b3-4c78-90e4-127fb6ffc00e tempest-VolumesDeleteCascade-2044992707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da.06a1d184-d93b-428d-ab6c-743ee05db35b" returned: 0 in 0.413s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:40 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-3e8ce335-84b3-4c78-90e4-127fb6ffc00e tempest-VolumesDeleteCascade-2044992707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.923s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:59:40 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-6d994f8d-7f67-4f4f-ac53-6028fb917e02 tempest-SnapshotDependencyTests-313489084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.308s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:59:40 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-6d994f8d-7f67-4f4f-ac53-6028fb917e02 tempest-SnapshotDependencyTests-313489084 None] Creating offline snapshot ad477bbe-95d8-45fe-83c2-4be903505027 of volume 6764f8b1-9cd0-47e1-ae00-edab30cb3501 {{(pid=82485) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 15:59:40 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-3e8ce335-84b3-4c78-90e4-127fb6ffc00e tempest-VolumesDeleteCascade-2044992707 None] Create snapshot completed successfully
Apr 15 15:59:40 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd2f0bf-9c9c-4f81-8dc9-cdfb83eb4733]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:59:40 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6d994f8d-7f67-4f4f-ac53-6028fb917e02 tempest-SnapshotDependencyTests-313489084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:40 devstack sudo[89544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501
Apr 15 15:59:40 devstack sudo[89544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:40 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-59624ee6-901a-4cf1-9791-982d0a48ceee tempest-VolumesDeleteCascade-2044992707 None] Acquiring lock "cinder-6dbe5946-dac7-46b0-8758-d3fefccfd5da-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:59:40 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-59624ee6-901a-4cf1-9791-982d0a48ceee tempest-VolumesDeleteCascade-2044992707 None] Lock "cinder-6dbe5946-dac7-46b0-8758-d3fefccfd5da-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:59:40 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-59624ee6-901a-4cf1-9791-982d0a48ceee tempest-VolumesDeleteCascade-2044992707 None] Performing cascade delete. {{(pid=82485) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 15 15:59:40 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-59624ee6-901a-4cf1-9791-982d0a48ceee tempest-VolumesDeleteCascade-2044992707 None] Acquiring lock "cinder-06a1d184-d93b-428d-ab6c-743ee05db35b-delete_snapshot" by "delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:59:40 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-59624ee6-901a-4cf1-9791-982d0a48ceee tempest-VolumesDeleteCascade-2044992707 None] Lock "cinder-06a1d184-d93b-428d-ab6c-743ee05db35b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:59:40 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-59624ee6-901a-4cf1-9791-982d0a48ceee tempest-VolumesDeleteCascade-2044992707 None] Acquiring lock "cinder-quobyte-6dbe5946-dac7-46b0-8758-d3fefccfd5da" by "delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:59:40 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-59624ee6-901a-4cf1-9791-982d0a48ceee tempest-VolumesDeleteCascade-2044992707 None] Lock "cinder-quobyte-6dbe5946-dac7-46b0-8758-d3fefccfd5da" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:59:40 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-59624ee6-901a-4cf1-9791-982d0a48ceee tempest-VolumesDeleteCascade-2044992707 None] Acquiring lock "cinder-quobyte-06a1d184-d93b-428d-ab6c-743ee05db35b" by "_delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:59:40 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-59624ee6-901a-4cf1-9791-982d0a48ceee tempest-VolumesDeleteCascade-2044992707 None] Lock "cinder-quobyte-06a1d184-d93b-428d-ab6c-743ee05db35b" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:59:40 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-59624ee6-901a-4cf1-9791-982d0a48ceee tempest-VolumesDeleteCascade-2044992707 None] Deleting offline snapshot 06a1d184-d93b-428d-ab6c-743ee05db35b of volume 6dbe5946-dac7-46b0-8758-d3fefccfd5da {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 15:59:40 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-59624ee6-901a-4cf1-9791-982d0a48ceee tempest-VolumesDeleteCascade-2044992707 None] snapshot_file for this snap is: volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da.06a1d184-d93b-428d-ab6c-743ee05db35b {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 15:59:40 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f3df9c-3204-49ab-bcb2-8a8bb61fc615]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:59:40 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-59624ee6-901a-4cf1-9791-982d0a48ceee tempest-VolumesDeleteCascade-2044992707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da.06a1d184-d93b-428d-ab6c-743ee05db35b {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:40 devstack sudo[89546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da.06a1d184-d93b-428d-ab6c-743ee05db35b
Apr 15 15:59:40 devstack sudo[89546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:40 devstack sudo[89544]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:40 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6d994f8d-7f67-4f4f-ac53-6028fb917e02 tempest-SnapshotDependencyTests-313489084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501" returned: 0 in 0.526s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:40 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6d994f8d-7f67-4f4f-ac53-6028fb917e02 tempest-SnapshotDependencyTests-313489084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501.ad477bbe-95d8-45fe-83c2-4be903505027 1G {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:40 devstack sudo[89551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501.ad477bbe-95d8-45fe-83c2-4be903505027 1G
Apr 15 15:59:40 devstack sudo[89551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:41 devstack sudo[89546]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:41 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-59624ee6-901a-4cf1-9791-982d0a48ceee tempest-VolumesDeleteCascade-2044992707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da.06a1d184-d93b-428d-ab6c-743ee05db35b" returned: 0 in 0.510s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:41 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-59624ee6-901a-4cf1-9791-982d0a48ceee tempest-VolumesDeleteCascade-2044992707 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82485) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 15:59:41 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[61396709-43e0-4969-8fa8-233ccf5ee8e6]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:59:41 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-59624ee6-901a-4cf1-9791-982d0a48ceee tempest-VolumesDeleteCascade-2044992707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da.fa36739a-5028-4dd6-8203-6018bc1c64a1 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:41 devstack sudo[89556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da.fa36739a-5028-4dd6-8203-6018bc1c64a1
Apr 15 15:59:41 devstack sudo[89556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:41 devstack sudo[89551]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:41 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6d994f8d-7f67-4f4f-ac53-6028fb917e02 tempest-SnapshotDependencyTests-313489084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501.ad477bbe-95d8-45fe-83c2-4be903505027 1G" returned: 0 in 0.517s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:41 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6d994f8d-7f67-4f4f-ac53-6028fb917e02 tempest-SnapshotDependencyTests-313489084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501.ad477bbe-95d8-45fe-83c2-4be903505027 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:41 devstack sudo[89593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501.ad477bbe-95d8-45fe-83c2-4be903505027
Apr 15 15:59:41 devstack sudo[89593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:41 devstack sudo[89556]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:41 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-59624ee6-901a-4cf1-9791-982d0a48ceee tempest-VolumesDeleteCascade-2044992707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da.fa36739a-5028-4dd6-8203-6018bc1c64a1" returned: 0 in 0.545s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:41 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-59624ee6-901a-4cf1-9791-982d0a48ceee tempest-VolumesDeleteCascade-2044992707 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82485) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 15:59:41 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-59624ee6-901a-4cf1-9791-982d0a48ceee tempest-VolumesDeleteCascade-2044992707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da.06a1d184-d93b-428d-ab6c-743ee05db35b {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:41 devstack sudo[89600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da.06a1d184-d93b-428d-ab6c-743ee05db35b
Apr 15 15:59:41 devstack sudo[89600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:41 devstack sudo[89593]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:41 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6d994f8d-7f67-4f4f-ac53-6028fb917e02 tempest-SnapshotDependencyTests-313489084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501.ad477bbe-95d8-45fe-83c2-4be903505027" returned: 0 in 0.450s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:41 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-6d994f8d-7f67-4f4f-ac53-6028fb917e02 tempest-SnapshotDependencyTests-313489084 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501.ad477bbe-95d8-45fe-83c2-4be903505027 is being set with open permissions: ugo+rw
Apr 15 15:59:41 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6d994f8d-7f67-4f4f-ac53-6028fb917e02 tempest-SnapshotDependencyTests-313489084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501.ad477bbe-95d8-45fe-83c2-4be903505027 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:41 devstack sudo[89605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501.ad477bbe-95d8-45fe-83c2-4be903505027
Apr 15 15:59:41 devstack sudo[89605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:42 devstack sudo[89600]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:42 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-59624ee6-901a-4cf1-9791-982d0a48ceee tempest-VolumesDeleteCascade-2044992707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da.06a1d184-d93b-428d-ab6c-743ee05db35b" returned: 0 in 0.510s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:42 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-59624ee6-901a-4cf1-9791-982d0a48ceee tempest-VolumesDeleteCascade-2044992707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da.06a1d184-d93b-428d-ab6c-743ee05db35b {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:42 devstack sudo[89611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da.06a1d184-d93b-428d-ab6c-743ee05db35b
Apr 15 15:59:42 devstack sudo[89611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:42 devstack sudo[89605]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:42 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6d994f8d-7f67-4f4f-ac53-6028fb917e02 tempest-SnapshotDependencyTests-313489084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501.ad477bbe-95d8-45fe-83c2-4be903505027" returned: 0 in 0.482s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:42 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6d994f8d-7f67-4f4f-ac53-6028fb917e02 tempest-SnapshotDependencyTests-313489084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501.info {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:42 devstack sudo[89613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501.info
Apr 15 15:59:42 devstack sudo[89613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:42 devstack sudo[89611]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:42 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-59624ee6-901a-4cf1-9791-982d0a48ceee tempest-VolumesDeleteCascade-2044992707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da.06a1d184-d93b-428d-ab6c-743ee05db35b" returned: 0 in 0.464s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:42 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-59624ee6-901a-4cf1-9791-982d0a48ceee tempest-VolumesDeleteCascade-2044992707 None] Lock "cinder-quobyte-06a1d184-d93b-428d-ab6c-743ee05db35b" released by "_delete_snapshot" :: held 2.086s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:59:42 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-59624ee6-901a-4cf1-9791-982d0a48ceee tempest-VolumesDeleteCascade-2044992707 None] Lock "cinder-quobyte-6dbe5946-dac7-46b0-8758-d3fefccfd5da" released by "delete_snapshot" :: held 2.097s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:59:42 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-59624ee6-901a-4cf1-9791-982d0a48ceee tempest-VolumesDeleteCascade-2044992707 None] Created reservations ['75961b6e-6312-4923-a6d5-1795fd879779', '600796c4-a4de-490e-ad58-8e67ee493156', 'cd92895c-5200-41e8-b9f3-f43507031d57', '9d682b52-403a-411e-b185-96c22d82d59d'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:59:42 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-59624ee6-901a-4cf1-9791-982d0a48ceee tempest-VolumesDeleteCascade-2044992707 None] Delete snapshot completed successfully.
Apr 15 15:59:42 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-59624ee6-901a-4cf1-9791-982d0a48ceee tempest-VolumesDeleteCascade-2044992707 None] Lock "cinder-06a1d184-d93b-428d-ab6c-743ee05db35b-delete_snapshot" released by "delete_snapshot" :: held 2.186s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:59:42 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-59624ee6-901a-4cf1-9791-982d0a48ceee tempest-VolumesDeleteCascade-2044992707 None] Acquiring lock "cinder-fa36739a-5028-4dd6-8203-6018bc1c64a1-delete_snapshot" by "delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:59:42 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-59624ee6-901a-4cf1-9791-982d0a48ceee tempest-VolumesDeleteCascade-2044992707 None] Lock "cinder-fa36739a-5028-4dd6-8203-6018bc1c64a1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:59:42 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-59624ee6-901a-4cf1-9791-982d0a48ceee tempest-VolumesDeleteCascade-2044992707 None] Acquiring lock "cinder-quobyte-6dbe5946-dac7-46b0-8758-d3fefccfd5da" by "delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:59:42 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-59624ee6-901a-4cf1-9791-982d0a48ceee tempest-VolumesDeleteCascade-2044992707 None] Lock "cinder-quobyte-6dbe5946-dac7-46b0-8758-d3fefccfd5da" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:59:42 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-59624ee6-901a-4cf1-9791-982d0a48ceee tempest-VolumesDeleteCascade-2044992707 None] Acquiring lock "cinder-quobyte-fa36739a-5028-4dd6-8203-6018bc1c64a1" by "_delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:59:42 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-59624ee6-901a-4cf1-9791-982d0a48ceee tempest-VolumesDeleteCascade-2044992707 None] Lock "cinder-quobyte-fa36739a-5028-4dd6-8203-6018bc1c64a1" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:59:42 devstack sudo[89613]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:42 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-59624ee6-901a-4cf1-9791-982d0a48ceee tempest-VolumesDeleteCascade-2044992707 None] Deleting offline snapshot fa36739a-5028-4dd6-8203-6018bc1c64a1 of volume 6dbe5946-dac7-46b0-8758-d3fefccfd5da {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 15:59:42 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-59624ee6-901a-4cf1-9791-982d0a48ceee tempest-VolumesDeleteCascade-2044992707 None] snapshot_file for this snap is: volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da.fa36739a-5028-4dd6-8203-6018bc1c64a1 {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 15:59:42 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6d994f8d-7f67-4f4f-ac53-6028fb917e02 tempest-SnapshotDependencyTests-313489084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501.info" returned: 0 in 0.456s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:42 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-6d994f8d-7f67-4f4f-ac53-6028fb917e02 tempest-SnapshotDependencyTests-313489084 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501.info is being set with open permissions: ugo+rw
Apr 15 15:59:42 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6d994f8d-7f67-4f4f-ac53-6028fb917e02 tempest-SnapshotDependencyTests-313489084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501.info {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:42 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a88ad39-1bc7-492a-8e92-8bc9ce7faa0d]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:59:42 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-59624ee6-901a-4cf1-9791-982d0a48ceee tempest-VolumesDeleteCascade-2044992707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da.fa36739a-5028-4dd6-8203-6018bc1c64a1 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:42 devstack sudo[89617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501.info
Apr 15 15:59:42 devstack sudo[89617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:42 devstack sudo[89618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da.fa36739a-5028-4dd6-8203-6018bc1c64a1
Apr 15 15:59:42 devstack sudo[89618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:43 devstack sudo[89617]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:43 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6d994f8d-7f67-4f4f-ac53-6028fb917e02 tempest-SnapshotDependencyTests-313489084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501.info" returned: 0 in 0.413s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:43 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-6d994f8d-7f67-4f4f-ac53-6028fb917e02 tempest-SnapshotDependencyTests-313489084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.911s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:59:43 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-6d994f8d-7f67-4f4f-ac53-6028fb917e02 tempest-SnapshotDependencyTests-313489084 None] Create snapshot completed successfully
Apr 15 15:59:43 devstack sudo[89618]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:43 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-59624ee6-901a-4cf1-9791-982d0a48ceee tempest-VolumesDeleteCascade-2044992707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da.fa36739a-5028-4dd6-8203-6018bc1c64a1" returned: 0 in 0.499s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:43 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-59624ee6-901a-4cf1-9791-982d0a48ceee tempest-VolumesDeleteCascade-2044992707 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82485) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 15:59:43 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[648ebf5e-0aa1-4109-852d-39d444f9ddaa]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:59:43 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-59624ee6-901a-4cf1-9791-982d0a48ceee tempest-VolumesDeleteCascade-2044992707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:43 devstack sudo[89625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da
Apr 15 15:59:43 devstack sudo[89625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:43 devstack sudo[89625]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:43 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-59624ee6-901a-4cf1-9791-982d0a48ceee tempest-VolumesDeleteCascade-2044992707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da" returned: 0 in 0.481s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:43 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-59624ee6-901a-4cf1-9791-982d0a48ceee tempest-VolumesDeleteCascade-2044992707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da.fa36739a-5028-4dd6-8203-6018bc1c64a1 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:43 devstack sudo[89630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da.fa36739a-5028-4dd6-8203-6018bc1c64a1
Apr 15 15:59:43 devstack sudo[89630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:44 devstack sudo[89630]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-59624ee6-901a-4cf1-9791-982d0a48ceee tempest-VolumesDeleteCascade-2044992707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da.fa36739a-5028-4dd6-8203-6018bc1c64a1" returned: 0 in 0.505s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-59624ee6-901a-4cf1-9791-982d0a48ceee tempest-VolumesDeleteCascade-2044992707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da.fa36739a-5028-4dd6-8203-6018bc1c64a1 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:44 devstack sudo[89635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da.fa36739a-5028-4dd6-8203-6018bc1c64a1
Apr 15 15:59:44 devstack sudo[89635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:44 devstack cinder-volume[82485]: DEBUG oslo_service.periodic_task [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82485) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 15 15:59:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:59:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:59:44 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:59:44 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:59:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:59:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:44 devstack sudo[89637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:59:44 devstack sudo[89637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:44 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-07875bc7-513c-4812-b95a-0d9e6037b30a tempest-SnapshotDependencyTests-313489084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:59:44 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-07875bc7-513c-4812-b95a-0d9e6037b30a tempest-SnapshotDependencyTests-313489084 None] Flow 'volume_create_manager' (cd2dd125-b86e-41a3-8467-258bb8448b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:59:44 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-07875bc7-513c-4812-b95a-0d9e6037b30a tempest-SnapshotDependencyTests-313489084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (193c9ba9-e728-4f17-ae2a-c533cc4a7c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:59:44 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-07875bc7-513c-4812-b95a-0d9e6037b30a tempest-SnapshotDependencyTests-313489084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (193c9ba9-e728-4f17-ae2a-c533cc4a7c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:59:44Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f1e7af1-3121-4725-8a0e-26eb5baad375,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c11e810fbd414cc69daa181450b144d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:59:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ad477bbe-95d8-45fe-83c2-4be903505027,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:59:45Z,use_quota=True,user_id='659bba96dc5c4ca9af77fb78c76c88a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:59:44 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-07875bc7-513c-4812-b95a-0d9e6037b30a tempest-SnapshotDependencyTests-313489084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a3c9a69-c04e-426e-9c7c-93ae31a0fb3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:59:44 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-07875bc7-513c-4812-b95a-0d9e6037b30a tempest-SnapshotDependencyTests-313489084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a3c9a69-c04e-426e-9c7c-93ae31a0fb3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:59:44 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-07875bc7-513c-4812-b95a-0d9e6037b30a tempest-SnapshotDependencyTests-313489084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e58256e-612c-4110-ba1e-aceba50610b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:59:44 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-07875bc7-513c-4812-b95a-0d9e6037b30a tempest-SnapshotDependencyTests-313489084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e58256e-612c-4110-ba1e-aceba50610b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6f1e7af1-3121-4725-8a0e-26eb5baad375', 'volume_name': 'volume-6f1e7af1-3121-4725-8a0e-26eb5baad375', 'volume_size': 1, 'snapshot_id': 'ad477bbe-95d8-45fe-83c2-4be903505027'}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:59:44 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-07875bc7-513c-4812-b95a-0d9e6037b30a tempest-SnapshotDependencyTests-313489084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25dc1f96-e204-4f74-a719-a57f28a4e1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:59:44 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-07875bc7-513c-4812-b95a-0d9e6037b30a tempest-SnapshotDependencyTests-313489084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25dc1f96-e204-4f74-a719-a57f28a4e1e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:59:44 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-07875bc7-513c-4812-b95a-0d9e6037b30a tempest-SnapshotDependencyTests-313489084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afab713f-7313-4179-8832-bc7de9a7e0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:59:44 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-07875bc7-513c-4812-b95a-0d9e6037b30a tempest-SnapshotDependencyTests-313489084 None] Volume 6f1e7af1-3121-4725-8a0e-26eb5baad375: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6f1e7af1-3121-4725-8a0e-26eb5baad375', 'volume_size': 1, 'snapshot_id': 'ad477bbe-95d8-45fe-83c2-4be903505027'}
Apr 15 15:59:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-07875bc7-513c-4812-b95a-0d9e6037b30a tempest-SnapshotDependencyTests-313489084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:59:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-07875bc7-513c-4812-b95a-0d9e6037b30a tempest-SnapshotDependencyTests-313489084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:59:44 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-07875bc7-513c-4812-b95a-0d9e6037b30a tempest-SnapshotDependencyTests-313489084 None] Acquiring lock "cinder-quobyte-ad477bbe-95d8-45fe-83c2-4be903505027-6f1e7af1-3121-4725-8a0e-26eb5baad375" by "_create_volume_from_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:59:44 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-07875bc7-513c-4812-b95a-0d9e6037b30a tempest-SnapshotDependencyTests-313489084 None] Lock "cinder-quobyte-ad477bbe-95d8-45fe-83c2-4be903505027-6f1e7af1-3121-4725-8a0e-26eb5baad375" acquired by "_create_volume_from_snapshot" :: waited 0.010s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:59:44 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-07875bc7-513c-4812-b95a-0d9e6037b30a tempest-SnapshotDependencyTests-313489084 None] Creating volume 6f1e7af1-3121-4725-8a0e-26eb5baad375 from snapshot ad477bbe-95d8-45fe-83c2-4be903505027 {{(pid=82485) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 15 15:59:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-07875bc7-513c-4812-b95a-0d9e6037b30a tempest-SnapshotDependencyTests-313489084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:59:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-07875bc7-513c-4812-b95a-0d9e6037b30a tempest-SnapshotDependencyTests-313489084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:59:44 devstack sudo[89635]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:44 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-07875bc7-513c-4812-b95a-0d9e6037b30a tempest-SnapshotDependencyTests-313489084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:59:44 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-07875bc7-513c-4812-b95a-0d9e6037b30a tempest-SnapshotDependencyTests-313489084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:59:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-07875bc7-513c-4812-b95a-0d9e6037b30a tempest-SnapshotDependencyTests-313489084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:59:44 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-07875bc7-513c-4812-b95a-0d9e6037b30a tempest-SnapshotDependencyTests-313489084 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:59:44 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-07875bc7-513c-4812-b95a-0d9e6037b30a tempest-SnapshotDependencyTests-313489084 None] Acquiring lock "cinder-quobyte-6f1e7af1-3121-4725-8a0e-26eb5baad375" by "_copy_volume_from_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:59:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-59624ee6-901a-4cf1-9791-982d0a48ceee tempest-VolumesDeleteCascade-2044992707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da.fa36739a-5028-4dd6-8203-6018bc1c64a1" returned: 0 in 0.484s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:44 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-07875bc7-513c-4812-b95a-0d9e6037b30a tempest-SnapshotDependencyTests-313489084 None] Lock "cinder-quobyte-6f1e7af1-3121-4725-8a0e-26eb5baad375" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:59:44 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-07875bc7-513c-4812-b95a-0d9e6037b30a tempest-SnapshotDependencyTests-313489084 None] snapshot: ad477bbe-95d8-45fe-83c2-4be903505027, volume: 6f1e7af1-3121-4725-8a0e-26eb5baad375,  {{(pid=82485) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 15 15:59:44 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-59624ee6-901a-4cf1-9791-982d0a48ceee tempest-VolumesDeleteCascade-2044992707 None] Lock "cinder-quobyte-fa36739a-5028-4dd6-8203-6018bc1c64a1" released by "_delete_snapshot" :: held 2.035s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:59:44 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-59624ee6-901a-4cf1-9791-982d0a48ceee tempest-VolumesDeleteCascade-2044992707 None] Lock "cinder-quobyte-6dbe5946-dac7-46b0-8758-d3fefccfd5da" released by "delete_snapshot" :: held 2.050s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:59:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-07875bc7-513c-4812-b95a-0d9e6037b30a tempest-SnapshotDependencyTests-313489084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:59:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-07875bc7-513c-4812-b95a-0d9e6037b30a tempest-SnapshotDependencyTests-313489084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:59:44 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-07875bc7-513c-4812-b95a-0d9e6037b30a tempest-SnapshotDependencyTests-313489084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:59:44 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-07875bc7-513c-4812-b95a-0d9e6037b30a tempest-SnapshotDependencyTests-313489084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:59:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-07875bc7-513c-4812-b95a-0d9e6037b30a tempest-SnapshotDependencyTests-313489084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:59:44 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aafd57b-eb97-44db-b6a1-05487ae88e2f]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:59:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-07875bc7-513c-4812-b95a-0d9e6037b30a tempest-SnapshotDependencyTests-313489084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501.ad477bbe-95d8-45fe-83c2-4be903505027 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:44 devstack sudo[89637]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.509s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:44 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:59:44 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-59624ee6-901a-4cf1-9791-982d0a48ceee tempest-VolumesDeleteCascade-2044992707 None] Created reservations ['a68c649e-1ee4-4688-8fb0-e845985bef78', 'd8ca4184-8ef5-4f89-b57b-b15cd14f7c30', '8b2a6ae4-92aa-4f25-b94d-ae4ba4643213', '8334465d-42bb-4fa5-8061-d91c1a680879'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:59:45 devstack sudo[89642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501.ad477bbe-95d8-45fe-83c2-4be903505027
Apr 15 15:59:45 devstack sudo[89642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:45 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-59624ee6-901a-4cf1-9791-982d0a48ceee tempest-VolumesDeleteCascade-2044992707 None] Delete snapshot completed successfully.
Apr 15 15:59:45 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-59624ee6-901a-4cf1-9791-982d0a48ceee tempest-VolumesDeleteCascade-2044992707 None] Lock "cinder-fa36739a-5028-4dd6-8203-6018bc1c64a1-delete_snapshot" released by "delete_snapshot" :: held 2.204s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:59:45 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-59624ee6-901a-4cf1-9791-982d0a48ceee tempest-VolumesDeleteCascade-2044992707 None] Snapshots deleted, issuing volume delete {{(pid=82485) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 15 15:59:45 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-59624ee6-901a-4cf1-9791-982d0a48ceee tempest-VolumesDeleteCascade-2044992707 None] Acquiring lock "cinder-quobyte-6dbe5946-dac7-46b0-8758-d3fefccfd5da" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:59:45 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-59624ee6-901a-4cf1-9791-982d0a48ceee tempest-VolumesDeleteCascade-2044992707 None] Lock "cinder-quobyte-6dbe5946-dac7-46b0-8758-d3fefccfd5da" acquired by "delete_volume" :: waited 0.007s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:59:45 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[00567fae-686b-4548-b670-12cf0e4bb870]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:59:45 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-59624ee6-901a-4cf1-9791-982d0a48ceee tempest-VolumesDeleteCascade-2044992707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:45 devstack sudo[89644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da
Apr 15 15:59:45 devstack sudo[89644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:45 devstack sudo[89642]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:45 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-07875bc7-513c-4812-b95a-0d9e6037b30a tempest-SnapshotDependencyTests-313489084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501.ad477bbe-95d8-45fe-83c2-4be903505027" returned: 0 in 0.500s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:45 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-07875bc7-513c-4812-b95a-0d9e6037b30a tempest-SnapshotDependencyTests-313489084 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82485) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 15:59:45 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-07875bc7-513c-4812-b95a-0d9e6037b30a tempest-SnapshotDependencyTests-313489084 None] will copy from snapshot at /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501 {{(pid=82485) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 15 15:59:45 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-07875bc7-513c-4812-b95a-0d9e6037b30a tempest-SnapshotDependencyTests-313489084 None] Creating direct copy from snapshot {{(pid=82485) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 15 15:59:45 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f1c47b-c1c3-4237-b306-848761b9056d]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:59:45 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-07875bc7-513c-4812-b95a-0d9e6037b30a tempest-SnapshotDependencyTests-313489084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:45 devstack sudo[89649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501
Apr 15 15:59:45 devstack sudo[89649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:45 devstack sudo[89644]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:45 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-59624ee6-901a-4cf1-9791-982d0a48ceee tempest-VolumesDeleteCascade-2044992707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da" returned: 0 in 0.488s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:45 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-59624ee6-901a-4cf1-9791-982d0a48ceee tempest-VolumesDeleteCascade-2044992707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:45 devstack sudo[89654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da
Apr 15 15:59:45 devstack sudo[89654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:45 devstack sudo[89649]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:45 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-07875bc7-513c-4812-b95a-0d9e6037b30a tempest-SnapshotDependencyTests-313489084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501" returned: 0 in 0.517s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:45 devstack cinder-volume[82485]: DEBUG cinder.utils [None req-07875bc7-513c-4812-b95a-0d9e6037b30a tempest-SnapshotDependencyTests-313489084 None] Path /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6f1e7af1-3121-4725-8a0e-26eb5baad375 not found in is_blk_device check {{(pid=82485) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 15 15:59:45 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-07875bc7-513c-4812-b95a-0d9e6037b30a tempest-SnapshotDependencyTests-313489084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6f1e7af1-3121-4725-8a0e-26eb5baad375 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:45 devstack sudo[89660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6f1e7af1-3121-4725-8a0e-26eb5baad375
Apr 15 15:59:45 devstack sudo[89660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:45 devstack sudo[89654]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:45 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-59624ee6-901a-4cf1-9791-982d0a48ceee tempest-VolumesDeleteCascade-2044992707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6dbe5946-dac7-46b0-8758-d3fefccfd5da" returned: 0 in 0.448s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:45 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-59624ee6-901a-4cf1-9791-982d0a48ceee tempest-VolumesDeleteCascade-2044992707 None] Lock "cinder-quobyte-6dbe5946-dac7-46b0-8758-d3fefccfd5da" released by "delete_volume" :: held 0.965s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:59:46 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-59624ee6-901a-4cf1-9791-982d0a48ceee tempest-VolumesDeleteCascade-2044992707 None] Created reservations ['050de2bb-b503-401a-9c36-671233176643', 'ab261946-bdfc-4f77-a876-481ddd8d29e2', '94be45a4-b18a-4f16-8d5a-4c299fba4973', '73aaadd0-8798-4c5b-b2a7-b686d17377a2'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:59:46 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-59624ee6-901a-4cf1-9791-982d0a48ceee tempest-VolumesDeleteCascade-2044992707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:59:46 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-59624ee6-901a-4cf1-9791-982d0a48ceee tempest-VolumesDeleteCascade-2044992707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:59:46 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-59624ee6-901a-4cf1-9791-982d0a48ceee tempest-VolumesDeleteCascade-2044992707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:59:46 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-59624ee6-901a-4cf1-9791-982d0a48ceee tempest-VolumesDeleteCascade-2044992707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:59:46 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-59624ee6-901a-4cf1-9791-982d0a48ceee tempest-VolumesDeleteCascade-2044992707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:59:46 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-59624ee6-901a-4cf1-9791-982d0a48ceee tempest-VolumesDeleteCascade-2044992707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:46 devstack sudo[89662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:59:46 devstack sudo[89662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:46 devstack sudo[89662]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:46 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-59624ee6-901a-4cf1-9791-982d0a48ceee tempest-VolumesDeleteCascade-2044992707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.501s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:46 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-59624ee6-901a-4cf1-9791-982d0a48ceee tempest-VolumesDeleteCascade-2044992707 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:59:46 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-59624ee6-901a-4cf1-9791-982d0a48ceee tempest-VolumesDeleteCascade-2044992707 None] Deleted volume successfully.
Apr 15 15:59:46 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-59624ee6-901a-4cf1-9791-982d0a48ceee tempest-VolumesDeleteCascade-2044992707 None] Lock "cinder-6dbe5946-dac7-46b0-8758-d3fefccfd5da-delete_volume" released by "delete_volume" :: held 6.027s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:59:47 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7adba2b-3ab8-47e7-8a5a-65e7e288be2d tempest-VolumesDeleteCascade-2044992707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:59:47 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d7adba2b-3ab8-47e7-8a5a-65e7e288be2d tempest-VolumesDeleteCascade-2044992707 None] Flow 'volume_create_manager' (6d80bd0e-d8f5-4ab7-a3bd-ee1af7fea32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:59:47 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d7adba2b-3ab8-47e7-8a5a-65e7e288be2d tempest-VolumesDeleteCascade-2044992707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcf72491-26e4-415f-8a3e-767ff4328b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:59:47 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d7adba2b-3ab8-47e7-8a5a-65e7e288be2d tempest-VolumesDeleteCascade-2044992707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcf72491-26e4-415f-8a3e-767ff4328b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:59:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1806810447',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=814abc0a-e6d1-4311-8ab1-cfcc7b7463c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67e3e0dabdc048219cc8341ae456b6dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:59:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:59:48Z,use_quota=True,user_id='fde42d8564444314b033a2f5e30c6cc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:59:47 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d7adba2b-3ab8-47e7-8a5a-65e7e288be2d tempest-VolumesDeleteCascade-2044992707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24423df4-39d7-4542-93f9-12a3152051bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:59:48 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d7adba2b-3ab8-47e7-8a5a-65e7e288be2d tempest-VolumesDeleteCascade-2044992707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24423df4-39d7-4542-93f9-12a3152051bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:59:48 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d7adba2b-3ab8-47e7-8a5a-65e7e288be2d tempest-VolumesDeleteCascade-2044992707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18825ca8-9c3c-4ba2-ae56-d195cf219c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:59:48 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d7adba2b-3ab8-47e7-8a5a-65e7e288be2d tempest-VolumesDeleteCascade-2044992707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18825ca8-9c3c-4ba2-ae56-d195cf219c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '814abc0a-e6d1-4311-8ab1-cfcc7b7463c3', 'volume_name': 'volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:59:48 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d7adba2b-3ab8-47e7-8a5a-65e7e288be2d tempest-VolumesDeleteCascade-2044992707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (356dbc96-1047-4525-9ced-2f3769aa2c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:59:48 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d7adba2b-3ab8-47e7-8a5a-65e7e288be2d tempest-VolumesDeleteCascade-2044992707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (356dbc96-1047-4525-9ced-2f3769aa2c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:59:48 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d7adba2b-3ab8-47e7-8a5a-65e7e288be2d tempest-VolumesDeleteCascade-2044992707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87fa41b2-edb5-418f-97ec-a70ab2d3635e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:59:48 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-d7adba2b-3ab8-47e7-8a5a-65e7e288be2d tempest-VolumesDeleteCascade-2044992707 None] Volume 814abc0a-e6d1-4311-8ab1-cfcc7b7463c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3', 'volume_size': 1}
Apr 15 15:59:48 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-d7adba2b-3ab8-47e7-8a5a-65e7e288be2d tempest-VolumesDeleteCascade-2044992707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:59:48 devstack sudo[89660]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:48 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-07875bc7-513c-4812-b95a-0d9e6037b30a tempest-SnapshotDependencyTests-313489084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6f1e7af1-3121-4725-8a0e-26eb5baad375" returned: 0 in 2.093s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:48 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[d229ed65-fe60-4763-8410-3564537e09dc]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:59:48 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-07875bc7-513c-4812-b95a-0d9e6037b30a tempest-SnapshotDependencyTests-313489084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:48 devstack sudo[89675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501
Apr 15 15:59:48 devstack sudo[89675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:48 devstack sudo[89675]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:48 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-07875bc7-513c-4812-b95a-0d9e6037b30a tempest-SnapshotDependencyTests-313489084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501" returned: 0 in 0.600s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:48 devstack cinder-volume[82485]: DEBUG cinder.image.image_utils [None req-07875bc7-513c-4812-b95a-0d9e6037b30a tempest-SnapshotDependencyTests-313489084 None] Image conversion details: src /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501, size 1024.00 MB, duration 2.09 sec, destination /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6f1e7af1-3121-4725-8a0e-26eb5baad375 {{(pid=82485) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 15:59:48 devstack cinder-volume[82485]: INFO cinder.image.image_utils [None req-07875bc7-513c-4812-b95a-0d9e6037b30a tempest-SnapshotDependencyTests-313489084 None] Converted 1024.00 MB image at 489.11 MB/s
Apr 15 15:59:48 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-07875bc7-513c-4812-b95a-0d9e6037b30a tempest-SnapshotDependencyTests-313489084 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6f1e7af1-3121-4725-8a0e-26eb5baad375 is being set with open permissions: ugo+rw
Apr 15 15:59:48 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-07875bc7-513c-4812-b95a-0d9e6037b30a tempest-SnapshotDependencyTests-313489084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6f1e7af1-3121-4725-8a0e-26eb5baad375 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:48 devstack sudo[89680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6f1e7af1-3121-4725-8a0e-26eb5baad375
Apr 15 15:59:48 devstack sudo[89680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:49 devstack sudo[89680]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:49 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-07875bc7-513c-4812-b95a-0d9e6037b30a tempest-SnapshotDependencyTests-313489084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6f1e7af1-3121-4725-8a0e-26eb5baad375" returned: 0 in 0.433s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:49 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-07875bc7-513c-4812-b95a-0d9e6037b30a tempest-SnapshotDependencyTests-313489084 None] Lock "cinder-quobyte-6f1e7af1-3121-4725-8a0e-26eb5baad375" released by "_copy_volume_from_snapshot" :: held 4.223s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:59:49 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-07875bc7-513c-4812-b95a-0d9e6037b30a tempest-SnapshotDependencyTests-313489084 None] Lock "cinder-quobyte-ad477bbe-95d8-45fe-83c2-4be903505027-6f1e7af1-3121-4725-8a0e-26eb5baad375" released by "_create_volume_from_snapshot" :: held 4.254s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:59:49 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-07875bc7-513c-4812-b95a-0d9e6037b30a tempest-SnapshotDependencyTests-313489084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.266s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:59:49 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-d7adba2b-3ab8-47e7-8a5a-65e7e288be2d tempest-VolumesDeleteCascade-2044992707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.072s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:59:49 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-d7adba2b-3ab8-47e7-8a5a-65e7e288be2d tempest-VolumesDeleteCascade-2044992707 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:59:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1806810447',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=814abc0a-e6d1-4311-8ab1-cfcc7b7463c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67e3e0dabdc048219cc8341ae456b6dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:59:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:59:48Z,use_quota=True,user_id='fde42d8564444314b033a2f5e30c6cc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 15:59:49 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-d7adba2b-3ab8-47e7-8a5a-65e7e288be2d tempest-VolumesDeleteCascade-2044992707 None] Creating volume 814abc0a-e6d1-4311-8ab1-cfcc7b7463c3 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 15:59:49 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-d7adba2b-3ab8-47e7-8a5a-65e7e288be2d tempest-VolumesDeleteCascade-2044992707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:59:49 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-d7adba2b-3ab8-47e7-8a5a-65e7e288be2d tempest-VolumesDeleteCascade-2044992707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:59:49 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-d7adba2b-3ab8-47e7-8a5a-65e7e288be2d tempest-VolumesDeleteCascade-2044992707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:59:49 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-d7adba2b-3ab8-47e7-8a5a-65e7e288be2d tempest-VolumesDeleteCascade-2044992707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:59:49 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-d7adba2b-3ab8-47e7-8a5a-65e7e288be2d tempest-VolumesDeleteCascade-2044992707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:59:49 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-d7adba2b-3ab8-47e7-8a5a-65e7e288be2d tempest-VolumesDeleteCascade-2044992707 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:59:49 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-d7adba2b-3ab8-47e7-8a5a-65e7e288be2d tempest-VolumesDeleteCascade-2044992707 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 15:59:49 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-d7adba2b-3ab8-47e7-8a5a-65e7e288be2d tempest-VolumesDeleteCascade-2044992707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:49 devstack sudo[89683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3 1073741824
Apr 15 15:59:49 devstack sudo[89683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:49 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-07875bc7-513c-4812-b95a-0d9e6037b30a tempest-SnapshotDependencyTests-313489084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afab713f-7313-4179-8832-bc7de9a7e0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f1e7af1-3121-4725-8a0e-26eb5baad375', 'volume_size': 1, 'snapshot_id': 'ad477bbe-95d8-45fe-83c2-4be903505027'}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:59:49 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-07875bc7-513c-4812-b95a-0d9e6037b30a tempest-SnapshotDependencyTests-313489084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97f9da78-81b1-492f-9a9d-850f9a29280a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:59:49 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-07875bc7-513c-4812-b95a-0d9e6037b30a tempest-SnapshotDependencyTests-313489084 None] Volume volume-6f1e7af1-3121-4725-8a0e-26eb5baad375 (6f1e7af1-3121-4725-8a0e-26eb5baad375): created successfully
Apr 15 15:59:49 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-07875bc7-513c-4812-b95a-0d9e6037b30a tempest-SnapshotDependencyTests-313489084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97f9da78-81b1-492f-9a9d-850f9a29280a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:59:49 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-07875bc7-513c-4812-b95a-0d9e6037b30a tempest-SnapshotDependencyTests-313489084 None] Flow 'volume_create_manager' (cd2dd125-b86e-41a3-8467-258bb8448b3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:59:49 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-07875bc7-513c-4812-b95a-0d9e6037b30a tempest-SnapshotDependencyTests-313489084 None] Created volume successfully.
Apr 15 15:59:49 devstack sudo[89683]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:49 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-d7adba2b-3ab8-47e7-8a5a-65e7e288be2d tempest-VolumesDeleteCascade-2044992707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3 1073741824" returned: 0 in 0.531s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:52 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-d7adba2b-3ab8-47e7-8a5a-65e7e288be2d tempest-VolumesDeleteCascade-2044992707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:52 devstack sudo[89688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3
Apr 15 15:59:52 devstack sudo[89688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:53 devstack sudo[89688]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:53 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-d7adba2b-3ab8-47e7-8a5a-65e7e288be2d tempest-VolumesDeleteCascade-2044992707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3" returned: 0 in 0.443s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:53 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-d7adba2b-3ab8-47e7-8a5a-65e7e288be2d tempest-VolumesDeleteCascade-2044992707 None] <== create_volume: return (4085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 15:59:53 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-d7adba2b-3ab8-47e7-8a5a-65e7e288be2d tempest-VolumesDeleteCascade-2044992707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.087s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:59:53 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-4b8bfec4-7743-49ec-b7fb-736d6c932a2f tempest-SnapshotDependencyTests-313489084 None] Acquiring lock "cinder-ad477bbe-95d8-45fe-83c2-4be903505027-delete_snapshot" by "delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:59:53 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-4b8bfec4-7743-49ec-b7fb-736d6c932a2f tempest-SnapshotDependencyTests-313489084 None] Lock "cinder-ad477bbe-95d8-45fe-83c2-4be903505027-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:59:53 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-4b8bfec4-7743-49ec-b7fb-736d6c932a2f tempest-SnapshotDependencyTests-313489084 None] Acquiring lock "cinder-quobyte-6764f8b1-9cd0-47e1-ae00-edab30cb3501" by "delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:59:53 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-4b8bfec4-7743-49ec-b7fb-736d6c932a2f tempest-SnapshotDependencyTests-313489084 None] Lock "cinder-quobyte-6764f8b1-9cd0-47e1-ae00-edab30cb3501" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:59:53 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-4b8bfec4-7743-49ec-b7fb-736d6c932a2f tempest-SnapshotDependencyTests-313489084 None] Acquiring lock "cinder-quobyte-ad477bbe-95d8-45fe-83c2-4be903505027" by "_delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:59:53 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-4b8bfec4-7743-49ec-b7fb-736d6c932a2f tempest-SnapshotDependencyTests-313489084 None] Lock "cinder-quobyte-ad477bbe-95d8-45fe-83c2-4be903505027" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:59:53 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-4b8bfec4-7743-49ec-b7fb-736d6c932a2f tempest-SnapshotDependencyTests-313489084 None] Deleting offline snapshot ad477bbe-95d8-45fe-83c2-4be903505027 of volume 6764f8b1-9cd0-47e1-ae00-edab30cb3501 {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 15:59:53 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-4b8bfec4-7743-49ec-b7fb-736d6c932a2f tempest-SnapshotDependencyTests-313489084 None] snapshot_file for this snap is: volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501.ad477bbe-95d8-45fe-83c2-4be903505027 {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 15:59:53 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de95c20-26f6-43b5-a173-32dfc659c281]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:59:53 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4b8bfec4-7743-49ec-b7fb-736d6c932a2f tempest-SnapshotDependencyTests-313489084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501.ad477bbe-95d8-45fe-83c2-4be903505027 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:54 devstack sudo[89691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501.ad477bbe-95d8-45fe-83c2-4be903505027
Apr 15 15:59:54 devstack sudo[89691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:54 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d7adba2b-3ab8-47e7-8a5a-65e7e288be2d tempest-VolumesDeleteCascade-2044992707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87fa41b2-edb5-418f-97ec-a70ab2d3635e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:59:54 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d7adba2b-3ab8-47e7-8a5a-65e7e288be2d tempest-VolumesDeleteCascade-2044992707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (628ae682-e141-46ff-b533-9e2d8d1623bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:59:54 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-d7adba2b-3ab8-47e7-8a5a-65e7e288be2d tempest-VolumesDeleteCascade-2044992707 None] Volume volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3 (814abc0a-e6d1-4311-8ab1-cfcc7b7463c3): created successfully
Apr 15 15:59:54 devstack sudo[89691]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:54 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d7adba2b-3ab8-47e7-8a5a-65e7e288be2d tempest-VolumesDeleteCascade-2044992707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (628ae682-e141-46ff-b533-9e2d8d1623bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:59:54 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d7adba2b-3ab8-47e7-8a5a-65e7e288be2d tempest-VolumesDeleteCascade-2044992707 None] Flow 'volume_create_manager' (6d80bd0e-d8f5-4ab7-a3bd-ee1af7fea32c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:59:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4b8bfec4-7743-49ec-b7fb-736d6c932a2f tempest-SnapshotDependencyTests-313489084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501.ad477bbe-95d8-45fe-83c2-4be903505027" returned: 0 in 0.496s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:54 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-4b8bfec4-7743-49ec-b7fb-736d6c932a2f tempest-SnapshotDependencyTests-313489084 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82485) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 15:59:54 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-d7adba2b-3ab8-47e7-8a5a-65e7e288be2d tempest-VolumesDeleteCascade-2044992707 None] Created volume successfully.
Apr 15 15:59:54 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3f4693-b5a6-46bd-97b5-31e05f5c7ae5]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:59:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4b8bfec4-7743-49ec-b7fb-736d6c932a2f tempest-SnapshotDependencyTests-313489084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:54 devstack sudo[89696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501
Apr 15 15:59:54 devstack sudo[89696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:54 devstack sudo[89696]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4b8bfec4-7743-49ec-b7fb-736d6c932a2f tempest-SnapshotDependencyTests-313489084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501" returned: 0 in 0.467s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4b8bfec4-7743-49ec-b7fb-736d6c932a2f tempest-SnapshotDependencyTests-313489084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501.ad477bbe-95d8-45fe-83c2-4be903505027 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:54 devstack sudo[89702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501.ad477bbe-95d8-45fe-83c2-4be903505027
Apr 15 15:59:54 devstack sudo[89702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:55 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-81808ad5-729c-4f22-8e56-91c3d70a813b tempest-VolumesDeleteCascade-2044992707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:59:55 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-81808ad5-729c-4f22-8e56-91c3d70a813b tempest-VolumesDeleteCascade-2044992707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:59:55 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-81808ad5-729c-4f22-8e56-91c3d70a813b tempest-VolumesDeleteCascade-2044992707 None] Creating offline snapshot b89fd11d-9397-4467-949c-99fbe2dc2f55 of volume 814abc0a-e6d1-4311-8ab1-cfcc7b7463c3 {{(pid=82485) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 15:59:55 devstack sudo[89702]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:55 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4b8bfec4-7743-49ec-b7fb-736d6c932a2f tempest-SnapshotDependencyTests-313489084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501.ad477bbe-95d8-45fe-83c2-4be903505027" returned: 0 in 0.466s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:55 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4b8bfec4-7743-49ec-b7fb-736d6c932a2f tempest-SnapshotDependencyTests-313489084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501.ad477bbe-95d8-45fe-83c2-4be903505027 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:55 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[abdb2141-782e-48ae-8ca6-f8555d9c18c8]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:59:55 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-81808ad5-729c-4f22-8e56-91c3d70a813b tempest-VolumesDeleteCascade-2044992707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:55 devstack sudo[89708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501.ad477bbe-95d8-45fe-83c2-4be903505027
Apr 15 15:59:55 devstack sudo[89708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:55 devstack sudo[89709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3
Apr 15 15:59:55 devstack sudo[89709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:55 devstack sudo[89708]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:55 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4b8bfec4-7743-49ec-b7fb-736d6c932a2f tempest-SnapshotDependencyTests-313489084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501.ad477bbe-95d8-45fe-83c2-4be903505027" returned: 0 in 0.423s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:55 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-4b8bfec4-7743-49ec-b7fb-736d6c932a2f tempest-SnapshotDependencyTests-313489084 None] Lock "cinder-quobyte-ad477bbe-95d8-45fe-83c2-4be903505027" released by "_delete_snapshot" :: held 1.908s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:59:55 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-4b8bfec4-7743-49ec-b7fb-736d6c932a2f tempest-SnapshotDependencyTests-313489084 None] Lock "cinder-quobyte-6764f8b1-9cd0-47e1-ae00-edab30cb3501" released by "delete_snapshot" :: held 1.920s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:59:55 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-4b8bfec4-7743-49ec-b7fb-736d6c932a2f tempest-SnapshotDependencyTests-313489084 None] Created reservations ['e6ccccf0-e25e-4d28-b0ca-77058b750b33', 'e01ce0ca-1e9e-4627-b231-1b7513a3a405', 'c90317e0-13fd-46c0-b4e3-26a9439222ee', '1a0bf4bf-d8bc-4a35-b3c9-326faabcf8ef'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:59:55 devstack sudo[89709]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:55 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-81808ad5-729c-4f22-8e56-91c3d70a813b tempest-VolumesDeleteCascade-2044992707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3" returned: 0 in 0.492s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:55 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-81808ad5-729c-4f22-8e56-91c3d70a813b tempest-VolumesDeleteCascade-2044992707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3.b89fd11d-9397-4467-949c-99fbe2dc2f55 1G {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:55 devstack sudo[89717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3.b89fd11d-9397-4467-949c-99fbe2dc2f55 1G
Apr 15 15:59:55 devstack sudo[89717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:55 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-4b8bfec4-7743-49ec-b7fb-736d6c932a2f tempest-SnapshotDependencyTests-313489084 None] Delete snapshot completed successfully.
Apr 15 15:59:55 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-4b8bfec4-7743-49ec-b7fb-736d6c932a2f tempest-SnapshotDependencyTests-313489084 None] Lock "cinder-ad477bbe-95d8-45fe-83c2-4be903505027-delete_snapshot" released by "delete_snapshot" :: held 2.021s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:59:56 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-221ad29b-f629-43c9-903b-d417a1572338 tempest-SnapshotDependencyTests-313489084 None] Acquiring lock "cinder-6764f8b1-9cd0-47e1-ae00-edab30cb3501-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:59:56 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-221ad29b-f629-43c9-903b-d417a1572338 tempest-SnapshotDependencyTests-313489084 None] Lock "cinder-6764f8b1-9cd0-47e1-ae00-edab30cb3501-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:59:56 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-221ad29b-f629-43c9-903b-d417a1572338 tempest-SnapshotDependencyTests-313489084 None] Acquiring lock "cinder-quobyte-6764f8b1-9cd0-47e1-ae00-edab30cb3501" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:59:56 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-221ad29b-f629-43c9-903b-d417a1572338 tempest-SnapshotDependencyTests-313489084 None] Lock "cinder-quobyte-6764f8b1-9cd0-47e1-ae00-edab30cb3501" acquired by "delete_volume" :: waited 0.010s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:59:56 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[38333545-6b13-4993-b17c-ed152ced4a70]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:59:56 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-221ad29b-f629-43c9-903b-d417a1572338 tempest-SnapshotDependencyTests-313489084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:56 devstack sudo[89719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501
Apr 15 15:59:56 devstack sudo[89719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:56 devstack sudo[89717]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:56 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-81808ad5-729c-4f22-8e56-91c3d70a813b tempest-VolumesDeleteCascade-2044992707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3.b89fd11d-9397-4467-949c-99fbe2dc2f55 1G" returned: 0 in 0.498s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:56 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-81808ad5-729c-4f22-8e56-91c3d70a813b tempest-VolumesDeleteCascade-2044992707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3.b89fd11d-9397-4467-949c-99fbe2dc2f55 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:56 devstack sudo[89724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3.b89fd11d-9397-4467-949c-99fbe2dc2f55
Apr 15 15:59:56 devstack sudo[89724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:56 devstack sudo[89719]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:56 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-221ad29b-f629-43c9-903b-d417a1572338 tempest-SnapshotDependencyTests-313489084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501" returned: 0 in 0.495s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:56 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-221ad29b-f629-43c9-903b-d417a1572338 tempest-SnapshotDependencyTests-313489084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:56 devstack sudo[89729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501
Apr 15 15:59:56 devstack sudo[89729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:56 devstack sudo[89724]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:56 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-81808ad5-729c-4f22-8e56-91c3d70a813b tempest-VolumesDeleteCascade-2044992707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3.b89fd11d-9397-4467-949c-99fbe2dc2f55" returned: 0 in 0.434s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:56 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-81808ad5-729c-4f22-8e56-91c3d70a813b tempest-VolumesDeleteCascade-2044992707 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3.b89fd11d-9397-4467-949c-99fbe2dc2f55 is being set with open permissions: ugo+rw
Apr 15 15:59:56 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-81808ad5-729c-4f22-8e56-91c3d70a813b tempest-VolumesDeleteCascade-2044992707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3.b89fd11d-9397-4467-949c-99fbe2dc2f55 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:56 devstack sudo[89734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3.b89fd11d-9397-4467-949c-99fbe2dc2f55
Apr 15 15:59:56 devstack sudo[89734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:57 devstack sudo[89729]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-221ad29b-f629-43c9-903b-d417a1572338 tempest-SnapshotDependencyTests-313489084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6764f8b1-9cd0-47e1-ae00-edab30cb3501" returned: 0 in 0.414s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:57 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-221ad29b-f629-43c9-903b-d417a1572338 tempest-SnapshotDependencyTests-313489084 None] Lock "cinder-quobyte-6764f8b1-9cd0-47e1-ae00-edab30cb3501" released by "delete_volume" :: held 0.942s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:59:57 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-221ad29b-f629-43c9-903b-d417a1572338 tempest-SnapshotDependencyTests-313489084 None] Created reservations ['f0f1b3cb-089e-4993-a91d-eab350cd2024', 'fc69a47a-045a-499a-98fd-d7abbd682f32', '21c03503-1f0b-4c9e-92d8-8ae44fdb84ec', '716768fa-389e-439c-9487-cc806fdae67b'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:59:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-221ad29b-f629-43c9-903b-d417a1572338 tempest-SnapshotDependencyTests-313489084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:59:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-221ad29b-f629-43c9-903b-d417a1572338 tempest-SnapshotDependencyTests-313489084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:59:57 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-221ad29b-f629-43c9-903b-d417a1572338 tempest-SnapshotDependencyTests-313489084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:59:57 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-221ad29b-f629-43c9-903b-d417a1572338 tempest-SnapshotDependencyTests-313489084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:59:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-221ad29b-f629-43c9-903b-d417a1572338 tempest-SnapshotDependencyTests-313489084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:59:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-221ad29b-f629-43c9-903b-d417a1572338 tempest-SnapshotDependencyTests-313489084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:57 devstack sudo[89737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:59:57 devstack sudo[89737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:57 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-2e79ad88-1f9e-4364-91b0-b11f35244792 tempest-SnapshotDependencyTests-313489084 None] Acquiring lock "cinder-6f1e7af1-3121-4725-8a0e-26eb5baad375-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:59:57 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-2e79ad88-1f9e-4364-91b0-b11f35244792 tempest-SnapshotDependencyTests-313489084 None] Lock "cinder-6f1e7af1-3121-4725-8a0e-26eb5baad375-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:59:57 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-2e79ad88-1f9e-4364-91b0-b11f35244792 tempest-SnapshotDependencyTests-313489084 None] Acquiring lock "cinder-quobyte-6f1e7af1-3121-4725-8a0e-26eb5baad375" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:59:57 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-2e79ad88-1f9e-4364-91b0-b11f35244792 tempest-SnapshotDependencyTests-313489084 None] Lock "cinder-quobyte-6f1e7af1-3121-4725-8a0e-26eb5baad375" acquired by "delete_volume" :: waited 0.008s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:59:57 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[110bcb3a-a605-40b8-ab07-48fac455fa70]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:59:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-2e79ad88-1f9e-4364-91b0-b11f35244792 tempest-SnapshotDependencyTests-313489084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6f1e7af1-3121-4725-8a0e-26eb5baad375 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:57 devstack sudo[89734]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-81808ad5-729c-4f22-8e56-91c3d70a813b tempest-VolumesDeleteCascade-2044992707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3.b89fd11d-9397-4467-949c-99fbe2dc2f55" returned: 0 in 0.452s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:57 devstack sudo[89740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6f1e7af1-3121-4725-8a0e-26eb5baad375
Apr 15 15:59:57 devstack sudo[89740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-81808ad5-729c-4f22-8e56-91c3d70a813b tempest-VolumesDeleteCascade-2044992707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3.info {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:57 devstack sudo[89742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3.info
Apr 15 15:59:57 devstack sudo[89742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:57 devstack sudo[89737]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-221ad29b-f629-43c9-903b-d417a1572338 tempest-SnapshotDependencyTests-313489084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.499s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:57 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-221ad29b-f629-43c9-903b-d417a1572338 tempest-SnapshotDependencyTests-313489084 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:59:57 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-221ad29b-f629-43c9-903b-d417a1572338 tempest-SnapshotDependencyTests-313489084 None] Deleted volume successfully.
Apr 15 15:59:57 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-221ad29b-f629-43c9-903b-d417a1572338 tempest-SnapshotDependencyTests-313489084 None] Lock "cinder-6764f8b1-9cd0-47e1-ae00-edab30cb3501-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:59:57 devstack sudo[89740]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-2e79ad88-1f9e-4364-91b0-b11f35244792 tempest-SnapshotDependencyTests-313489084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6f1e7af1-3121-4725-8a0e-26eb5baad375" returned: 0 in 0.489s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-2e79ad88-1f9e-4364-91b0-b11f35244792 tempest-SnapshotDependencyTests-313489084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6f1e7af1-3121-4725-8a0e-26eb5baad375 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:57 devstack sudo[89742]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:57 devstack sudo[89749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6f1e7af1-3121-4725-8a0e-26eb5baad375
Apr 15 15:59:57 devstack sudo[89749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-81808ad5-729c-4f22-8e56-91c3d70a813b tempest-VolumesDeleteCascade-2044992707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3.info" returned: 0 in 0.423s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:57 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-81808ad5-729c-4f22-8e56-91c3d70a813b tempest-VolumesDeleteCascade-2044992707 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3.info is being set with open permissions: ugo+rw
Apr 15 15:59:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-81808ad5-729c-4f22-8e56-91c3d70a813b tempest-VolumesDeleteCascade-2044992707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3.info {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:57 devstack sudo[89751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3.info
Apr 15 15:59:57 devstack sudo[89751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:58 devstack sudo[89749]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-2e79ad88-1f9e-4364-91b0-b11f35244792 tempest-SnapshotDependencyTests-313489084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6f1e7af1-3121-4725-8a0e-26eb5baad375" returned: 0 in 0.398s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:58 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-2e79ad88-1f9e-4364-91b0-b11f35244792 tempest-SnapshotDependencyTests-313489084 None] Lock "cinder-quobyte-6f1e7af1-3121-4725-8a0e-26eb5baad375" released by "delete_volume" :: held 0.908s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:59:58 devstack sudo[89751]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-81808ad5-729c-4f22-8e56-91c3d70a813b tempest-VolumesDeleteCascade-2044992707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3.info" returned: 0 in 0.405s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-81808ad5-729c-4f22-8e56-91c3d70a813b tempest-VolumesDeleteCascade-2044992707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.768s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:59:58 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-81808ad5-729c-4f22-8e56-91c3d70a813b tempest-VolumesDeleteCascade-2044992707 None] Create snapshot completed successfully
Apr 15 15:59:58 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-2e79ad88-1f9e-4364-91b0-b11f35244792 tempest-SnapshotDependencyTests-313489084 None] Created reservations ['36fc48ca-e38e-43e7-8d8f-3a55da1d8f4f', 'efe94d7d-2c4c-4d51-ad2e-4cf003f4ccf5', '7a227407-373c-41e8-bb10-7544f1ef632a', '506f8b36-dc6e-485e-a06a-21fafb07c08b'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 15:59:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-2e79ad88-1f9e-4364-91b0-b11f35244792 tempest-SnapshotDependencyTests-313489084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:59:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-2e79ad88-1f9e-4364-91b0-b11f35244792 tempest-SnapshotDependencyTests-313489084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:59:58 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-2e79ad88-1f9e-4364-91b0-b11f35244792 tempest-SnapshotDependencyTests-313489084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:59:58 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-2e79ad88-1f9e-4364-91b0-b11f35244792 tempest-SnapshotDependencyTests-313489084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:59:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-2e79ad88-1f9e-4364-91b0-b11f35244792 tempest-SnapshotDependencyTests-313489084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:59:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-2e79ad88-1f9e-4364-91b0-b11f35244792 tempest-SnapshotDependencyTests-313489084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:58 devstack sudo[89755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 15:59:58 devstack sudo[89755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:58 devstack sudo[89755]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-2e79ad88-1f9e-4364-91b0-b11f35244792 tempest-SnapshotDependencyTests-313489084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.430s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:58 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-2e79ad88-1f9e-4364-91b0-b11f35244792 tempest-SnapshotDependencyTests-313489084 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 15:59:58 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-2e79ad88-1f9e-4364-91b0-b11f35244792 tempest-SnapshotDependencyTests-313489084 None] Deleted volume successfully.
Apr 15 15:59:58 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-2e79ad88-1f9e-4364-91b0-b11f35244792 tempest-SnapshotDependencyTests-313489084 None] Lock "cinder-6f1e7af1-3121-4725-8a0e-26eb5baad375-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 15:59:58 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-7408613f-b7fe-43a2-aa82-4ab718b05f6a tempest-VolumesDeleteCascade-2044992707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 15:59:58 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7408613f-b7fe-43a2-aa82-4ab718b05f6a tempest-VolumesDeleteCascade-2044992707 None] Flow 'volume_create_manager' (3c3a875f-0632-4fa5-97c4-f41fc5de2fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 15:59:58 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7408613f-b7fe-43a2-aa82-4ab718b05f6a tempest-VolumesDeleteCascade-2044992707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10b99930-781d-4ace-9383-54117e74d60b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:59:58 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7408613f-b7fe-43a2-aa82-4ab718b05f6a tempest-VolumesDeleteCascade-2044992707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10b99930-781d-4ace-9383-54117e74d60b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T13:59:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-939796297',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49bf9403-3dda-49b6-899f-874d0ede38ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67e3e0dabdc048219cc8341ae456b6dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T13:59:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b89fd11d-9397-4467-949c-99fbe2dc2f55,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T13:59:59Z,use_quota=True,user_id='fde42d8564444314b033a2f5e30c6cc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:59:58 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7408613f-b7fe-43a2-aa82-4ab718b05f6a tempest-VolumesDeleteCascade-2044992707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (883163f4-664b-471d-adc9-3239224eb301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:59:58 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7408613f-b7fe-43a2-aa82-4ab718b05f6a tempest-VolumesDeleteCascade-2044992707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (883163f4-664b-471d-adc9-3239224eb301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:59:58 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7408613f-b7fe-43a2-aa82-4ab718b05f6a tempest-VolumesDeleteCascade-2044992707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23d5a7d7-1b07-4f63-9e3c-3ceb82fde494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:59:58 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7408613f-b7fe-43a2-aa82-4ab718b05f6a tempest-VolumesDeleteCascade-2044992707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23d5a7d7-1b07-4f63-9e3c-3ceb82fde494) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '49bf9403-3dda-49b6-899f-874d0ede38ba', 'volume_name': 'volume-49bf9403-3dda-49b6-899f-874d0ede38ba', 'volume_size': 1, 'snapshot_id': 'b89fd11d-9397-4467-949c-99fbe2dc2f55'}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:59:58 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7408613f-b7fe-43a2-aa82-4ab718b05f6a tempest-VolumesDeleteCascade-2044992707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89fcc056-0c5c-4ee1-8cd5-05837900af03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:59:58 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7408613f-b7fe-43a2-aa82-4ab718b05f6a tempest-VolumesDeleteCascade-2044992707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89fcc056-0c5c-4ee1-8cd5-05837900af03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 15:59:58 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7408613f-b7fe-43a2-aa82-4ab718b05f6a tempest-VolumesDeleteCascade-2044992707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b5ae62c-e78d-4df2-9963-4373ea14d2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 15:59:58 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-7408613f-b7fe-43a2-aa82-4ab718b05f6a tempest-VolumesDeleteCascade-2044992707 None] Volume 49bf9403-3dda-49b6-899f-874d0ede38ba: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-49bf9403-3dda-49b6-899f-874d0ede38ba', 'volume_size': 1, 'snapshot_id': 'b89fd11d-9397-4467-949c-99fbe2dc2f55'}
Apr 15 15:59:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7408613f-b7fe-43a2-aa82-4ab718b05f6a tempest-VolumesDeleteCascade-2044992707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:59:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7408613f-b7fe-43a2-aa82-4ab718b05f6a tempest-VolumesDeleteCascade-2044992707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:59:58 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-7408613f-b7fe-43a2-aa82-4ab718b05f6a tempest-VolumesDeleteCascade-2044992707 None] Acquiring lock "cinder-quobyte-b89fd11d-9397-4467-949c-99fbe2dc2f55-49bf9403-3dda-49b6-899f-874d0ede38ba" by "_create_volume_from_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:59:58 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-7408613f-b7fe-43a2-aa82-4ab718b05f6a tempest-VolumesDeleteCascade-2044992707 None] Lock "cinder-quobyte-b89fd11d-9397-4467-949c-99fbe2dc2f55-49bf9403-3dda-49b6-899f-874d0ede38ba" acquired by "_create_volume_from_snapshot" :: waited 0.006s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:59:58 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-7408613f-b7fe-43a2-aa82-4ab718b05f6a tempest-VolumesDeleteCascade-2044992707 None] Creating volume 49bf9403-3dda-49b6-899f-874d0ede38ba from snapshot b89fd11d-9397-4467-949c-99fbe2dc2f55 {{(pid=82485) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 15 15:59:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7408613f-b7fe-43a2-aa82-4ab718b05f6a tempest-VolumesDeleteCascade-2044992707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:59:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7408613f-b7fe-43a2-aa82-4ab718b05f6a tempest-VolumesDeleteCascade-2044992707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:59:58 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-7408613f-b7fe-43a2-aa82-4ab718b05f6a tempest-VolumesDeleteCascade-2044992707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:59:58 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-7408613f-b7fe-43a2-aa82-4ab718b05f6a tempest-VolumesDeleteCascade-2044992707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:59:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7408613f-b7fe-43a2-aa82-4ab718b05f6a tempest-VolumesDeleteCascade-2044992707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:59:58 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-7408613f-b7fe-43a2-aa82-4ab718b05f6a tempest-VolumesDeleteCascade-2044992707 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 15:59:58 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-7408613f-b7fe-43a2-aa82-4ab718b05f6a tempest-VolumesDeleteCascade-2044992707 None] Acquiring lock "cinder-quobyte-49bf9403-3dda-49b6-899f-874d0ede38ba" by "_copy_volume_from_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 15:59:58 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-7408613f-b7fe-43a2-aa82-4ab718b05f6a tempest-VolumesDeleteCascade-2044992707 None] Lock "cinder-quobyte-49bf9403-3dda-49b6-899f-874d0ede38ba" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 15:59:58 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-7408613f-b7fe-43a2-aa82-4ab718b05f6a tempest-VolumesDeleteCascade-2044992707 None] snapshot: b89fd11d-9397-4467-949c-99fbe2dc2f55, volume: 49bf9403-3dda-49b6-899f-874d0ede38ba,  {{(pid=82485) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 15 15:59:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7408613f-b7fe-43a2-aa82-4ab718b05f6a tempest-VolumesDeleteCascade-2044992707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 15:59:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7408613f-b7fe-43a2-aa82-4ab718b05f6a tempest-VolumesDeleteCascade-2044992707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 15:59:58 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-7408613f-b7fe-43a2-aa82-4ab718b05f6a tempest-VolumesDeleteCascade-2044992707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 15:59:58 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-7408613f-b7fe-43a2-aa82-4ab718b05f6a tempest-VolumesDeleteCascade-2044992707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 15:59:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7408613f-b7fe-43a2-aa82-4ab718b05f6a tempest-VolumesDeleteCascade-2044992707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 15:59:58 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[846f5ab7-6dfd-4a95-bc79-50ca0b77f9cd]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:59:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7408613f-b7fe-43a2-aa82-4ab718b05f6a tempest-VolumesDeleteCascade-2044992707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3.b89fd11d-9397-4467-949c-99fbe2dc2f55 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:59 devstack sudo[89758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3.b89fd11d-9397-4467-949c-99fbe2dc2f55
Apr 15 15:59:59 devstack sudo[89758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 15:59:59 devstack sudo[89758]: pam_unix(sudo:session): session closed for user root
Apr 15 15:59:59 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7408613f-b7fe-43a2-aa82-4ab718b05f6a tempest-VolumesDeleteCascade-2044992707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3.b89fd11d-9397-4467-949c-99fbe2dc2f55" returned: 0 in 0.516s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 15:59:59 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-7408613f-b7fe-43a2-aa82-4ab718b05f6a tempest-VolumesDeleteCascade-2044992707 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82485) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 15:59:59 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-7408613f-b7fe-43a2-aa82-4ab718b05f6a tempest-VolumesDeleteCascade-2044992707 None] will copy from snapshot at /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3 {{(pid=82485) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 15 15:59:59 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-7408613f-b7fe-43a2-aa82-4ab718b05f6a tempest-VolumesDeleteCascade-2044992707 None] Creating direct copy from snapshot {{(pid=82485) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 15 15:59:59 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[6519399b-dc97-4894-8b13-68a8eb49bb63]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 15:59:59 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7408613f-b7fe-43a2-aa82-4ab718b05f6a tempest-VolumesDeleteCascade-2044992707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 15:59:59 devstack sudo[89764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3
Apr 15 15:59:59 devstack sudo[89764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:00 devstack sudo[89764]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7408613f-b7fe-43a2-aa82-4ab718b05f6a tempest-VolumesDeleteCascade-2044992707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3" returned: 0 in 0.553s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:00 devstack cinder-volume[82485]: DEBUG cinder.utils [None req-7408613f-b7fe-43a2-aa82-4ab718b05f6a tempest-VolumesDeleteCascade-2044992707 None] Path /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-49bf9403-3dda-49b6-899f-874d0ede38ba not found in is_blk_device check {{(pid=82485) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 15 16:00:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7408613f-b7fe-43a2-aa82-4ab718b05f6a tempest-VolumesDeleteCascade-2044992707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-49bf9403-3dda-49b6-899f-874d0ede38ba {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:00 devstack sudo[89769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-49bf9403-3dda-49b6-899f-874d0ede38ba
Apr 15 16:00:00 devstack sudo[89769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:02 devstack sudo[89769]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:02 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7408613f-b7fe-43a2-aa82-4ab718b05f6a tempest-VolumesDeleteCascade-2044992707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-49bf9403-3dda-49b6-899f-874d0ede38ba" returned: 0 in 2.035s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:02 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e46e22a-eca3-4778-b162-dbcf5b1f8c84]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:00:02 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7408613f-b7fe-43a2-aa82-4ab718b05f6a tempest-VolumesDeleteCascade-2044992707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:02 devstack sudo[89782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3
Apr 15 16:00:02 devstack sudo[89782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:02 devstack sudo[89782]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:02 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7408613f-b7fe-43a2-aa82-4ab718b05f6a tempest-VolumesDeleteCascade-2044992707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3" returned: 0 in 0.638s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:02 devstack cinder-volume[82485]: DEBUG cinder.image.image_utils [None req-7408613f-b7fe-43a2-aa82-4ab718b05f6a tempest-VolumesDeleteCascade-2044992707 None] Image conversion details: src /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3, size 1024.00 MB, duration 2.04 sec, destination /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-49bf9403-3dda-49b6-899f-874d0ede38ba {{(pid=82485) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 16:00:02 devstack cinder-volume[82485]: INFO cinder.image.image_utils [None req-7408613f-b7fe-43a2-aa82-4ab718b05f6a tempest-VolumesDeleteCascade-2044992707 None] Converted 1024.00 MB image at 502.82 MB/s
Apr 15 16:00:02 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-7408613f-b7fe-43a2-aa82-4ab718b05f6a tempest-VolumesDeleteCascade-2044992707 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-49bf9403-3dda-49b6-899f-874d0ede38ba is being set with open permissions: ugo+rw
Apr 15 16:00:02 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7408613f-b7fe-43a2-aa82-4ab718b05f6a tempest-VolumesDeleteCascade-2044992707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-49bf9403-3dda-49b6-899f-874d0ede38ba {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:02 devstack sudo[89787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-49bf9403-3dda-49b6-899f-874d0ede38ba
Apr 15 16:00:02 devstack sudo[89787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:03 devstack sudo[89787]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:03 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7408613f-b7fe-43a2-aa82-4ab718b05f6a tempest-VolumesDeleteCascade-2044992707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-49bf9403-3dda-49b6-899f-874d0ede38ba" returned: 0 in 0.446s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:03 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-7408613f-b7fe-43a2-aa82-4ab718b05f6a tempest-VolumesDeleteCascade-2044992707 None] Lock "cinder-quobyte-49bf9403-3dda-49b6-899f-874d0ede38ba" released by "_copy_volume_from_snapshot" :: held 4.247s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:00:03 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-7408613f-b7fe-43a2-aa82-4ab718b05f6a tempest-VolumesDeleteCascade-2044992707 None] Lock "cinder-quobyte-b89fd11d-9397-4467-949c-99fbe2dc2f55-49bf9403-3dda-49b6-899f-874d0ede38ba" released by "_create_volume_from_snapshot" :: held 4.282s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:00:03 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7408613f-b7fe-43a2-aa82-4ab718b05f6a tempest-VolumesDeleteCascade-2044992707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.289s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:00:03 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7408613f-b7fe-43a2-aa82-4ab718b05f6a tempest-VolumesDeleteCascade-2044992707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b5ae62c-e78d-4df2-9963-4373ea14d2c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49bf9403-3dda-49b6-899f-874d0ede38ba', 'volume_size': 1, 'snapshot_id': 'b89fd11d-9397-4467-949c-99fbe2dc2f55'}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:03 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7408613f-b7fe-43a2-aa82-4ab718b05f6a tempest-VolumesDeleteCascade-2044992707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d8baf82-9db2-4cee-97e2-67f478f14b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:03 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-7408613f-b7fe-43a2-aa82-4ab718b05f6a tempest-VolumesDeleteCascade-2044992707 None] Volume volume-49bf9403-3dda-49b6-899f-874d0ede38ba (49bf9403-3dda-49b6-899f-874d0ede38ba): created successfully
Apr 15 16:00:03 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7408613f-b7fe-43a2-aa82-4ab718b05f6a tempest-VolumesDeleteCascade-2044992707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d8baf82-9db2-4cee-97e2-67f478f14b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:03 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7408613f-b7fe-43a2-aa82-4ab718b05f6a tempest-VolumesDeleteCascade-2044992707 None] Flow 'volume_create_manager' (3c3a875f-0632-4fa5-97c4-f41fc5de2fc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:00:03 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-7408613f-b7fe-43a2-aa82-4ab718b05f6a tempest-VolumesDeleteCascade-2044992707 None] Created volume successfully.
Apr 15 16:00:04 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-88787256-05a9-4f14-b499-b6c0c59e1c1b tempest-VolumesDeleteCascade-2044992707 None] Acquiring lock "cinder-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:00:04 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-88787256-05a9-4f14-b499-b6c0c59e1c1b tempest-VolumesDeleteCascade-2044992707 None] Lock "cinder-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:00:04 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-88787256-05a9-4f14-b499-b6c0c59e1c1b tempest-VolumesDeleteCascade-2044992707 None] Performing cascade delete. {{(pid=82485) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 15 16:00:04 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-88787256-05a9-4f14-b499-b6c0c59e1c1b tempest-VolumesDeleteCascade-2044992707 None] Acquiring lock "cinder-b89fd11d-9397-4467-949c-99fbe2dc2f55-delete_snapshot" by "delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:00:04 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-88787256-05a9-4f14-b499-b6c0c59e1c1b tempest-VolumesDeleteCascade-2044992707 None] Lock "cinder-b89fd11d-9397-4467-949c-99fbe2dc2f55-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:00:04 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-88787256-05a9-4f14-b499-b6c0c59e1c1b tempest-VolumesDeleteCascade-2044992707 None] Acquiring lock "cinder-quobyte-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3" by "delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:00:04 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-88787256-05a9-4f14-b499-b6c0c59e1c1b tempest-VolumesDeleteCascade-2044992707 None] Lock "cinder-quobyte-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:00:04 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-88787256-05a9-4f14-b499-b6c0c59e1c1b tempest-VolumesDeleteCascade-2044992707 None] Acquiring lock "cinder-quobyte-b89fd11d-9397-4467-949c-99fbe2dc2f55" by "_delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:00:04 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-88787256-05a9-4f14-b499-b6c0c59e1c1b tempest-VolumesDeleteCascade-2044992707 None] Lock "cinder-quobyte-b89fd11d-9397-4467-949c-99fbe2dc2f55" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:00:04 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-88787256-05a9-4f14-b499-b6c0c59e1c1b tempest-VolumesDeleteCascade-2044992707 None] Deleting offline snapshot b89fd11d-9397-4467-949c-99fbe2dc2f55 of volume 814abc0a-e6d1-4311-8ab1-cfcc7b7463c3 {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 16:00:04 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-88787256-05a9-4f14-b499-b6c0c59e1c1b tempest-VolumesDeleteCascade-2044992707 None] snapshot_file for this snap is: volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3.b89fd11d-9397-4467-949c-99fbe2dc2f55 {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 16:00:04 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e9394a-1786-4a75-bed9-a7549ad84950]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:00:04 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-88787256-05a9-4f14-b499-b6c0c59e1c1b tempest-VolumesDeleteCascade-2044992707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3.b89fd11d-9397-4467-949c-99fbe2dc2f55 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:04 devstack sudo[89792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3.b89fd11d-9397-4467-949c-99fbe2dc2f55
Apr 15 16:00:04 devstack sudo[89792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:04 devstack sudo[89792]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:04 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-88787256-05a9-4f14-b499-b6c0c59e1c1b tempest-VolumesDeleteCascade-2044992707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3.b89fd11d-9397-4467-949c-99fbe2dc2f55" returned: 0 in 0.540s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:04 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-88787256-05a9-4f14-b499-b6c0c59e1c1b tempest-VolumesDeleteCascade-2044992707 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82485) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:00:04 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0b2f73-f664-4ee6-bc66-5691e12cb691]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:00:04 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-88787256-05a9-4f14-b499-b6c0c59e1c1b tempest-VolumesDeleteCascade-2044992707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:04 devstack sudo[89798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3
Apr 15 16:00:04 devstack sudo[89798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:05 devstack sudo[89798]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:05 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-88787256-05a9-4f14-b499-b6c0c59e1c1b tempest-VolumesDeleteCascade-2044992707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3" returned: 0 in 0.557s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:05 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-88787256-05a9-4f14-b499-b6c0c59e1c1b tempest-VolumesDeleteCascade-2044992707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3.b89fd11d-9397-4467-949c-99fbe2dc2f55 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:05 devstack sudo[89803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3.b89fd11d-9397-4467-949c-99fbe2dc2f55
Apr 15 16:00:05 devstack sudo[89803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:05 devstack sudo[89803]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:05 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-88787256-05a9-4f14-b499-b6c0c59e1c1b tempest-VolumesDeleteCascade-2044992707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3.b89fd11d-9397-4467-949c-99fbe2dc2f55" returned: 0 in 0.454s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:05 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-88787256-05a9-4f14-b499-b6c0c59e1c1b tempest-VolumesDeleteCascade-2044992707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3.b89fd11d-9397-4467-949c-99fbe2dc2f55 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:05 devstack sudo[89808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3.b89fd11d-9397-4467-949c-99fbe2dc2f55
Apr 15 16:00:05 devstack sudo[89808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:06 devstack sudo[89808]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:06 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-88787256-05a9-4f14-b499-b6c0c59e1c1b tempest-VolumesDeleteCascade-2044992707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3.b89fd11d-9397-4467-949c-99fbe2dc2f55" returned: 0 in 0.425s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:06 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-88787256-05a9-4f14-b499-b6c0c59e1c1b tempest-VolumesDeleteCascade-2044992707 None] Lock "cinder-quobyte-b89fd11d-9397-4467-949c-99fbe2dc2f55" released by "_delete_snapshot" :: held 2.025s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:00:06 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-88787256-05a9-4f14-b499-b6c0c59e1c1b tempest-VolumesDeleteCascade-2044992707 None] Lock "cinder-quobyte-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3" released by "delete_snapshot" :: held 2.039s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:00:06 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-88787256-05a9-4f14-b499-b6c0c59e1c1b tempest-VolumesDeleteCascade-2044992707 None] Created reservations ['8e0d5511-fc6f-43d1-a69e-e6fe68573326', '99407c7c-d5b1-4e5f-9858-efb3dcabaf4f', '807f79a5-bb8d-4ba1-a03c-3693a297c88f', '011af0f4-e0cd-4937-b7a3-b0d7edb2b95b'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:00:06 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-88787256-05a9-4f14-b499-b6c0c59e1c1b tempest-VolumesDeleteCascade-2044992707 None] Delete snapshot completed successfully.
Apr 15 16:00:06 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-88787256-05a9-4f14-b499-b6c0c59e1c1b tempest-VolumesDeleteCascade-2044992707 None] Lock "cinder-b89fd11d-9397-4467-949c-99fbe2dc2f55-delete_snapshot" released by "delete_snapshot" :: held 2.146s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:00:06 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-88787256-05a9-4f14-b499-b6c0c59e1c1b tempest-VolumesDeleteCascade-2044992707 None] Snapshots deleted, issuing volume delete {{(pid=82485) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 15 16:00:06 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-88787256-05a9-4f14-b499-b6c0c59e1c1b tempest-VolumesDeleteCascade-2044992707 None] Acquiring lock "cinder-quobyte-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:00:06 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-88787256-05a9-4f14-b499-b6c0c59e1c1b tempest-VolumesDeleteCascade-2044992707 None] Lock "cinder-quobyte-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3" acquired by "delete_volume" :: waited 0.009s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:00:06 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[af71da43-0b4a-4681-9a2b-c20dc92d4b92]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:00:06 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-88787256-05a9-4f14-b499-b6c0c59e1c1b tempest-VolumesDeleteCascade-2044992707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:06 devstack sudo[89811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3
Apr 15 16:00:06 devstack sudo[89811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:06 devstack sudo[89811]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:06 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-88787256-05a9-4f14-b499-b6c0c59e1c1b tempest-VolumesDeleteCascade-2044992707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3" returned: 0 in 0.479s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:06 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-88787256-05a9-4f14-b499-b6c0c59e1c1b tempest-VolumesDeleteCascade-2044992707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:06 devstack sudo[89816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3
Apr 15 16:00:06 devstack sudo[89816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:07 devstack sudo[89816]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:07 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-88787256-05a9-4f14-b499-b6c0c59e1c1b tempest-VolumesDeleteCascade-2044992707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3" returned: 0 in 0.426s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:07 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-88787256-05a9-4f14-b499-b6c0c59e1c1b tempest-VolumesDeleteCascade-2044992707 None] Lock "cinder-quobyte-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3" released by "delete_volume" :: held 0.941s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:00:07 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-88787256-05a9-4f14-b499-b6c0c59e1c1b tempest-VolumesDeleteCascade-2044992707 None] Created reservations ['cd153989-8e5c-413f-a495-f5de6803152a', 'bb839bbc-7362-4d4b-907a-8e668d17c05b', 'ddb05990-f4e0-4b98-b047-156b8fd952b2', '56b5287d-3eaa-470c-a72e-eb4118e532f3'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:00:07 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-88787256-05a9-4f14-b499-b6c0c59e1c1b tempest-VolumesDeleteCascade-2044992707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:00:07 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-88787256-05a9-4f14-b499-b6c0c59e1c1b tempest-VolumesDeleteCascade-2044992707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:00:07 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-88787256-05a9-4f14-b499-b6c0c59e1c1b tempest-VolumesDeleteCascade-2044992707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:00:07 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-88787256-05a9-4f14-b499-b6c0c59e1c1b tempest-VolumesDeleteCascade-2044992707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:00:07 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-88787256-05a9-4f14-b499-b6c0c59e1c1b tempest-VolumesDeleteCascade-2044992707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:00:07 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-88787256-05a9-4f14-b499-b6c0c59e1c1b tempest-VolumesDeleteCascade-2044992707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:07 devstack sudo[89819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 16:00:07 devstack sudo[89819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:07 devstack sudo[89819]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:07 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-88787256-05a9-4f14-b499-b6c0c59e1c1b tempest-VolumesDeleteCascade-2044992707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.433s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:07 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-88787256-05a9-4f14-b499-b6c0c59e1c1b tempest-VolumesDeleteCascade-2044992707 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:00:07 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-88787256-05a9-4f14-b499-b6c0c59e1c1b tempest-VolumesDeleteCascade-2044992707 None] Deleted volume successfully.
Apr 15 16:00:07 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-88787256-05a9-4f14-b499-b6c0c59e1c1b tempest-VolumesDeleteCascade-2044992707 None] Lock "cinder-814abc0a-e6d1-4311-8ab1-cfcc7b7463c3-delete_volume" released by "delete_volume" :: held 3.705s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:00:08 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-a5815a0f-31cd-47aa-a9a0-f7805a6ef646 tempest-VolumesDeleteCascade-2044992707 None] Acquiring lock "cinder-49bf9403-3dda-49b6-899f-874d0ede38ba-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:00:08 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-a5815a0f-31cd-47aa-a9a0-f7805a6ef646 tempest-VolumesDeleteCascade-2044992707 None] Lock "cinder-49bf9403-3dda-49b6-899f-874d0ede38ba-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:00:08 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-a5815a0f-31cd-47aa-a9a0-f7805a6ef646 tempest-VolumesDeleteCascade-2044992707 None] Acquiring lock "cinder-quobyte-49bf9403-3dda-49b6-899f-874d0ede38ba" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:00:08 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-a5815a0f-31cd-47aa-a9a0-f7805a6ef646 tempest-VolumesDeleteCascade-2044992707 None] Lock "cinder-quobyte-49bf9403-3dda-49b6-899f-874d0ede38ba" acquired by "delete_volume" :: waited 0.007s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:00:08 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[548dfbcd-6af7-4d8f-9a17-6266fe2c54c2]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:00:08 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-a5815a0f-31cd-47aa-a9a0-f7805a6ef646 tempest-VolumesDeleteCascade-2044992707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-49bf9403-3dda-49b6-899f-874d0ede38ba {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:08 devstack sudo[89822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-49bf9403-3dda-49b6-899f-874d0ede38ba
Apr 15 16:00:08 devstack sudo[89822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:09 devstack sudo[89822]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:09 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-a5815a0f-31cd-47aa-a9a0-f7805a6ef646 tempest-VolumesDeleteCascade-2044992707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-49bf9403-3dda-49b6-899f-874d0ede38ba" returned: 0 in 0.469s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:09 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-a5815a0f-31cd-47aa-a9a0-f7805a6ef646 tempest-VolumesDeleteCascade-2044992707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-49bf9403-3dda-49b6-899f-874d0ede38ba {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:09 devstack sudo[89827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-49bf9403-3dda-49b6-899f-874d0ede38ba
Apr 15 16:00:09 devstack sudo[89827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:09 devstack sudo[89827]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:09 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-a5815a0f-31cd-47aa-a9a0-f7805a6ef646 tempest-VolumesDeleteCascade-2044992707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-49bf9403-3dda-49b6-899f-874d0ede38ba" returned: 0 in 0.421s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:09 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-a5815a0f-31cd-47aa-a9a0-f7805a6ef646 tempest-VolumesDeleteCascade-2044992707 None] Lock "cinder-quobyte-49bf9403-3dda-49b6-899f-874d0ede38ba" released by "delete_volume" :: held 0.919s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:00:09 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-a5815a0f-31cd-47aa-a9a0-f7805a6ef646 tempest-VolumesDeleteCascade-2044992707 None] Created reservations ['28d07442-ab82-4bfe-91a3-3c1bd56cc5fc', '082c71aa-a7bc-440d-a32f-9d4e0e197b70', '48ed36c7-8dff-4c97-84b9-b5e62ff341b7', '8bcd79db-8cc5-4938-b3df-36c11a30022a'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:00:09 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-a5815a0f-31cd-47aa-a9a0-f7805a6ef646 tempest-VolumesDeleteCascade-2044992707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:00:09 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-a5815a0f-31cd-47aa-a9a0-f7805a6ef646 tempest-VolumesDeleteCascade-2044992707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:00:09 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-a5815a0f-31cd-47aa-a9a0-f7805a6ef646 tempest-VolumesDeleteCascade-2044992707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:00:09 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-a5815a0f-31cd-47aa-a9a0-f7805a6ef646 tempest-VolumesDeleteCascade-2044992707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:00:09 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-a5815a0f-31cd-47aa-a9a0-f7805a6ef646 tempest-VolumesDeleteCascade-2044992707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:00:09 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-a5815a0f-31cd-47aa-a9a0-f7805a6ef646 tempest-VolumesDeleteCascade-2044992707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:09 devstack sudo[89830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 16:00:09 devstack sudo[89830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:10 devstack sudo[89830]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-a5815a0f-31cd-47aa-a9a0-f7805a6ef646 tempest-VolumesDeleteCascade-2044992707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.434s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:10 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-a5815a0f-31cd-47aa-a9a0-f7805a6ef646 tempest-VolumesDeleteCascade-2044992707 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:00:10 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-a5815a0f-31cd-47aa-a9a0-f7805a6ef646 tempest-VolumesDeleteCascade-2044992707 None] Deleted volume successfully.
Apr 15 16:00:10 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-a5815a0f-31cd-47aa-a9a0-f7805a6ef646 tempest-VolumesDeleteCascade-2044992707 None] Lock "cinder-49bf9403-3dda-49b6-899f-874d0ede38ba-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:00:11 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-eef05f11-7d97-4ce8-9427-45ae68616bef tempest-VolumesGetTest-1217066466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:00:11 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-eef05f11-7d97-4ce8-9427-45ae68616bef tempest-VolumesGetTest-1217066466 None] Flow 'volume_create_manager' (7f467d8c-cda6-40cc-9bcc-a6661f5e45b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:00:11 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-eef05f11-7d97-4ce8-9427-45ae68616bef tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df822146-f0b3-43ac-b07f-222c9ddaf1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:11 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-eef05f11-7d97-4ce8-9427-45ae68616bef tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df822146-f0b3-43ac-b07f-222c9ddaf1fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:00:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-386132935',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a02c9948-1d03-46a8-8caf-d81b68e7a2ef,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a7fb9f4edec34dd2b9586b03209ea693',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:00:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:00:11Z,use_quota=True,user_id='e7edf2cd1a3147a89d74ea17b48d54c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:11 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-eef05f11-7d97-4ce8-9427-45ae68616bef tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4973aed-0eb3-4cee-862f-98b257d161ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:11 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-eef05f11-7d97-4ce8-9427-45ae68616bef tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4973aed-0eb3-4cee-862f-98b257d161ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:11 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-eef05f11-7d97-4ce8-9427-45ae68616bef tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33f71837-b241-4cde-be51-7c732354bb98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:11 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-eef05f11-7d97-4ce8-9427-45ae68616bef tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33f71837-b241-4cde-be51-7c732354bb98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a02c9948-1d03-46a8-8caf-d81b68e7a2ef', 'volume_name': 'volume-a02c9948-1d03-46a8-8caf-d81b68e7a2ef', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:11 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-eef05f11-7d97-4ce8-9427-45ae68616bef tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69161e3f-acd7-454d-8aa7-7d7427647dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:11 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-eef05f11-7d97-4ce8-9427-45ae68616bef tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69161e3f-acd7-454d-8aa7-7d7427647dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:11 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-eef05f11-7d97-4ce8-9427-45ae68616bef tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c9d5fe2-6812-4a10-8d9c-b452973eee0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:11 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-eef05f11-7d97-4ce8-9427-45ae68616bef tempest-VolumesGetTest-1217066466 None] Volume a02c9948-1d03-46a8-8caf-d81b68e7a2ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a02c9948-1d03-46a8-8caf-d81b68e7a2ef', 'volume_size': 1}
Apr 15 16:00:11 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-eef05f11-7d97-4ce8-9427-45ae68616bef tempest-VolumesGetTest-1217066466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:00:11 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-eef05f11-7d97-4ce8-9427-45ae68616bef tempest-VolumesGetTest-1217066466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:00:11 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-eef05f11-7d97-4ce8-9427-45ae68616bef tempest-VolumesGetTest-1217066466 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:00:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-386132935',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a02c9948-1d03-46a8-8caf-d81b68e7a2ef,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a7fb9f4edec34dd2b9586b03209ea693',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:00:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:00:11Z,use_quota=True,user_id='e7edf2cd1a3147a89d74ea17b48d54c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:00:11 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-eef05f11-7d97-4ce8-9427-45ae68616bef tempest-VolumesGetTest-1217066466 None] Creating volume a02c9948-1d03-46a8-8caf-d81b68e7a2ef {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:00:11 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-eef05f11-7d97-4ce8-9427-45ae68616bef tempest-VolumesGetTest-1217066466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:00:11 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-eef05f11-7d97-4ce8-9427-45ae68616bef tempest-VolumesGetTest-1217066466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:00:11 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-eef05f11-7d97-4ce8-9427-45ae68616bef tempest-VolumesGetTest-1217066466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:00:11 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-eef05f11-7d97-4ce8-9427-45ae68616bef tempest-VolumesGetTest-1217066466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:00:11 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-eef05f11-7d97-4ce8-9427-45ae68616bef tempest-VolumesGetTest-1217066466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:00:11 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-eef05f11-7d97-4ce8-9427-45ae68616bef tempest-VolumesGetTest-1217066466 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:00:11 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-eef05f11-7d97-4ce8-9427-45ae68616bef tempest-VolumesGetTest-1217066466 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 16:00:11 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-eef05f11-7d97-4ce8-9427-45ae68616bef tempest-VolumesGetTest-1217066466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a02c9948-1d03-46a8-8caf-d81b68e7a2ef 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:11 devstack sudo[89833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a02c9948-1d03-46a8-8caf-d81b68e7a2ef 1073741824
Apr 15 16:00:11 devstack sudo[89833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:11 devstack sudo[89833]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-eef05f11-7d97-4ce8-9427-45ae68616bef tempest-VolumesGetTest-1217066466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a02c9948-1d03-46a8-8caf-d81b68e7a2ef 1073741824" returned: 0 in 0.467s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-eef05f11-7d97-4ce8-9427-45ae68616bef tempest-VolumesGetTest-1217066466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a02c9948-1d03-46a8-8caf-d81b68e7a2ef {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:12 devstack sudo[89838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a02c9948-1d03-46a8-8caf-d81b68e7a2ef
Apr 15 16:00:12 devstack sudo[89838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:12 devstack sudo[89838]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-eef05f11-7d97-4ce8-9427-45ae68616bef tempest-VolumesGetTest-1217066466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a02c9948-1d03-46a8-8caf-d81b68e7a2ef" returned: 0 in 0.402s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:12 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-eef05f11-7d97-4ce8-9427-45ae68616bef tempest-VolumesGetTest-1217066466 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:00:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-eef05f11-7d97-4ce8-9427-45ae68616bef tempest-VolumesGetTest-1217066466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:00:12 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-eef05f11-7d97-4ce8-9427-45ae68616bef tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c9d5fe2-6812-4a10-8d9c-b452973eee0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a02c9948-1d03-46a8-8caf-d81b68e7a2ef', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:12 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-eef05f11-7d97-4ce8-9427-45ae68616bef tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64d47004-d74c-4138-bd2b-85bd5c7b0fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:12 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-eef05f11-7d97-4ce8-9427-45ae68616bef tempest-VolumesGetTest-1217066466 None] Volume volume-a02c9948-1d03-46a8-8caf-d81b68e7a2ef (a02c9948-1d03-46a8-8caf-d81b68e7a2ef): created successfully
Apr 15 16:00:12 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-eef05f11-7d97-4ce8-9427-45ae68616bef tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64d47004-d74c-4138-bd2b-85bd5c7b0fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:12 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-eef05f11-7d97-4ce8-9427-45ae68616bef tempest-VolumesGetTest-1217066466 None] Flow 'volume_create_manager' (7f467d8c-cda6-40cc-9bcc-a6661f5e45b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:00:12 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-eef05f11-7d97-4ce8-9427-45ae68616bef tempest-VolumesGetTest-1217066466 None] Created volume successfully.
Apr 15 16:00:13 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d33f5b7-562c-470b-b5dc-3731c13fae0d tempest-VolumesGetTest-1217066466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:00:13 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-4d33f5b7-562c-470b-b5dc-3731c13fae0d tempest-VolumesGetTest-1217066466 None] Flow 'volume_create_manager' (7b8bb988-3a8b-432f-9f91-74fc5f4b3c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:00:13 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-4d33f5b7-562c-470b-b5dc-3731c13fae0d tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa67823d-d87c-4563-8fe5-b2b3f1b7dc19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:13 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-4d33f5b7-562c-470b-b5dc-3731c13fae0d tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa67823d-d87c-4563-8fe5-b2b3f1b7dc19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:00:14Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1898734382',display_name='tempest-VolumesGetTest-Volume-1434085091',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2513d4d-dd2c-4a1c-9b70-746d4f8092b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7fb9f4edec34dd2b9586b03209ea693',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:00:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:00:14Z,use_quota=True,user_id='e7edf2cd1a3147a89d74ea17b48d54c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:13 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-4d33f5b7-562c-470b-b5dc-3731c13fae0d tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2634bdad-bd7f-4660-8796-a8d9956eb32b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:13 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-4d33f5b7-562c-470b-b5dc-3731c13fae0d tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2634bdad-bd7f-4660-8796-a8d9956eb32b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:13 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-4d33f5b7-562c-470b-b5dc-3731c13fae0d tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb9689f8-8f85-4d3e-9b11-0fbf7ba3c884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:14 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-4d33f5b7-562c-470b-b5dc-3731c13fae0d tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb9689f8-8f85-4d3e-9b11-0fbf7ba3c884) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2513d4d-dd2c-4a1c-9b70-746d4f8092b3', 'volume_name': 'volume-c2513d4d-dd2c-4a1c-9b70-746d4f8092b3', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:14 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-4d33f5b7-562c-470b-b5dc-3731c13fae0d tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (300ebf34-a0de-48ed-a4df-3f1038513937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:14 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-4d33f5b7-562c-470b-b5dc-3731c13fae0d tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (300ebf34-a0de-48ed-a4df-3f1038513937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:14 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-4d33f5b7-562c-470b-b5dc-3731c13fae0d tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd3450d6-d64e-4477-b9eb-4437e6a837b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:14 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-4d33f5b7-562c-470b-b5dc-3731c13fae0d tempest-VolumesGetTest-1217066466 None] Volume c2513d4d-dd2c-4a1c-9b70-746d4f8092b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2513d4d-dd2c-4a1c-9b70-746d4f8092b3', 'volume_size': 1}
Apr 15 16:00:14 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-4d33f5b7-562c-470b-b5dc-3731c13fae0d tempest-VolumesGetTest-1217066466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:00:14 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-4d33f5b7-562c-470b-b5dc-3731c13fae0d tempest-VolumesGetTest-1217066466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:00:14 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-4d33f5b7-562c-470b-b5dc-3731c13fae0d tempest-VolumesGetTest-1217066466 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:00:14Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1898734382',display_name='tempest-VolumesGetTest-Volume-1434085091',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2513d4d-dd2c-4a1c-9b70-746d4f8092b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7fb9f4edec34dd2b9586b03209ea693',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:00:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:00:14Z,use_quota=True,user_id='e7edf2cd1a3147a89d74ea17b48d54c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:00:14 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-4d33f5b7-562c-470b-b5dc-3731c13fae0d tempest-VolumesGetTest-1217066466 None] Creating volume c2513d4d-dd2c-4a1c-9b70-746d4f8092b3 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:00:14 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-4d33f5b7-562c-470b-b5dc-3731c13fae0d tempest-VolumesGetTest-1217066466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:00:14 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-4d33f5b7-562c-470b-b5dc-3731c13fae0d tempest-VolumesGetTest-1217066466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:00:14 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-4d33f5b7-562c-470b-b5dc-3731c13fae0d tempest-VolumesGetTest-1217066466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:00:14 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-4d33f5b7-562c-470b-b5dc-3731c13fae0d tempest-VolumesGetTest-1217066466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:00:14 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-4d33f5b7-562c-470b-b5dc-3731c13fae0d tempest-VolumesGetTest-1217066466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:00:14 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-4d33f5b7-562c-470b-b5dc-3731c13fae0d tempest-VolumesGetTest-1217066466 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:00:14 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-4d33f5b7-562c-470b-b5dc-3731c13fae0d tempest-VolumesGetTest-1217066466 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 16:00:14 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4d33f5b7-562c-470b-b5dc-3731c13fae0d tempest-VolumesGetTest-1217066466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c2513d4d-dd2c-4a1c-9b70-746d4f8092b3 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:14 devstack sudo[89841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c2513d4d-dd2c-4a1c-9b70-746d4f8092b3 1073741824
Apr 15 16:00:14 devstack sudo[89841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:14 devstack sudo[89841]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:14 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4d33f5b7-562c-470b-b5dc-3731c13fae0d tempest-VolumesGetTest-1217066466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c2513d4d-dd2c-4a1c-9b70-746d4f8092b3 1073741824" returned: 0 in 0.481s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:14 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4d33f5b7-562c-470b-b5dc-3731c13fae0d tempest-VolumesGetTest-1217066466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c2513d4d-dd2c-4a1c-9b70-746d4f8092b3 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:14 devstack sudo[89848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c2513d4d-dd2c-4a1c-9b70-746d4f8092b3
Apr 15 16:00:14 devstack sudo[89848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:14 devstack sudo[89848]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:14 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4d33f5b7-562c-470b-b5dc-3731c13fae0d tempest-VolumesGetTest-1217066466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c2513d4d-dd2c-4a1c-9b70-746d4f8092b3" returned: 0 in 0.409s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:14 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-4d33f5b7-562c-470b-b5dc-3731c13fae0d tempest-VolumesGetTest-1217066466 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:00:14 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-4d33f5b7-562c-470b-b5dc-3731c13fae0d tempest-VolumesGetTest-1217066466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:00:14 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-4d33f5b7-562c-470b-b5dc-3731c13fae0d tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd3450d6-d64e-4477-b9eb-4437e6a837b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2513d4d-dd2c-4a1c-9b70-746d4f8092b3', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:14 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-4d33f5b7-562c-470b-b5dc-3731c13fae0d tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfe4c483-d575-4872-a083-8c78ce7d5fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:14 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-4d33f5b7-562c-470b-b5dc-3731c13fae0d tempest-VolumesGetTest-1217066466 None] Volume volume-c2513d4d-dd2c-4a1c-9b70-746d4f8092b3 (c2513d4d-dd2c-4a1c-9b70-746d4f8092b3): created successfully
Apr 15 16:00:14 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-4d33f5b7-562c-470b-b5dc-3731c13fae0d tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfe4c483-d575-4872-a083-8c78ce7d5fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:14 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-4d33f5b7-562c-470b-b5dc-3731c13fae0d tempest-VolumesGetTest-1217066466 None] Flow 'volume_create_manager' (7b8bb988-3a8b-432f-9f91-74fc5f4b3c51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:00:14 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-4d33f5b7-562c-470b-b5dc-3731c13fae0d tempest-VolumesGetTest-1217066466 None] Created volume successfully.
Apr 15 16:00:16 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-685494b7-f86a-4858-b9b2-f54edeb92f96 tempest-VolumesGetTest-1217066466 None] Acquiring lock "cinder-c2513d4d-dd2c-4a1c-9b70-746d4f8092b3-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:00:16 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-685494b7-f86a-4858-b9b2-f54edeb92f96 tempest-VolumesGetTest-1217066466 None] Lock "cinder-c2513d4d-dd2c-4a1c-9b70-746d4f8092b3-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:00:16 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-685494b7-f86a-4858-b9b2-f54edeb92f96 tempest-VolumesGetTest-1217066466 None] Acquiring lock "cinder-quobyte-c2513d4d-dd2c-4a1c-9b70-746d4f8092b3" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:00:16 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-685494b7-f86a-4858-b9b2-f54edeb92f96 tempest-VolumesGetTest-1217066466 None] Lock "cinder-quobyte-c2513d4d-dd2c-4a1c-9b70-746d4f8092b3" acquired by "delete_volume" :: waited 0.009s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:00:16 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[24073d92-3917-4f3b-aed5-babd7b8c10a3]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:00:16 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-685494b7-f86a-4858-b9b2-f54edeb92f96 tempest-VolumesGetTest-1217066466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c2513d4d-dd2c-4a1c-9b70-746d4f8092b3 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:16 devstack sudo[89851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c2513d4d-dd2c-4a1c-9b70-746d4f8092b3
Apr 15 16:00:16 devstack sudo[89851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:16 devstack sudo[89851]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:16 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-685494b7-f86a-4858-b9b2-f54edeb92f96 tempest-VolumesGetTest-1217066466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c2513d4d-dd2c-4a1c-9b70-746d4f8092b3" returned: 0 in 0.469s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:16 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-685494b7-f86a-4858-b9b2-f54edeb92f96 tempest-VolumesGetTest-1217066466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c2513d4d-dd2c-4a1c-9b70-746d4f8092b3 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:16 devstack sudo[89856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c2513d4d-dd2c-4a1c-9b70-746d4f8092b3
Apr 15 16:00:16 devstack sudo[89856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:17 devstack sudo[89856]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:17 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-685494b7-f86a-4858-b9b2-f54edeb92f96 tempest-VolumesGetTest-1217066466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c2513d4d-dd2c-4a1c-9b70-746d4f8092b3" returned: 0 in 0.399s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:17 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-685494b7-f86a-4858-b9b2-f54edeb92f96 tempest-VolumesGetTest-1217066466 None] Lock "cinder-quobyte-c2513d4d-dd2c-4a1c-9b70-746d4f8092b3" released by "delete_volume" :: held 0.895s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:00:17 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-685494b7-f86a-4858-b9b2-f54edeb92f96 tempest-VolumesGetTest-1217066466 None] Created reservations ['f3b38bea-a122-4e8f-a5c1-7f661aff6316', '54621085-71a8-409e-ab1c-4b9acd9dc720', '506a64f5-adb9-4cb4-855b-193792ca8dc6', 'a63b6092-0a45-4021-a504-490274a1c98d'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:00:17 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-685494b7-f86a-4858-b9b2-f54edeb92f96 tempest-VolumesGetTest-1217066466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:00:17 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-685494b7-f86a-4858-b9b2-f54edeb92f96 tempest-VolumesGetTest-1217066466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:00:17 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-685494b7-f86a-4858-b9b2-f54edeb92f96 tempest-VolumesGetTest-1217066466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:00:17 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-685494b7-f86a-4858-b9b2-f54edeb92f96 tempest-VolumesGetTest-1217066466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:00:17 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-685494b7-f86a-4858-b9b2-f54edeb92f96 tempest-VolumesGetTest-1217066466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:00:17 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-685494b7-f86a-4858-b9b2-f54edeb92f96 tempest-VolumesGetTest-1217066466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:17 devstack sudo[89859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 16:00:17 devstack sudo[89859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:17 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-4019d612-08e2-43ac-8052-76f62f8389f7 tempest-VolumesGetTest-1217066466 None] Acquiring lock "cinder-a02c9948-1d03-46a8-8caf-d81b68e7a2ef-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:00:17 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-4019d612-08e2-43ac-8052-76f62f8389f7 tempest-VolumesGetTest-1217066466 None] Lock "cinder-a02c9948-1d03-46a8-8caf-d81b68e7a2ef-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:00:17 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-4019d612-08e2-43ac-8052-76f62f8389f7 tempest-VolumesGetTest-1217066466 None] Acquiring lock "cinder-quobyte-a02c9948-1d03-46a8-8caf-d81b68e7a2ef" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:00:17 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-4019d612-08e2-43ac-8052-76f62f8389f7 tempest-VolumesGetTest-1217066466 None] Lock "cinder-quobyte-a02c9948-1d03-46a8-8caf-d81b68e7a2ef" acquired by "delete_volume" :: waited 0.013s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:00:17 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[06076d63-ce8b-4b89-a602-05ced2a6cc42]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:00:17 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4019d612-08e2-43ac-8052-76f62f8389f7 tempest-VolumesGetTest-1217066466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a02c9948-1d03-46a8-8caf-d81b68e7a2ef {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:17 devstack sudo[89861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a02c9948-1d03-46a8-8caf-d81b68e7a2ef
Apr 15 16:00:17 devstack sudo[89861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:17 devstack sudo[89859]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:17 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-685494b7-f86a-4858-b9b2-f54edeb92f96 tempest-VolumesGetTest-1217066466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.435s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:17 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-685494b7-f86a-4858-b9b2-f54edeb92f96 tempest-VolumesGetTest-1217066466 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:00:17 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-685494b7-f86a-4858-b9b2-f54edeb92f96 tempest-VolumesGetTest-1217066466 None] Deleted volume successfully.
Apr 15 16:00:17 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-685494b7-f86a-4858-b9b2-f54edeb92f96 tempest-VolumesGetTest-1217066466 None] Lock "cinder-c2513d4d-dd2c-4a1c-9b70-746d4f8092b3-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:00:17 devstack sudo[89861]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:17 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4019d612-08e2-43ac-8052-76f62f8389f7 tempest-VolumesGetTest-1217066466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a02c9948-1d03-46a8-8caf-d81b68e7a2ef" returned: 0 in 0.471s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:17 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4019d612-08e2-43ac-8052-76f62f8389f7 tempest-VolumesGetTest-1217066466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a02c9948-1d03-46a8-8caf-d81b68e7a2ef {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:17 devstack sudo[89867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a02c9948-1d03-46a8-8caf-d81b68e7a2ef
Apr 15 16:00:17 devstack sudo[89867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:18 devstack sudo[89867]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4019d612-08e2-43ac-8052-76f62f8389f7 tempest-VolumesGetTest-1217066466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a02c9948-1d03-46a8-8caf-d81b68e7a2ef" returned: 0 in 0.396s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:18 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-4019d612-08e2-43ac-8052-76f62f8389f7 tempest-VolumesGetTest-1217066466 None] Lock "cinder-quobyte-a02c9948-1d03-46a8-8caf-d81b68e7a2ef" released by "delete_volume" :: held 0.890s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:00:18 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-4019d612-08e2-43ac-8052-76f62f8389f7 tempest-VolumesGetTest-1217066466 None] Created reservations ['f94755e9-acef-4a08-a0ae-2b0f2be2ce9e', '762506f9-cc46-4629-92b2-21d636e776e4', '2ca5b054-dcd0-4451-9592-717d7b3815d3', '81a12ed3-8e6e-42b9-ae40-86183e58a21a'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:00:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-4019d612-08e2-43ac-8052-76f62f8389f7 tempest-VolumesGetTest-1217066466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:00:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-4019d612-08e2-43ac-8052-76f62f8389f7 tempest-VolumesGetTest-1217066466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:00:18 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-4019d612-08e2-43ac-8052-76f62f8389f7 tempest-VolumesGetTest-1217066466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:00:18 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-4019d612-08e2-43ac-8052-76f62f8389f7 tempest-VolumesGetTest-1217066466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:00:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-4019d612-08e2-43ac-8052-76f62f8389f7 tempest-VolumesGetTest-1217066466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:00:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4019d612-08e2-43ac-8052-76f62f8389f7 tempest-VolumesGetTest-1217066466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:18 devstack sudo[89870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 16:00:18 devstack sudo[89870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:18 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-f98fa868-95cf-4fca-b688-017e6a0a29af tempest-VolumesGetTest-1217066466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:00:18 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-f98fa868-95cf-4fca-b688-017e6a0a29af tempest-VolumesGetTest-1217066466 None] Flow 'volume_create_manager' (b4acb6a2-469d-443e-baed-1be93e30c31e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:00:18 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-f98fa868-95cf-4fca-b688-017e6a0a29af tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d71080ed-6955-4b3f-9aa3-4a9cacb46249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:18 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-f98fa868-95cf-4fca-b688-017e6a0a29af tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d71080ed-6955-4b3f-9aa3-4a9cacb46249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:00:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2136000404',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c5d3291-bc4f-434b-919c-a1f0c87bc6d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7fb9f4edec34dd2b9586b03209ea693',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:00:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:00:19Z,use_quota=True,user_id='e7edf2cd1a3147a89d74ea17b48d54c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:18 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-f98fa868-95cf-4fca-b688-017e6a0a29af tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f0b3331-f15e-4e3b-808b-abd392c12b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:18 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-f98fa868-95cf-4fca-b688-017e6a0a29af tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f0b3331-f15e-4e3b-808b-abd392c12b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:18 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-f98fa868-95cf-4fca-b688-017e6a0a29af tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4283bda-0eb2-4cf5-a350-70ae978f599b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:18 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-f98fa868-95cf-4fca-b688-017e6a0a29af tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4283bda-0eb2-4cf5-a350-70ae978f599b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c5d3291-bc4f-434b-919c-a1f0c87bc6d9', 'volume_name': 'volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:18 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-f98fa868-95cf-4fca-b688-017e6a0a29af tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fae1d56-faca-49c0-a119-015718878220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:18 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-f98fa868-95cf-4fca-b688-017e6a0a29af tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fae1d56-faca-49c0-a119-015718878220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:18 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-f98fa868-95cf-4fca-b688-017e6a0a29af tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00370574-7819-47e3-bd7b-5fa23774d0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:18 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-f98fa868-95cf-4fca-b688-017e6a0a29af tempest-VolumesGetTest-1217066466 None] Volume 6c5d3291-bc4f-434b-919c-a1f0c87bc6d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9', 'volume_size': 1}
Apr 15 16:00:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-f98fa868-95cf-4fca-b688-017e6a0a29af tempest-VolumesGetTest-1217066466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:00:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-f98fa868-95cf-4fca-b688-017e6a0a29af tempest-VolumesGetTest-1217066466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:00:18 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-f98fa868-95cf-4fca-b688-017e6a0a29af tempest-VolumesGetTest-1217066466 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:00:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2136000404',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c5d3291-bc4f-434b-919c-a1f0c87bc6d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7fb9f4edec34dd2b9586b03209ea693',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:00:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:00:19Z,use_quota=True,user_id='e7edf2cd1a3147a89d74ea17b48d54c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:00:18 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-f98fa868-95cf-4fca-b688-017e6a0a29af tempest-VolumesGetTest-1217066466 None] Creating volume 6c5d3291-bc4f-434b-919c-a1f0c87bc6d9 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:00:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-f98fa868-95cf-4fca-b688-017e6a0a29af tempest-VolumesGetTest-1217066466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:00:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-f98fa868-95cf-4fca-b688-017e6a0a29af tempest-VolumesGetTest-1217066466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:00:18 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-f98fa868-95cf-4fca-b688-017e6a0a29af tempest-VolumesGetTest-1217066466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:00:18 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-f98fa868-95cf-4fca-b688-017e6a0a29af tempest-VolumesGetTest-1217066466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:00:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-f98fa868-95cf-4fca-b688-017e6a0a29af tempest-VolumesGetTest-1217066466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:00:18 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-f98fa868-95cf-4fca-b688-017e6a0a29af tempest-VolumesGetTest-1217066466 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:00:18 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-f98fa868-95cf-4fca-b688-017e6a0a29af tempest-VolumesGetTest-1217066466 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 16:00:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-f98fa868-95cf-4fca-b688-017e6a0a29af tempest-VolumesGetTest-1217066466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:18 devstack sudo[89873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9 1073741824
Apr 15 16:00:18 devstack sudo[89873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:18 devstack sudo[89870]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4019d612-08e2-43ac-8052-76f62f8389f7 tempest-VolumesGetTest-1217066466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.435s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:18 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-4019d612-08e2-43ac-8052-76f62f8389f7 tempest-VolumesGetTest-1217066466 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:00:18 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-4019d612-08e2-43ac-8052-76f62f8389f7 tempest-VolumesGetTest-1217066466 None] Deleted volume successfully.
Apr 15 16:00:18 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-4019d612-08e2-43ac-8052-76f62f8389f7 tempest-VolumesGetTest-1217066466 None] Lock "cinder-a02c9948-1d03-46a8-8caf-d81b68e7a2ef-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:00:19 devstack sudo[89873]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-f98fa868-95cf-4fca-b688-017e6a0a29af tempest-VolumesGetTest-1217066466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9 1073741824" returned: 0 in 0.471s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-f98fa868-95cf-4fca-b688-017e6a0a29af tempest-VolumesGetTest-1217066466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:19 devstack sudo[89878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9
Apr 15 16:00:19 devstack sudo[89878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:19 devstack sudo[89878]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-f98fa868-95cf-4fca-b688-017e6a0a29af tempest-VolumesGetTest-1217066466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9" returned: 0 in 0.424s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:19 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-f98fa868-95cf-4fca-b688-017e6a0a29af tempest-VolumesGetTest-1217066466 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:00:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-f98fa868-95cf-4fca-b688-017e6a0a29af tempest-VolumesGetTest-1217066466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:00:19 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-f98fa868-95cf-4fca-b688-017e6a0a29af tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00370574-7819-47e3-bd7b-5fa23774d0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:19 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-f98fa868-95cf-4fca-b688-017e6a0a29af tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e493ca61-76d9-47e0-9cc8-de518f3bcf77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:19 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-f98fa868-95cf-4fca-b688-017e6a0a29af tempest-VolumesGetTest-1217066466 None] Volume volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9 (6c5d3291-bc4f-434b-919c-a1f0c87bc6d9): created successfully
Apr 15 16:00:19 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-f98fa868-95cf-4fca-b688-017e6a0a29af tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e493ca61-76d9-47e0-9cc8-de518f3bcf77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:19 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-f98fa868-95cf-4fca-b688-017e6a0a29af tempest-VolumesGetTest-1217066466 None] Flow 'volume_create_manager' (b4acb6a2-469d-443e-baed-1be93e30c31e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:00:19 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-f98fa868-95cf-4fca-b688-017e6a0a29af tempest-VolumesGetTest-1217066466 None] Created volume successfully.
Apr 15 16:00:21 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:00:21 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] Flow 'volume_create_manager' (b780fb48-5554-457b-8a53-9b292a4ed629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:00:21 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (011fca58-724f-417c-a12e-9d2f75409cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:21 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (011fca58-724f-417c-a12e-9d2f75409cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:00:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1089164521',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78273c16-5d62-4324-8b60-8732caac526a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a7fb9f4edec34dd2b9586b03209ea693',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:00:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=6c5d3291-bc4f-434b-919c-a1f0c87bc6d9,status='creating',terminated_at=None,updated_at=2026-04-15T14:00:21Z,use_quota=True,user_id='e7edf2cd1a3147a89d74ea17b48d54c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:21 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fc3a8a0-fb69-458a-8723-86779f7a4a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:21 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fc3a8a0-fb69-458a-8723-86779f7a4a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:21 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2689ba1f-74d9-4798-b452-41de29ccc276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:21 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2689ba1f-74d9-4798-b452-41de29ccc276) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '78273c16-5d62-4324-8b60-8732caac526a', 'volume_name': 'volume-78273c16-5d62-4324-8b60-8732caac526a', 'volume_size': 1, 'source_volid': '6c5d3291-bc4f-434b-919c-a1f0c87bc6d9', 'source_volstatus': 'available'}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:21 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f58bab70-8163-4273-8e68-85ed71cc7b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:21 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f58bab70-8163-4273-8e68-85ed71cc7b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:21 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dc161ab-2efc-4246-9499-c46e84514d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:21 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] Volume 78273c16-5d62-4324-8b60-8732caac526a: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-78273c16-5d62-4324-8b60-8732caac526a', 'volume_size': 1, 'source_volid': '6c5d3291-bc4f-434b-919c-a1f0c87bc6d9', 'source_volstatus': 'available'}
Apr 15 16:00:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:00:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:00:21 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] Cloning volume 6c5d3291-bc4f-434b-919c-a1f0c87bc6d9 to volume 78273c16-5d62-4324-8b60-8732caac526a
Apr 15 16:00:21 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] Creating offline snapshot 30b74270-9159-4caa-ac74-03b0ca975c72 of volume 6c5d3291-bc4f-434b-919c-a1f0c87bc6d9 {{(pid=82485) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 16:00:21 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d07ae6b-c116-4196-a4b5-69bdd1989667]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:00:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:21 devstack sudo[89881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9
Apr 15 16:00:21 devstack sudo[89881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:21 devstack sudo[89881]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9" returned: 0 in 0.477s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9.30b74270-9159-4caa-ac74-03b0ca975c72 1G {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:21 devstack sudo[89886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9.30b74270-9159-4caa-ac74-03b0ca975c72 1G
Apr 15 16:00:21 devstack sudo[89886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:22 devstack sudo[89886]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:22 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9.30b74270-9159-4caa-ac74-03b0ca975c72 1G" returned: 0 in 0.466s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:22 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9.30b74270-9159-4caa-ac74-03b0ca975c72 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:22 devstack sudo[89891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9.30b74270-9159-4caa-ac74-03b0ca975c72
Apr 15 16:00:22 devstack sudo[89891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:22 devstack sudo[89891]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:22 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9.30b74270-9159-4caa-ac74-03b0ca975c72" returned: 0 in 0.430s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:22 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9.30b74270-9159-4caa-ac74-03b0ca975c72 is being set with open permissions: ugo+rw
Apr 15 16:00:22 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9.30b74270-9159-4caa-ac74-03b0ca975c72 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:22 devstack sudo[89896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9.30b74270-9159-4caa-ac74-03b0ca975c72
Apr 15 16:00:22 devstack sudo[89896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:22 devstack sudo[89896]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:22 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9.30b74270-9159-4caa-ac74-03b0ca975c72" returned: 0 in 0.407s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:22 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9.info {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:22 devstack sudo[89899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9.info
Apr 15 16:00:22 devstack sudo[89899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:23 devstack sudo[89899]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:23 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9.info" returned: 0 in 0.430s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:23 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9.info is being set with open permissions: ugo+rw
Apr 15 16:00:23 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9.info {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:23 devstack sudo[89902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9.info
Apr 15 16:00:23 devstack sudo[89902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:23 devstack sudo[89902]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:23 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9.info" returned: 0 in 0.409s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:23 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] Acquiring lock "cinder-quobyte-78273c16-5d62-4324-8b60-8732caac526a" by "_copy_volume_from_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:00:23 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] Lock "cinder-quobyte-78273c16-5d62-4324-8b60-8732caac526a" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:00:23 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] snapshot: 30b74270-9159-4caa-ac74-03b0ca975c72, volume: 78273c16-5d62-4324-8b60-8732caac526a,  {{(pid=82485) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 15 16:00:23 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:00:23 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:00:23 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:00:23 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:00:23 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:00:23 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a132b82-8cb6-4082-b88f-aaa6745f6783]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:00:23 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9.30b74270-9159-4caa-ac74-03b0ca975c72 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:23 devstack sudo[89905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9.30b74270-9159-4caa-ac74-03b0ca975c72
Apr 15 16:00:23 devstack sudo[89905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:24 devstack sudo[89905]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:24 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9.30b74270-9159-4caa-ac74-03b0ca975c72" returned: 0 in 0.486s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:24 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82485) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:00:24 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] will copy from snapshot at /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9 {{(pid=82485) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 15 16:00:24 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] Creating direct copy from snapshot {{(pid=82485) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 15 16:00:24 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9ccdad-aead-432d-bf2e-dc0540ac4e4b]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:00:24 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:24 devstack sudo[89910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9
Apr 15 16:00:24 devstack sudo[89910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:24 devstack sudo[89910]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:24 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9" returned: 0 in 0.471s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:24 devstack cinder-volume[82485]: DEBUG cinder.utils [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] Path /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78273c16-5d62-4324-8b60-8732caac526a not found in is_blk_device check {{(pid=82485) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 15 16:00:24 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78273c16-5d62-4324-8b60-8732caac526a {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:24 devstack sudo[89916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78273c16-5d62-4324-8b60-8732caac526a
Apr 15 16:00:24 devstack sudo[89916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:26 devstack sudo[89916]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78273c16-5d62-4324-8b60-8732caac526a" returned: 0 in 1.872s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:26 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ab0f09-e3a9-424c-9fcd-6ea4d72820a8]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:00:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:26 devstack sudo[89928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9
Apr 15 16:00:26 devstack sudo[89928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:27 devstack sudo[89928]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:27 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9" returned: 0 in 0.584s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:27 devstack cinder-volume[82485]: DEBUG cinder.image.image_utils [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] Image conversion details: src /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9, size 1024.00 MB, duration 1.87 sec, destination /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78273c16-5d62-4324-8b60-8732caac526a {{(pid=82485) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 16:00:27 devstack cinder-volume[82485]: INFO cinder.image.image_utils [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] Converted 1024.00 MB image at 546.71 MB/s
Apr 15 16:00:27 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78273c16-5d62-4324-8b60-8732caac526a is being set with open permissions: ugo+rw
Apr 15 16:00:27 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78273c16-5d62-4324-8b60-8732caac526a {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:27 devstack sudo[89934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78273c16-5d62-4324-8b60-8732caac526a
Apr 15 16:00:27 devstack sudo[89934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:27 devstack sudo[89934]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:27 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78273c16-5d62-4324-8b60-8732caac526a" returned: 0 in 0.413s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:27 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] Lock "cinder-quobyte-78273c16-5d62-4324-8b60-8732caac526a" released by "_copy_volume_from_snapshot" :: held 3.871s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:00:27 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] Acquiring lock "cinder-quobyte-30b74270-9159-4caa-ac74-03b0ca975c72" by "_delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:00:27 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] Lock "cinder-quobyte-30b74270-9159-4caa-ac74-03b0ca975c72" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:00:27 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] Deleting offline snapshot 30b74270-9159-4caa-ac74-03b0ca975c72 of volume 6c5d3291-bc4f-434b-919c-a1f0c87bc6d9 {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 16:00:27 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] snapshot_file for this snap is: volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9.30b74270-9159-4caa-ac74-03b0ca975c72 {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 16:00:27 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[18376605-0936-4fa2-ab3a-e2c6aa75fa43]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:00:27 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9.30b74270-9159-4caa-ac74-03b0ca975c72 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:27 devstack sudo[89937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9.30b74270-9159-4caa-ac74-03b0ca975c72
Apr 15 16:00:27 devstack sudo[89937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:28 devstack sudo[89937]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:28 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9.30b74270-9159-4caa-ac74-03b0ca975c72" returned: 0 in 0.501s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:28 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82485) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:00:28 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8ef094-db72-4b87-8c03-a41417027fad]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:00:28 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:28 devstack sudo[89942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9
Apr 15 16:00:28 devstack sudo[89942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:28 devstack sudo[89942]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:28 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9" returned: 0 in 0.486s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:28 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9.30b74270-9159-4caa-ac74-03b0ca975c72 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:28 devstack sudo[89947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9.30b74270-9159-4caa-ac74-03b0ca975c72
Apr 15 16:00:28 devstack sudo[89947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:29 devstack sudo[89947]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:29 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9.30b74270-9159-4caa-ac74-03b0ca975c72" returned: 0 in 0.441s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:29 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9.30b74270-9159-4caa-ac74-03b0ca975c72 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:29 devstack sudo[89952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9.30b74270-9159-4caa-ac74-03b0ca975c72
Apr 15 16:00:29 devstack sudo[89952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:29 devstack sudo[89952]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:29 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9.30b74270-9159-4caa-ac74-03b0ca975c72" returned: 0 in 0.431s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:29 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] Lock "cinder-quobyte-30b74270-9159-4caa-ac74-03b0ca975c72" released by "_delete_snapshot" :: held 1.905s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:00:29 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.511s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:00:29 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dc161ab-2efc-4246-9499-c46e84514d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78273c16-5d62-4324-8b60-8732caac526a', 'volume_size': 1, 'source_volid': '6c5d3291-bc4f-434b-919c-a1f0c87bc6d9', 'source_volstatus': 'available'}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:29 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b4e06cb-1160-45c8-ad9b-b4288211c71b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:29 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] Volume volume-78273c16-5d62-4324-8b60-8732caac526a (78273c16-5d62-4324-8b60-8732caac526a): created successfully
Apr 15 16:00:29 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b4e06cb-1160-45c8-ad9b-b4288211c71b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:29 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] Flow 'volume_create_manager' (b780fb48-5554-457b-8a53-9b292a4ed629) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:00:29 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-1b23bc11-c0bd-4026-aec9-693599dcf3ef tempest-VolumesGetTest-1217066466 None] Created volume successfully.
Apr 15 16:00:30 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-39465f88-dd2c-491b-bec6-bf2c9ae96fe2 tempest-VolumesGetTest-1217066466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:00:30 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-39465f88-dd2c-491b-bec6-bf2c9ae96fe2 tempest-VolumesGetTest-1217066466 None] Flow 'volume_create_manager' (ce012e18-e932-4ae2-b192-85ac4fdafaf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:00:30 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-39465f88-dd2c-491b-bec6-bf2c9ae96fe2 tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dacca07c-8f6d-481f-bd21-e7d6325a395e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:30 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-39465f88-dd2c-491b-bec6-bf2c9ae96fe2 tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dacca07c-8f6d-481f-bd21-e7d6325a395e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:00:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1436585421',display_name='tempest-VolumesGetTest-Volume-449038477',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d11747c-f34d-43f8-8532-4178692b8b1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7fb9f4edec34dd2b9586b03209ea693',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:00:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:00:31Z,use_quota=True,user_id='e7edf2cd1a3147a89d74ea17b48d54c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:30 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-39465f88-dd2c-491b-bec6-bf2c9ae96fe2 tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dec6211a-0ce0-4adc-b1f7-a90baeb29070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:30 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-39465f88-dd2c-491b-bec6-bf2c9ae96fe2 tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dec6211a-0ce0-4adc-b1f7-a90baeb29070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:30 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-39465f88-dd2c-491b-bec6-bf2c9ae96fe2 tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fccaea94-442c-4124-8ca5-5fd05e3e2193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:30 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-39465f88-dd2c-491b-bec6-bf2c9ae96fe2 tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fccaea94-442c-4124-8ca5-5fd05e3e2193) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d11747c-f34d-43f8-8532-4178692b8b1b', 'volume_name': 'volume-8d11747c-f34d-43f8-8532-4178692b8b1b', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:30 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-39465f88-dd2c-491b-bec6-bf2c9ae96fe2 tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (009d049e-7b54-4591-9014-4800c4c4da7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:30 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-39465f88-dd2c-491b-bec6-bf2c9ae96fe2 tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (009d049e-7b54-4591-9014-4800c4c4da7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:30 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-39465f88-dd2c-491b-bec6-bf2c9ae96fe2 tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3a5e422-7def-4160-b635-ca290b99556c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:30 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-39465f88-dd2c-491b-bec6-bf2c9ae96fe2 tempest-VolumesGetTest-1217066466 None] Volume 8d11747c-f34d-43f8-8532-4178692b8b1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d11747c-f34d-43f8-8532-4178692b8b1b', 'volume_size': 1}
Apr 15 16:00:30 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-39465f88-dd2c-491b-bec6-bf2c9ae96fe2 tempest-VolumesGetTest-1217066466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:00:30 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-39465f88-dd2c-491b-bec6-bf2c9ae96fe2 tempest-VolumesGetTest-1217066466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:00:30 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-39465f88-dd2c-491b-bec6-bf2c9ae96fe2 tempest-VolumesGetTest-1217066466 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:00:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1436585421',display_name='tempest-VolumesGetTest-Volume-449038477',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d11747c-f34d-43f8-8532-4178692b8b1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7fb9f4edec34dd2b9586b03209ea693',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:00:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:00:31Z,use_quota=True,user_id='e7edf2cd1a3147a89d74ea17b48d54c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:00:30 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-39465f88-dd2c-491b-bec6-bf2c9ae96fe2 tempest-VolumesGetTest-1217066466 None] Creating volume 8d11747c-f34d-43f8-8532-4178692b8b1b {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:00:30 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-39465f88-dd2c-491b-bec6-bf2c9ae96fe2 tempest-VolumesGetTest-1217066466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:00:30 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-39465f88-dd2c-491b-bec6-bf2c9ae96fe2 tempest-VolumesGetTest-1217066466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:00:30 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-39465f88-dd2c-491b-bec6-bf2c9ae96fe2 tempest-VolumesGetTest-1217066466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:00:30 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-39465f88-dd2c-491b-bec6-bf2c9ae96fe2 tempest-VolumesGetTest-1217066466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:00:30 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-39465f88-dd2c-491b-bec6-bf2c9ae96fe2 tempest-VolumesGetTest-1217066466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:00:30 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-39465f88-dd2c-491b-bec6-bf2c9ae96fe2 tempest-VolumesGetTest-1217066466 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:00:30 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-39465f88-dd2c-491b-bec6-bf2c9ae96fe2 tempest-VolumesGetTest-1217066466 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 16:00:30 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-39465f88-dd2c-491b-bec6-bf2c9ae96fe2 tempest-VolumesGetTest-1217066466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8d11747c-f34d-43f8-8532-4178692b8b1b 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:31 devstack sudo[89955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8d11747c-f34d-43f8-8532-4178692b8b1b 1073741824
Apr 15 16:00:31 devstack sudo[89955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:31 devstack sudo[89955]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:31 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-39465f88-dd2c-491b-bec6-bf2c9ae96fe2 tempest-VolumesGetTest-1217066466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8d11747c-f34d-43f8-8532-4178692b8b1b 1073741824" returned: 0 in 0.482s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:31 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-39465f88-dd2c-491b-bec6-bf2c9ae96fe2 tempest-VolumesGetTest-1217066466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8d11747c-f34d-43f8-8532-4178692b8b1b {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:31 devstack sudo[89960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8d11747c-f34d-43f8-8532-4178692b8b1b
Apr 15 16:00:31 devstack sudo[89960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:31 devstack sudo[89960]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:31 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-39465f88-dd2c-491b-bec6-bf2c9ae96fe2 tempest-VolumesGetTest-1217066466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8d11747c-f34d-43f8-8532-4178692b8b1b" returned: 0 in 0.410s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:31 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-39465f88-dd2c-491b-bec6-bf2c9ae96fe2 tempest-VolumesGetTest-1217066466 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:00:31 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-39465f88-dd2c-491b-bec6-bf2c9ae96fe2 tempest-VolumesGetTest-1217066466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:00:31 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-39465f88-dd2c-491b-bec6-bf2c9ae96fe2 tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3a5e422-7def-4160-b635-ca290b99556c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d11747c-f34d-43f8-8532-4178692b8b1b', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:31 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-39465f88-dd2c-491b-bec6-bf2c9ae96fe2 tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b4137bd-3003-4d10-959d-5382516fec0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:31 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-39465f88-dd2c-491b-bec6-bf2c9ae96fe2 tempest-VolumesGetTest-1217066466 None] Volume volume-8d11747c-f34d-43f8-8532-4178692b8b1b (8d11747c-f34d-43f8-8532-4178692b8b1b): created successfully
Apr 15 16:00:31 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-39465f88-dd2c-491b-bec6-bf2c9ae96fe2 tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b4137bd-3003-4d10-959d-5382516fec0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:31 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-39465f88-dd2c-491b-bec6-bf2c9ae96fe2 tempest-VolumesGetTest-1217066466 None] Flow 'volume_create_manager' (ce012e18-e932-4ae2-b192-85ac4fdafaf1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:00:31 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-39465f88-dd2c-491b-bec6-bf2c9ae96fe2 tempest-VolumesGetTest-1217066466 None] Created volume successfully.
Apr 15 16:00:33 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-db8b0358-897f-4f9d-b846-4bf6f24928e4 tempest-VolumesGetTest-1217066466 None] Acquiring lock "cinder-8d11747c-f34d-43f8-8532-4178692b8b1b-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:00:33 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-db8b0358-897f-4f9d-b846-4bf6f24928e4 tempest-VolumesGetTest-1217066466 None] Lock "cinder-8d11747c-f34d-43f8-8532-4178692b8b1b-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:00:33 devstack cinder-volume[82485]: DEBUG dbcounter [-] [82485] Writing DB stats cinder:UPDATE=112,cinder:DELETE=14,cinder:SELECT=99,cinder:INSERT=26 {{(pid=82485) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 16:00:33 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-db8b0358-897f-4f9d-b846-4bf6f24928e4 tempest-VolumesGetTest-1217066466 None] Acquiring lock "cinder-quobyte-8d11747c-f34d-43f8-8532-4178692b8b1b" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:00:33 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-db8b0358-897f-4f9d-b846-4bf6f24928e4 tempest-VolumesGetTest-1217066466 None] Lock "cinder-quobyte-8d11747c-f34d-43f8-8532-4178692b8b1b" acquired by "delete_volume" :: waited 0.008s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:00:33 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[9deb1f7d-cd76-445c-be77-97a004d139ca]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:00:33 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-db8b0358-897f-4f9d-b846-4bf6f24928e4 tempest-VolumesGetTest-1217066466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8d11747c-f34d-43f8-8532-4178692b8b1b {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:33 devstack sudo[89963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8d11747c-f34d-43f8-8532-4178692b8b1b
Apr 15 16:00:33 devstack sudo[89963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:33 devstack sudo[89963]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:33 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-db8b0358-897f-4f9d-b846-4bf6f24928e4 tempest-VolumesGetTest-1217066466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8d11747c-f34d-43f8-8532-4178692b8b1b" returned: 0 in 0.475s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:33 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-db8b0358-897f-4f9d-b846-4bf6f24928e4 tempest-VolumesGetTest-1217066466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8d11747c-f34d-43f8-8532-4178692b8b1b {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:33 devstack sudo[89968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8d11747c-f34d-43f8-8532-4178692b8b1b
Apr 15 16:00:33 devstack sudo[89968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:34 devstack sudo[89968]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:34 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-db8b0358-897f-4f9d-b846-4bf6f24928e4 tempest-VolumesGetTest-1217066466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8d11747c-f34d-43f8-8532-4178692b8b1b" returned: 0 in 0.403s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:34 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-db8b0358-897f-4f9d-b846-4bf6f24928e4 tempest-VolumesGetTest-1217066466 None] Lock "cinder-quobyte-8d11747c-f34d-43f8-8532-4178692b8b1b" released by "delete_volume" :: held 0.906s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:00:34 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-db8b0358-897f-4f9d-b846-4bf6f24928e4 tempest-VolumesGetTest-1217066466 None] Created reservations ['1b6cdefe-6076-4def-a04d-c41762f83da7', '6a300b30-d5a1-4f20-9236-46278f8bbb56', '5210f980-3f76-4633-a25b-3d5b419cd307', '5812070f-69a7-42b3-8286-6154cb32fa21'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:00:34 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-db8b0358-897f-4f9d-b846-4bf6f24928e4 tempest-VolumesGetTest-1217066466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:00:34 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-db8b0358-897f-4f9d-b846-4bf6f24928e4 tempest-VolumesGetTest-1217066466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:00:34 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-db8b0358-897f-4f9d-b846-4bf6f24928e4 tempest-VolumesGetTest-1217066466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:00:34 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-db8b0358-897f-4f9d-b846-4bf6f24928e4 tempest-VolumesGetTest-1217066466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:00:34 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-db8b0358-897f-4f9d-b846-4bf6f24928e4 tempest-VolumesGetTest-1217066466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:00:34 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-db8b0358-897f-4f9d-b846-4bf6f24928e4 tempest-VolumesGetTest-1217066466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:34 devstack sudo[89971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 16:00:34 devstack sudo[89971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:34 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-b53c6ba5-2e9a-4169-9357-50e8dae295f4 tempest-VolumesGetTest-1217066466 None] Acquiring lock "cinder-78273c16-5d62-4324-8b60-8732caac526a-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:00:34 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-b53c6ba5-2e9a-4169-9357-50e8dae295f4 tempest-VolumesGetTest-1217066466 None] Lock "cinder-78273c16-5d62-4324-8b60-8732caac526a-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:00:34 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-b53c6ba5-2e9a-4169-9357-50e8dae295f4 tempest-VolumesGetTest-1217066466 None] Acquiring lock "cinder-quobyte-78273c16-5d62-4324-8b60-8732caac526a" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:00:34 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-b53c6ba5-2e9a-4169-9357-50e8dae295f4 tempest-VolumesGetTest-1217066466 None] Lock "cinder-quobyte-78273c16-5d62-4324-8b60-8732caac526a" acquired by "delete_volume" :: waited 0.006s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:00:34 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b740c2b-80a5-4d27-8213-a2017a94bfe5]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:00:34 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b53c6ba5-2e9a-4169-9357-50e8dae295f4 tempest-VolumesGetTest-1217066466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78273c16-5d62-4324-8b60-8732caac526a {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:34 devstack sudo[89973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78273c16-5d62-4324-8b60-8732caac526a
Apr 15 16:00:34 devstack sudo[89973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:34 devstack sudo[89971]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:34 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-db8b0358-897f-4f9d-b846-4bf6f24928e4 tempest-VolumesGetTest-1217066466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.448s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:34 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-db8b0358-897f-4f9d-b846-4bf6f24928e4 tempest-VolumesGetTest-1217066466 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:00:34 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-db8b0358-897f-4f9d-b846-4bf6f24928e4 tempest-VolumesGetTest-1217066466 None] Deleted volume successfully.
Apr 15 16:00:34 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-db8b0358-897f-4f9d-b846-4bf6f24928e4 tempest-VolumesGetTest-1217066466 None] Lock "cinder-8d11747c-f34d-43f8-8532-4178692b8b1b-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:00:34 devstack sudo[89973]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:34 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b53c6ba5-2e9a-4169-9357-50e8dae295f4 tempest-VolumesGetTest-1217066466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78273c16-5d62-4324-8b60-8732caac526a" returned: 0 in 0.493s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:34 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b53c6ba5-2e9a-4169-9357-50e8dae295f4 tempest-VolumesGetTest-1217066466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78273c16-5d62-4324-8b60-8732caac526a {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:34 devstack sudo[89980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78273c16-5d62-4324-8b60-8732caac526a
Apr 15 16:00:34 devstack sudo[89980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:35 devstack sudo[89980]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:35 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b53c6ba5-2e9a-4169-9357-50e8dae295f4 tempest-VolumesGetTest-1217066466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-78273c16-5d62-4324-8b60-8732caac526a" returned: 0 in 0.415s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:35 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-b53c6ba5-2e9a-4169-9357-50e8dae295f4 tempest-VolumesGetTest-1217066466 None] Lock "cinder-quobyte-78273c16-5d62-4324-8b60-8732caac526a" released by "delete_volume" :: held 0.928s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:00:35 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-b53c6ba5-2e9a-4169-9357-50e8dae295f4 tempest-VolumesGetTest-1217066466 None] Created reservations ['6f1ac22f-9119-4bb5-8664-73cc70915566', '5ff4c8fe-18f1-433c-9fd9-7e437d857d0d', '343b9ade-f4d4-485d-8678-ed9370e923eb', 'bfe32a89-7ca1-40bc-a802-eab66b0ecf98'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:00:35 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-b53c6ba5-2e9a-4169-9357-50e8dae295f4 tempest-VolumesGetTest-1217066466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:00:35 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-b53c6ba5-2e9a-4169-9357-50e8dae295f4 tempest-VolumesGetTest-1217066466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:00:35 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-b53c6ba5-2e9a-4169-9357-50e8dae295f4 tempest-VolumesGetTest-1217066466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:00:35 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-b53c6ba5-2e9a-4169-9357-50e8dae295f4 tempest-VolumesGetTest-1217066466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:00:35 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-b53c6ba5-2e9a-4169-9357-50e8dae295f4 tempest-VolumesGetTest-1217066466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:00:35 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b53c6ba5-2e9a-4169-9357-50e8dae295f4 tempest-VolumesGetTest-1217066466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:35 devstack sudo[89989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 16:00:35 devstack sudo[89989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:35 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-370943b2-f7cc-4578-8aa7-013ffc2570c5 tempest-VolumesGetTest-1217066466 None] Acquiring lock "cinder-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:00:35 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-370943b2-f7cc-4578-8aa7-013ffc2570c5 tempest-VolumesGetTest-1217066466 None] Lock "cinder-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:00:35 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-370943b2-f7cc-4578-8aa7-013ffc2570c5 tempest-VolumesGetTest-1217066466 None] Acquiring lock "cinder-quobyte-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:00:35 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-370943b2-f7cc-4578-8aa7-013ffc2570c5 tempest-VolumesGetTest-1217066466 None] Lock "cinder-quobyte-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9" acquired by "delete_volume" :: waited 0.013s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:00:35 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47a5089-f418-4fe5-82bb-cc78e8002281]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:00:35 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-370943b2-f7cc-4578-8aa7-013ffc2570c5 tempest-VolumesGetTest-1217066466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:35 devstack sudo[89991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9
Apr 15 16:00:35 devstack sudo[89991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:35 devstack sudo[89989]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:35 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b53c6ba5-2e9a-4169-9357-50e8dae295f4 tempest-VolumesGetTest-1217066466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.460s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:35 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-b53c6ba5-2e9a-4169-9357-50e8dae295f4 tempest-VolumesGetTest-1217066466 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:00:35 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-b53c6ba5-2e9a-4169-9357-50e8dae295f4 tempest-VolumesGetTest-1217066466 None] Deleted volume successfully.
Apr 15 16:00:35 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-b53c6ba5-2e9a-4169-9357-50e8dae295f4 tempest-VolumesGetTest-1217066466 None] Lock "cinder-78273c16-5d62-4324-8b60-8732caac526a-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:00:36 devstack sudo[89991]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:36 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-370943b2-f7cc-4578-8aa7-013ffc2570c5 tempest-VolumesGetTest-1217066466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9" returned: 0 in 0.481s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:36 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-370943b2-f7cc-4578-8aa7-013ffc2570c5 tempest-VolumesGetTest-1217066466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:36 devstack sudo[89997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9
Apr 15 16:00:36 devstack sudo[89997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:36 devstack sudo[89997]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:36 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-370943b2-f7cc-4578-8aa7-013ffc2570c5 tempest-VolumesGetTest-1217066466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9" returned: 0 in 0.415s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:36 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-370943b2-f7cc-4578-8aa7-013ffc2570c5 tempest-VolumesGetTest-1217066466 None] Lock "cinder-quobyte-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9" released by "delete_volume" :: held 0.923s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:00:36 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-370943b2-f7cc-4578-8aa7-013ffc2570c5 tempest-VolumesGetTest-1217066466 None] Created reservations ['6d9156fb-5e05-4f98-9603-c4228e0af9d7', '4ffea9de-7af4-42fc-97a4-01cf338a77ec', '7db5cf14-4e4d-411c-a82f-0505fc4a87a2', '71b408ed-097c-40ca-ba98-e51e293f41f9'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:00:36 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-370943b2-f7cc-4578-8aa7-013ffc2570c5 tempest-VolumesGetTest-1217066466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:00:36 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-370943b2-f7cc-4578-8aa7-013ffc2570c5 tempest-VolumesGetTest-1217066466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:00:36 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-370943b2-f7cc-4578-8aa7-013ffc2570c5 tempest-VolumesGetTest-1217066466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:00:36 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-370943b2-f7cc-4578-8aa7-013ffc2570c5 tempest-VolumesGetTest-1217066466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:00:36 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-370943b2-f7cc-4578-8aa7-013ffc2570c5 tempest-VolumesGetTest-1217066466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:00:36 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-370943b2-f7cc-4578-8aa7-013ffc2570c5 tempest-VolumesGetTest-1217066466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:36 devstack sudo[90000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 16:00:36 devstack sudo[90000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:37 devstack sudo[90000]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:37 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-370943b2-f7cc-4578-8aa7-013ffc2570c5 tempest-VolumesGetTest-1217066466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.488s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:37 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-370943b2-f7cc-4578-8aa7-013ffc2570c5 tempest-VolumesGetTest-1217066466 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:00:37 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-370943b2-f7cc-4578-8aa7-013ffc2570c5 tempest-VolumesGetTest-1217066466 None] Deleted volume successfully.
Apr 15 16:00:37 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-370943b2-f7cc-4578-8aa7-013ffc2570c5 tempest-VolumesGetTest-1217066466 None] Lock "cinder-6c5d3291-bc4f-434b-919c-a1f0c87bc6d9-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:00:37 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:00:37 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] Flow 'volume_create_manager' (50c31f0b-4d19-4670-b75e-c94e5582d64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:00:37 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cd982c6-9806-4953-bffd-b8e51c92f8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:37 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cd982c6-9806-4953-bffd-b8e51c92f8a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:00:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1457785969',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33ae4d4d-a2ad-46b1-b2e8-7ae095a23f1c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a7fb9f4edec34dd2b9586b03209ea693',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:00:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:00:37Z,use_quota=True,user_id='e7edf2cd1a3147a89d74ea17b48d54c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:37 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a590d1c-94e8-4533-83d3-9b97edd0f4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:37 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a590d1c-94e8-4533-83d3-9b97edd0f4e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:37 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9fc806a-934e-4eb9-b96f-e36b52aae9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:37 devstack cinder-volume[82485]: DEBUG cinder.image.glance [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] Creating Keystone auth plugin from conf {{(pid=82485) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 15 16:00:37 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9fc806a-934e-4eb9-b96f-e36b52aae9c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '33ae4d4d-a2ad-46b1-b2e8-7ae095a23f1c', 'volume_name': 'volume-33ae4d4d-a2ad-46b1-b2e8-7ae095a23f1c', 'volume_size': 1, 'image_id': '0fe37db8-916e-4521-8f72-73003c13994a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0fe37db8-916e-4521-8f72-73003c13994a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '57491fc0e71d4fad9011d017ccefe515', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0fe37db8-916e-4521-8f72-73003c13994a', 'created_at': datetime.datetime(2026, 4, 15, 13, 47, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 13, 47, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0fe37db8-916e-4521-8f72-73003c13994a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f1549cac550>}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:37 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4b8250d-7976-4209-86cb-869601e94cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:37 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4b8250d-7976-4209-86cb-869601e94cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:37 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad4bdfba-b491-4dbe-b066-9a0363edb1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:37 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] Volume 33ae4d4d-a2ad-46b1-b2e8-7ae095a23f1c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-33ae4d4d-a2ad-46b1-b2e8-7ae095a23f1c', 'volume_size': 1, 'image_id': '0fe37db8-916e-4521-8f72-73003c13994a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0fe37db8-916e-4521-8f72-73003c13994a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '57491fc0e71d4fad9011d017ccefe515', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0fe37db8-916e-4521-8f72-73003c13994a', 'created_at': datetime.datetime(2026, 4, 15, 13, 47, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 13, 47, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0fe37db8-916e-4521-8f72-73003c13994a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f1549cac550>}
Apr 15 16:00:37 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] Trying to clone 33ae4d4d-a2ad-46b1-b2e8-7ae095a23f1c from image 0fe37db8-916e-4521-8f72-73003c13994a at location (None, [{'url': 'file:///opt/stack/data/glance/images/0fe37db8-916e-4521-8f72-73003c13994a', 'metadata': {}}]). {{(pid=82485) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 15 16:00:37 devstack cinder-volume[82485]: DEBUG cinder.image.image_utils [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0fe37db8-916e-4521-8f72-73003c13994a_fnug7zwddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82485) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 15 16:00:37 devstack cinder-volume[82485]: INFO cinder.image.image_utils [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] Image download 20.69 MB at 20.69 MB/s
Apr 15 16:00:37 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[c625f95f-6850-456a-a320-4af55ae5cbf1]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:00:37 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fe37db8-916e-4521-8f72-73003c13994a_fnug7zwddevstack@QuobyteHD {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:37 devstack sudo[90004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fe37db8-916e-4521-8f72-73003c13994a_fnug7zwddevstack@QuobyteHD
Apr 15 16:00:37 devstack sudo[90004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:37 devstack sudo[90004]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:37 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fe37db8-916e-4521-8f72-73003c13994a_fnug7zwddevstack@QuobyteHD" returned: 0 in 0.461s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:37 devstack cinder-volume[82485]: DEBUG cinder.image.image_utils [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] Temporary image 0fe37db8-916e-4521-8f72-73003c13994a is fetched for user e7edf2cd1a3147a89d74ea17b48d54c1. {{(pid=82485) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 15 16:00:38 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be6f780-12be-4d51-b2dd-b6aafcb46695]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:00:38 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fe37db8-916e-4521-8f72-73003c13994a_fnug7zwddevstack@QuobyteHD {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:38 devstack sudo[90009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fe37db8-916e-4521-8f72-73003c13994a_fnug7zwddevstack@QuobyteHD
Apr 15 16:00:38 devstack sudo[90009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:38 devstack sudo[90009]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:38 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fe37db8-916e-4521-8f72-73003c13994a_fnug7zwddevstack@QuobyteHD" returned: 0 in 0.480s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:38 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:00:38 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:00:38 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:00:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1457785969',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33ae4d4d-a2ad-46b1-b2e8-7ae095a23f1c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a7fb9f4edec34dd2b9586b03209ea693',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:00:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:00:37Z,use_quota=True,user_id='e7edf2cd1a3147a89d74ea17b48d54c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:00:38 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] Creating volume 33ae4d4d-a2ad-46b1-b2e8-7ae095a23f1c {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:00:38 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:00:38 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:00:38 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:00:38 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:00:38 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:00:38 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:00:38 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 16:00:38 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-33ae4d4d-a2ad-46b1-b2e8-7ae095a23f1c 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:38 devstack sudo[90014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-33ae4d4d-a2ad-46b1-b2e8-7ae095a23f1c 1073741824
Apr 15 16:00:38 devstack sudo[90014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:38 devstack sudo[90014]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:38 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-33ae4d4d-a2ad-46b1-b2e8-7ae095a23f1c 1073741824" returned: 0 in 0.471s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:39 devstack cinder-volume[82485]: DEBUG dbcounter [-] [82485] Writing DB stats cinder:SELECT=98,cinder:UPDATE=118,cinder:DELETE=8,cinder:INSERT=38 {{(pid=82485) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 16:00:39 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-33ae4d4d-a2ad-46b1-b2e8-7ae095a23f1c {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:39 devstack sudo[90019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-33ae4d4d-a2ad-46b1-b2e8-7ae095a23f1c
Apr 15 16:00:39 devstack sudo[90019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:39 devstack sudo[90019]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:39 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-33ae4d4d-a2ad-46b1-b2e8-7ae095a23f1c" returned: 0 in 0.417s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:39 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:00:39 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:00:39 devstack cinder-volume[82485]: DEBUG cinder.volume.volume_utils [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] Attempting download of 0fe37db8-916e-4521-8f72-73003c13994a ((None, [{'url': 'file:///opt/stack/data/glance/images/0fe37db8-916e-4521-8f72-73003c13994a', 'metadata': {}}])) to volume 33ae4d4d-a2ad-46b1-b2e8-7ae095a23f1c. {{(pid=82485) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 15 16:00:39 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ed0daa-40ea-4811-8c74-a6605f0c1828]: (4, 'raw') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:00:39 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0fe37db8-916e-4521-8f72-73003c13994a_0glc9jgm {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:39 devstack sudo[90022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0fe37db8-916e-4521-8f72-73003c13994a_0glc9jgm
Apr 15 16:00:39 devstack sudo[90022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:39 devstack sudo[90022]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:39 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0fe37db8-916e-4521-8f72-73003c13994a_0glc9jgm" returned: 0 in 0.449s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:39 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0fe37db8-916e-4521-8f72-73003c13994a_0glc9jgm {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:40 devstack sudo[90026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0fe37db8-916e-4521-8f72-73003c13994a_0glc9jgm
Apr 15 16:00:40 devstack sudo[90026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:40 devstack sudo[90026]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:40 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0fe37db8-916e-4521-8f72-73003c13994a_0glc9jgm" returned: 1 in 0.462s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:40 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0fe37db8-916e-4521-8f72-73003c13994a_0glc9jgm' failed. Not Retrying. {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 16:00:40 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8ee911-3ce8-43ea-b4bb-17715bfbeb15]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:00:40 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fe37db8-916e-4521-8f72-73003c13994a_fnug7zwddevstack@QuobyteHD {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:40 devstack sudo[90030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fe37db8-916e-4521-8f72-73003c13994a_fnug7zwddevstack@QuobyteHD
Apr 15 16:00:40 devstack sudo[90030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:40 devstack sudo[90030]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:40 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fe37db8-916e-4521-8f72-73003c13994a_fnug7zwddevstack@QuobyteHD" returned: 0 in 0.455s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:40 devstack cinder-volume[82485]: DEBUG cinder.image.image_utils [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] 0fe37db8-916e-4521-8f72-73003c13994a was qcow2, converting to raw {{(pid=82485) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 15 16:00:40 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0fe37db8-916e-4521-8f72-73003c13994a_fnug7zwddevstack@QuobyteHD /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-33ae4d4d-a2ad-46b1-b2e8-7ae095a23f1c {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:40 devstack sudo[90035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0fe37db8-916e-4521-8f72-73003c13994a_fnug7zwddevstack@QuobyteHD /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-33ae4d4d-a2ad-46b1-b2e8-7ae095a23f1c
Apr 15 16:00:40 devstack sudo[90035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:41 devstack sudo[90035]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:41 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0fe37db8-916e-4521-8f72-73003c13994a_fnug7zwddevstack@QuobyteHD /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-33ae4d4d-a2ad-46b1-b2e8-7ae095a23f1c" returned: 0 in 0.886s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:41 devstack cinder-volume[82485]: DEBUG cinder.image.image_utils [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0fe37db8-916e-4521-8f72-73003c13994a_fnug7zwddevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-33ae4d4d-a2ad-46b1-b2e8-7ae095a23f1c {{(pid=82485) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 16:00:41 devstack cinder-volume[82485]: INFO cinder.image.image_utils [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] Converted 112.00 MB image at 112.00 MB/s
Apr 15 16:00:41 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-33ae4d4d-a2ad-46b1-b2e8-7ae095a23f1c 1G {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:41 devstack sudo[90083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-33ae4d4d-a2ad-46b1-b2e8-7ae095a23f1c 1G
Apr 15 16:00:41 devstack sudo[90083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:42 devstack sudo[90083]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:42 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-33ae4d4d-a2ad-46b1-b2e8-7ae095a23f1c 1G" returned: 0 in 0.425s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:42 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c7e91cd-a41d-430e-82eb-551d897d5663]: (4, 'raw') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:00:42 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-33ae4d4d-a2ad-46b1-b2e8-7ae095a23f1c {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:42 devstack sudo[90088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-33ae4d4d-a2ad-46b1-b2e8-7ae095a23f1c
Apr 15 16:00:42 devstack sudo[90088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:42 devstack sudo[90088]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:42 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-33ae4d4d-a2ad-46b1-b2e8-7ae095a23f1c" returned: 0 in 0.473s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:42 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-33ae4d4d-a2ad-46b1-b2e8-7ae095a23f1c {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:42 devstack sudo[90092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-33ae4d4d-a2ad-46b1-b2e8-7ae095a23f1c
Apr 15 16:00:42 devstack sudo[90092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:43 devstack sudo[90092]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:43 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-33ae4d4d-a2ad-46b1-b2e8-7ae095a23f1c" returned: 1 in 0.460s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:43 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-33ae4d4d-a2ad-46b1-b2e8-7ae095a23f1c' failed. Not Retrying. {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 16:00:43 devstack cinder-volume[82485]: DEBUG cinder.volume.volume_utils [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] Downloaded image 0fe37db8-916e-4521-8f72-73003c13994a ((None, [{'url': 'file:///opt/stack/data/glance/images/0fe37db8-916e-4521-8f72-73003c13994a', 'metadata': {}}])) to volume 33ae4d4d-a2ad-46b1-b2e8-7ae095a23f1c successfully. {{(pid=82485) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 15 16:00:43 devstack cinder-volume[82485]: DEBUG cinder.image.image_utils [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] Temporary image 0fe37db8-916e-4521-8f72-73003c13994a for user e7edf2cd1a3147a89d74ea17b48d54c1 is deleted. {{(pid=82485) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 15 16:00:43 devstack cinder-volume[82485]: DEBUG cinder.volume.volume_utils [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] Marking volume 33ae4d4d-a2ad-46b1-b2e8-7ae095a23f1c as bootable. {{(pid=82485) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 15 16:00:43 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] Copying metadata from image 0fe37db8-916e-4521-8f72-73003c13994a to 33ae4d4d-a2ad-46b1-b2e8-7ae095a23f1c. {{(pid=82485) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 15 16:00:43 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] Creating volume glance metadata for volume 33ae4d4d-a2ad-46b1-b2e8-7ae095a23f1c backed by image 0fe37db8-916e-4521-8f72-73003c13994a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0fe37db8-916e-4521-8f72-73003c13994a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82485) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 15 16:00:43 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad4bdfba-b491-4dbe-b066-9a0363edb1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33ae4d4d-a2ad-46b1-b2e8-7ae095a23f1c', 'volume_size': 1, 'image_id': '0fe37db8-916e-4521-8f72-73003c13994a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0fe37db8-916e-4521-8f72-73003c13994a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '57491fc0e71d4fad9011d017ccefe515', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0fe37db8-916e-4521-8f72-73003c13994a', 'created_at': datetime.datetime(2026, 4, 15, 13, 47, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 13, 47, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0fe37db8-916e-4521-8f72-73003c13994a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f1549cac550>}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:43 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edb1a056-d266-4bb2-a3dc-8c1e921a1207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:43 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] Volume volume-33ae4d4d-a2ad-46b1-b2e8-7ae095a23f1c (33ae4d4d-a2ad-46b1-b2e8-7ae095a23f1c): created successfully
Apr 15 16:00:43 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edb1a056-d266-4bb2-a3dc-8c1e921a1207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:43 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] Flow 'volume_create_manager' (50c31f0b-4d19-4670-b75e-c94e5582d64c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:00:43 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-db3f12d7-4a7a-4f59-b952-400b0d71ae95 tempest-VolumesGetTest-1217066466 None] Created volume successfully.
Apr 15 16:00:43 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1775165-8ec5-40d3-b882-1d9fd9e3f622 tempest-VolumesGetTest-1217066466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:00:43 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-f1775165-8ec5-40d3-b882-1d9fd9e3f622 tempest-VolumesGetTest-1217066466 None] Flow 'volume_create_manager' (60e4d5c2-a4d7-4e73-b397-8adf7685f778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:00:43 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-f1775165-8ec5-40d3-b882-1d9fd9e3f622 tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a7a4ac7-daeb-4225-a681-390fd174527c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:43 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-f1775165-8ec5-40d3-b882-1d9fd9e3f622 tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a7a4ac7-daeb-4225-a681-390fd174527c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:00:44Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-651524715',display_name='tempest-VolumesGetTest-Volume-1176800249',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73ea4650-cca5-4f8c-8dd4-522eba13f15f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7fb9f4edec34dd2b9586b03209ea693',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:00:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:00:44Z,use_quota=True,user_id='e7edf2cd1a3147a89d74ea17b48d54c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:43 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-f1775165-8ec5-40d3-b882-1d9fd9e3f622 tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88ebf3b6-983e-43d2-89fe-80daf7214d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:43 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-f1775165-8ec5-40d3-b882-1d9fd9e3f622 tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88ebf3b6-983e-43d2-89fe-80daf7214d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:43 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-f1775165-8ec5-40d3-b882-1d9fd9e3f622 tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa959456-28c3-487d-b945-f2de50abf077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:43 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-f1775165-8ec5-40d3-b882-1d9fd9e3f622 tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa959456-28c3-487d-b945-f2de50abf077) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73ea4650-cca5-4f8c-8dd4-522eba13f15f', 'volume_name': 'volume-73ea4650-cca5-4f8c-8dd4-522eba13f15f', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:43 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-f1775165-8ec5-40d3-b882-1d9fd9e3f622 tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c21f10ce-1baa-4604-947f-bad9b9af8026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:43 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-f1775165-8ec5-40d3-b882-1d9fd9e3f622 tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c21f10ce-1baa-4604-947f-bad9b9af8026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:43 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-f1775165-8ec5-40d3-b882-1d9fd9e3f622 tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88b1ee05-f628-426f-b4a2-d20c1cd2a1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:43 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-f1775165-8ec5-40d3-b882-1d9fd9e3f622 tempest-VolumesGetTest-1217066466 None] Volume 73ea4650-cca5-4f8c-8dd4-522eba13f15f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73ea4650-cca5-4f8c-8dd4-522eba13f15f', 'volume_size': 1}
Apr 15 16:00:43 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-f1775165-8ec5-40d3-b882-1d9fd9e3f622 tempest-VolumesGetTest-1217066466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:00:43 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-f1775165-8ec5-40d3-b882-1d9fd9e3f622 tempest-VolumesGetTest-1217066466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:00:43 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-f1775165-8ec5-40d3-b882-1d9fd9e3f622 tempest-VolumesGetTest-1217066466 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:00:44Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-651524715',display_name='tempest-VolumesGetTest-Volume-1176800249',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73ea4650-cca5-4f8c-8dd4-522eba13f15f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7fb9f4edec34dd2b9586b03209ea693',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:00:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:00:44Z,use_quota=True,user_id='e7edf2cd1a3147a89d74ea17b48d54c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:00:43 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-f1775165-8ec5-40d3-b882-1d9fd9e3f622 tempest-VolumesGetTest-1217066466 None] Creating volume 73ea4650-cca5-4f8c-8dd4-522eba13f15f {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:00:43 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-f1775165-8ec5-40d3-b882-1d9fd9e3f622 tempest-VolumesGetTest-1217066466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:00:43 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-f1775165-8ec5-40d3-b882-1d9fd9e3f622 tempest-VolumesGetTest-1217066466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:00:43 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-f1775165-8ec5-40d3-b882-1d9fd9e3f622 tempest-VolumesGetTest-1217066466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:00:43 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-f1775165-8ec5-40d3-b882-1d9fd9e3f622 tempest-VolumesGetTest-1217066466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:00:43 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-f1775165-8ec5-40d3-b882-1d9fd9e3f622 tempest-VolumesGetTest-1217066466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:00:43 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-f1775165-8ec5-40d3-b882-1d9fd9e3f622 tempest-VolumesGetTest-1217066466 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:00:43 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-f1775165-8ec5-40d3-b882-1d9fd9e3f622 tempest-VolumesGetTest-1217066466 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 16:00:43 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-f1775165-8ec5-40d3-b882-1d9fd9e3f622 tempest-VolumesGetTest-1217066466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-73ea4650-cca5-4f8c-8dd4-522eba13f15f 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:43 devstack sudo[90097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-73ea4650-cca5-4f8c-8dd4-522eba13f15f 1073741824
Apr 15 16:00:43 devstack sudo[90097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:44 devstack sudo[90097]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-f1775165-8ec5-40d3-b882-1d9fd9e3f622 tempest-VolumesGetTest-1217066466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-73ea4650-cca5-4f8c-8dd4-522eba13f15f 1073741824" returned: 0 in 0.494s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-f1775165-8ec5-40d3-b882-1d9fd9e3f622 tempest-VolumesGetTest-1217066466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-73ea4650-cca5-4f8c-8dd4-522eba13f15f {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:44 devstack sudo[90102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-73ea4650-cca5-4f8c-8dd4-522eba13f15f
Apr 15 16:00:44 devstack sudo[90102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:44 devstack cinder-volume[82485]: DEBUG oslo_service.periodic_task [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82485) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 15 16:00:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:00:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:00:44 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:00:44 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:00:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:00:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:44 devstack sudo[90104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 16:00:44 devstack sudo[90104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:44 devstack sudo[90102]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-f1775165-8ec5-40d3-b882-1d9fd9e3f622 tempest-VolumesGetTest-1217066466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-73ea4650-cca5-4f8c-8dd4-522eba13f15f" returned: 0 in 0.407s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:44 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-f1775165-8ec5-40d3-b882-1d9fd9e3f622 tempest-VolumesGetTest-1217066466 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:00:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-f1775165-8ec5-40d3-b882-1d9fd9e3f622 tempest-VolumesGetTest-1217066466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:00:44 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-f1775165-8ec5-40d3-b882-1d9fd9e3f622 tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88b1ee05-f628-426f-b4a2-d20c1cd2a1cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73ea4650-cca5-4f8c-8dd4-522eba13f15f', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:44 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-f1775165-8ec5-40d3-b882-1d9fd9e3f622 tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f745c384-6085-405b-b3d8-12c59eea1a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:44 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-f1775165-8ec5-40d3-b882-1d9fd9e3f622 tempest-VolumesGetTest-1217066466 None] Volume volume-73ea4650-cca5-4f8c-8dd4-522eba13f15f (73ea4650-cca5-4f8c-8dd4-522eba13f15f): created successfully
Apr 15 16:00:44 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-f1775165-8ec5-40d3-b882-1d9fd9e3f622 tempest-VolumesGetTest-1217066466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f745c384-6085-405b-b3d8-12c59eea1a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:44 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-f1775165-8ec5-40d3-b882-1d9fd9e3f622 tempest-VolumesGetTest-1217066466 None] Flow 'volume_create_manager' (60e4d5c2-a4d7-4e73-b397-8adf7685f778) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:00:44 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-f1775165-8ec5-40d3-b882-1d9fd9e3f622 tempest-VolumesGetTest-1217066466 None] Created volume successfully.
Apr 15 16:00:44 devstack sudo[90104]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.419s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:44 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:00:45 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-af825b3d-e183-46ce-a385-5f6445f42657 tempest-VolumesGetTest-1217066466 None] Acquiring lock "cinder-73ea4650-cca5-4f8c-8dd4-522eba13f15f-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:00:45 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-af825b3d-e183-46ce-a385-5f6445f42657 tempest-VolumesGetTest-1217066466 None] Lock "cinder-73ea4650-cca5-4f8c-8dd4-522eba13f15f-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:00:46 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-af825b3d-e183-46ce-a385-5f6445f42657 tempest-VolumesGetTest-1217066466 None] Acquiring lock "cinder-quobyte-73ea4650-cca5-4f8c-8dd4-522eba13f15f" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:00:46 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-af825b3d-e183-46ce-a385-5f6445f42657 tempest-VolumesGetTest-1217066466 None] Lock "cinder-quobyte-73ea4650-cca5-4f8c-8dd4-522eba13f15f" acquired by "delete_volume" :: waited 0.009s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:00:46 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9161ee-322e-442b-b554-3ea3b846c7cb]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:00:46 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-af825b3d-e183-46ce-a385-5f6445f42657 tempest-VolumesGetTest-1217066466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-73ea4650-cca5-4f8c-8dd4-522eba13f15f {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:46 devstack sudo[90109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-73ea4650-cca5-4f8c-8dd4-522eba13f15f
Apr 15 16:00:46 devstack sudo[90109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:46 devstack sudo[90109]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:46 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-af825b3d-e183-46ce-a385-5f6445f42657 tempest-VolumesGetTest-1217066466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-73ea4650-cca5-4f8c-8dd4-522eba13f15f" returned: 0 in 0.456s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:46 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-af825b3d-e183-46ce-a385-5f6445f42657 tempest-VolumesGetTest-1217066466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-73ea4650-cca5-4f8c-8dd4-522eba13f15f {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:46 devstack sudo[90114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-73ea4650-cca5-4f8c-8dd4-522eba13f15f
Apr 15 16:00:46 devstack sudo[90114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:46 devstack sudo[90114]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:46 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-af825b3d-e183-46ce-a385-5f6445f42657 tempest-VolumesGetTest-1217066466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-73ea4650-cca5-4f8c-8dd4-522eba13f15f" returned: 0 in 0.399s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:46 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-af825b3d-e183-46ce-a385-5f6445f42657 tempest-VolumesGetTest-1217066466 None] Lock "cinder-quobyte-73ea4650-cca5-4f8c-8dd4-522eba13f15f" released by "delete_volume" :: held 0.878s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:00:46 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-af825b3d-e183-46ce-a385-5f6445f42657 tempest-VolumesGetTest-1217066466 None] Created reservations ['44156d7f-d609-4fc7-a252-14b57b7bfde4', '56622c07-b0f1-4378-b090-40f9e136c889', '801bdca5-cee2-46d4-a97b-2f53a4573d89', '119f41e0-5732-4021-b353-d5894f009adc'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:00:46 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-af825b3d-e183-46ce-a385-5f6445f42657 tempest-VolumesGetTest-1217066466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:00:46 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-af825b3d-e183-46ce-a385-5f6445f42657 tempest-VolumesGetTest-1217066466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:00:46 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-af825b3d-e183-46ce-a385-5f6445f42657 tempest-VolumesGetTest-1217066466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:00:46 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-af825b3d-e183-46ce-a385-5f6445f42657 tempest-VolumesGetTest-1217066466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:00:46 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-af825b3d-e183-46ce-a385-5f6445f42657 tempest-VolumesGetTest-1217066466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:00:46 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-af825b3d-e183-46ce-a385-5f6445f42657 tempest-VolumesGetTest-1217066466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:46 devstack sudo[90117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 16:00:46 devstack sudo[90117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:47 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-f73afb82-65e2-490d-89b1-4db343c74978 tempest-VolumesGetTest-1217066466 None] Acquiring lock "cinder-33ae4d4d-a2ad-46b1-b2e8-7ae095a23f1c-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:00:47 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-f73afb82-65e2-490d-89b1-4db343c74978 tempest-VolumesGetTest-1217066466 None] Lock "cinder-33ae4d4d-a2ad-46b1-b2e8-7ae095a23f1c-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:00:47 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-f73afb82-65e2-490d-89b1-4db343c74978 tempest-VolumesGetTest-1217066466 None] Acquiring lock "cinder-quobyte-33ae4d4d-a2ad-46b1-b2e8-7ae095a23f1c" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:00:47 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-f73afb82-65e2-490d-89b1-4db343c74978 tempest-VolumesGetTest-1217066466 None] Lock "cinder-quobyte-33ae4d4d-a2ad-46b1-b2e8-7ae095a23f1c" acquired by "delete_volume" :: waited 0.016s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:00:47 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57dd236-c8ed-47d0-9152-2dfbca311c2f]: (4, 'raw') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:00:47 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-f73afb82-65e2-490d-89b1-4db343c74978 tempest-VolumesGetTest-1217066466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-33ae4d4d-a2ad-46b1-b2e8-7ae095a23f1c {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:47 devstack sudo[90119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-33ae4d4d-a2ad-46b1-b2e8-7ae095a23f1c
Apr 15 16:00:47 devstack sudo[90119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:47 devstack sudo[90117]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:47 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-af825b3d-e183-46ce-a385-5f6445f42657 tempest-VolumesGetTest-1217066466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.436s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:47 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-af825b3d-e183-46ce-a385-5f6445f42657 tempest-VolumesGetTest-1217066466 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:00:47 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-af825b3d-e183-46ce-a385-5f6445f42657 tempest-VolumesGetTest-1217066466 None] Deleted volume successfully.
Apr 15 16:00:47 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-af825b3d-e183-46ce-a385-5f6445f42657 tempest-VolumesGetTest-1217066466 None] Lock "cinder-73ea4650-cca5-4f8c-8dd4-522eba13f15f-delete_volume" released by "delete_volume" :: held 1.441s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:00:47 devstack sudo[90119]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:47 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-f73afb82-65e2-490d-89b1-4db343c74978 tempest-VolumesGetTest-1217066466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-33ae4d4d-a2ad-46b1-b2e8-7ae095a23f1c" returned: 0 in 0.462s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:47 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-f73afb82-65e2-490d-89b1-4db343c74978 tempest-VolumesGetTest-1217066466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-33ae4d4d-a2ad-46b1-b2e8-7ae095a23f1c {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:47 devstack sudo[90124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-33ae4d4d-a2ad-46b1-b2e8-7ae095a23f1c
Apr 15 16:00:47 devstack sudo[90124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:48 devstack sudo[90124]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:48 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-f73afb82-65e2-490d-89b1-4db343c74978 tempest-VolumesGetTest-1217066466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-33ae4d4d-a2ad-46b1-b2e8-7ae095a23f1c" returned: 1 in 0.447s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:48 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-f73afb82-65e2-490d-89b1-4db343c74978 tempest-VolumesGetTest-1217066466 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-33ae4d4d-a2ad-46b1-b2e8-7ae095a23f1c' failed. Not Retrying. {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 16:00:48 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-f73afb82-65e2-490d-89b1-4db343c74978 tempest-VolumesGetTest-1217066466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-33ae4d4d-a2ad-46b1-b2e8-7ae095a23f1c {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:48 devstack sudo[90129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-33ae4d4d-a2ad-46b1-b2e8-7ae095a23f1c
Apr 15 16:00:48 devstack sudo[90129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:48 devstack sudo[90129]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:48 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-f73afb82-65e2-490d-89b1-4db343c74978 tempest-VolumesGetTest-1217066466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-33ae4d4d-a2ad-46b1-b2e8-7ae095a23f1c" returned: 0 in 0.402s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:48 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-f73afb82-65e2-490d-89b1-4db343c74978 tempest-VolumesGetTest-1217066466 None] Lock "cinder-quobyte-33ae4d4d-a2ad-46b1-b2e8-7ae095a23f1c" released by "delete_volume" :: held 1.364s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:00:48 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-f73afb82-65e2-490d-89b1-4db343c74978 tempest-VolumesGetTest-1217066466 None] Created reservations ['f1f9d3f9-1d94-490e-b6fb-0faf7b71803f', '1d8bb138-2243-48a6-9778-25d3223f08f8', '9639863f-154f-495d-84d1-840357cdb1b2', '0f398a48-f48b-4613-8455-69cf1f45baa7'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:00:48 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-f73afb82-65e2-490d-89b1-4db343c74978 tempest-VolumesGetTest-1217066466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:00:48 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-f73afb82-65e2-490d-89b1-4db343c74978 tempest-VolumesGetTest-1217066466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:00:48 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-f73afb82-65e2-490d-89b1-4db343c74978 tempest-VolumesGetTest-1217066466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:00:48 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-f73afb82-65e2-490d-89b1-4db343c74978 tempest-VolumesGetTest-1217066466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:00:48 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-f73afb82-65e2-490d-89b1-4db343c74978 tempest-VolumesGetTest-1217066466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:00:48 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-f73afb82-65e2-490d-89b1-4db343c74978 tempest-VolumesGetTest-1217066466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:48 devstack sudo[90132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 16:00:48 devstack sudo[90132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:49 devstack sudo[90132]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:49 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-f73afb82-65e2-490d-89b1-4db343c74978 tempest-VolumesGetTest-1217066466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.420s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:49 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-f73afb82-65e2-490d-89b1-4db343c74978 tempest-VolumesGetTest-1217066466 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:00:49 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-f73afb82-65e2-490d-89b1-4db343c74978 tempest-VolumesGetTest-1217066466 None] Deleted volume successfully.
Apr 15 16:00:49 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-f73afb82-65e2-490d-89b1-4db343c74978 tempest-VolumesGetTest-1217066466 None] Lock "cinder-33ae4d4d-a2ad-46b1-b2e8-7ae095a23f1c-delete_volume" released by "delete_volume" :: held 1.927s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:00:50 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-71cb9faa-17d0-41d7-b67d-5c3a81b4e677 tempest-CreateVolumesFromSnapshotTest-476429753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:00:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-71cb9faa-17d0-41d7-b67d-5c3a81b4e677 tempest-CreateVolumesFromSnapshotTest-476429753 None] Flow 'volume_create_manager' (ce60fceb-4b3f-46b3-8f41-c69d6e0b072d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:00:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-71cb9faa-17d0-41d7-b67d-5c3a81b4e677 tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd2d8d5f-b30a-4c05-8013-695db815ce24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-71cb9faa-17d0-41d7-b67d-5c3a81b4e677 tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd2d8d5f-b30a-4c05-8013-695db815ce24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1422279763',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8233e52a-ed17-47b2-a8ba-ea24fcbdbb96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f4f2a5148284c95a8d197abd2a46434',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:00:51Z,use_quota=True,user_id='431190175ed04aa3bd5538bd0a33f09b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-71cb9faa-17d0-41d7-b67d-5c3a81b4e677 tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abe89571-b5d7-4c12-81cf-bd48d3f3a3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-71cb9faa-17d0-41d7-b67d-5c3a81b4e677 tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abe89571-b5d7-4c12-81cf-bd48d3f3a3ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-71cb9faa-17d0-41d7-b67d-5c3a81b4e677 tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81f694fa-221f-4c86-934d-dab6fe07cb10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-71cb9faa-17d0-41d7-b67d-5c3a81b4e677 tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81f694fa-221f-4c86-934d-dab6fe07cb10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8233e52a-ed17-47b2-a8ba-ea24fcbdbb96', 'volume_name': 'volume-8233e52a-ed17-47b2-a8ba-ea24fcbdbb96', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-71cb9faa-17d0-41d7-b67d-5c3a81b4e677 tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2ec9ad2-366f-47fd-ae78-2ff89b3c010f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-71cb9faa-17d0-41d7-b67d-5c3a81b4e677 tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2ec9ad2-366f-47fd-ae78-2ff89b3c010f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-71cb9faa-17d0-41d7-b67d-5c3a81b4e677 tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82450901-08b7-478b-8722-ee865353d6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:50 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-71cb9faa-17d0-41d7-b67d-5c3a81b4e677 tempest-CreateVolumesFromSnapshotTest-476429753 None] Volume 8233e52a-ed17-47b2-a8ba-ea24fcbdbb96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8233e52a-ed17-47b2-a8ba-ea24fcbdbb96', 'volume_size': 1}
Apr 15 16:00:50 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-71cb9faa-17d0-41d7-b67d-5c3a81b4e677 tempest-CreateVolumesFromSnapshotTest-476429753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:00:50 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-71cb9faa-17d0-41d7-b67d-5c3a81b4e677 tempest-CreateVolumesFromSnapshotTest-476429753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:00:50 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-71cb9faa-17d0-41d7-b67d-5c3a81b4e677 tempest-CreateVolumesFromSnapshotTest-476429753 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1422279763',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8233e52a-ed17-47b2-a8ba-ea24fcbdbb96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f4f2a5148284c95a8d197abd2a46434',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:00:51Z,use_quota=True,user_id='431190175ed04aa3bd5538bd0a33f09b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:00:50 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-71cb9faa-17d0-41d7-b67d-5c3a81b4e677 tempest-CreateVolumesFromSnapshotTest-476429753 None] Creating volume 8233e52a-ed17-47b2-a8ba-ea24fcbdbb96 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:00:50 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-71cb9faa-17d0-41d7-b67d-5c3a81b4e677 tempest-CreateVolumesFromSnapshotTest-476429753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:00:50 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-71cb9faa-17d0-41d7-b67d-5c3a81b4e677 tempest-CreateVolumesFromSnapshotTest-476429753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:00:50 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-71cb9faa-17d0-41d7-b67d-5c3a81b4e677 tempest-CreateVolumesFromSnapshotTest-476429753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:00:50 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-71cb9faa-17d0-41d7-b67d-5c3a81b4e677 tempest-CreateVolumesFromSnapshotTest-476429753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:00:50 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-71cb9faa-17d0-41d7-b67d-5c3a81b4e677 tempest-CreateVolumesFromSnapshotTest-476429753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:00:50 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-71cb9faa-17d0-41d7-b67d-5c3a81b4e677 tempest-CreateVolumesFromSnapshotTest-476429753 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:00:50 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-71cb9faa-17d0-41d7-b67d-5c3a81b4e677 tempest-CreateVolumesFromSnapshotTest-476429753 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 16:00:50 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-71cb9faa-17d0-41d7-b67d-5c3a81b4e677 tempest-CreateVolumesFromSnapshotTest-476429753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8233e52a-ed17-47b2-a8ba-ea24fcbdbb96 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:50 devstack sudo[90136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8233e52a-ed17-47b2-a8ba-ea24fcbdbb96 1073741824
Apr 15 16:00:50 devstack sudo[90136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:51 devstack sudo[90136]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:51 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-71cb9faa-17d0-41d7-b67d-5c3a81b4e677 tempest-CreateVolumesFromSnapshotTest-476429753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8233e52a-ed17-47b2-a8ba-ea24fcbdbb96 1073741824" returned: 0 in 0.478s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:51 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-71cb9faa-17d0-41d7-b67d-5c3a81b4e677 tempest-CreateVolumesFromSnapshotTest-476429753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8233e52a-ed17-47b2-a8ba-ea24fcbdbb96 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:51 devstack sudo[90141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8233e52a-ed17-47b2-a8ba-ea24fcbdbb96
Apr 15 16:00:51 devstack sudo[90141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:51 devstack sudo[90141]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:51 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-71cb9faa-17d0-41d7-b67d-5c3a81b4e677 tempest-CreateVolumesFromSnapshotTest-476429753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8233e52a-ed17-47b2-a8ba-ea24fcbdbb96" returned: 0 in 0.441s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:51 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-71cb9faa-17d0-41d7-b67d-5c3a81b4e677 tempest-CreateVolumesFromSnapshotTest-476429753 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:00:51 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-71cb9faa-17d0-41d7-b67d-5c3a81b4e677 tempest-CreateVolumesFromSnapshotTest-476429753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:00:51 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-71cb9faa-17d0-41d7-b67d-5c3a81b4e677 tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82450901-08b7-478b-8722-ee865353d6dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8233e52a-ed17-47b2-a8ba-ea24fcbdbb96', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:51 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-71cb9faa-17d0-41d7-b67d-5c3a81b4e677 tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f7c2737-d3ee-46a7-9ccd-37716b0a2106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:51 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-71cb9faa-17d0-41d7-b67d-5c3a81b4e677 tempest-CreateVolumesFromSnapshotTest-476429753 None] Volume volume-8233e52a-ed17-47b2-a8ba-ea24fcbdbb96 (8233e52a-ed17-47b2-a8ba-ea24fcbdbb96): created successfully
Apr 15 16:00:51 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-71cb9faa-17d0-41d7-b67d-5c3a81b4e677 tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f7c2737-d3ee-46a7-9ccd-37716b0a2106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:51 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-71cb9faa-17d0-41d7-b67d-5c3a81b4e677 tempest-CreateVolumesFromSnapshotTest-476429753 None] Flow 'volume_create_manager' (ce60fceb-4b3f-46b3-8f41-c69d6e0b072d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:00:51 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-71cb9faa-17d0-41d7-b67d-5c3a81b4e677 tempest-CreateVolumesFromSnapshotTest-476429753 None] Created volume successfully.
Apr 15 16:00:53 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-803ac482-b8c0-44be-a212-a9d4992c12f6 tempest-CreateVolumesFromSnapshotTest-476429753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:00:53 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-803ac482-b8c0-44be-a212-a9d4992c12f6 tempest-CreateVolumesFromSnapshotTest-476429753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:00:53 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-803ac482-b8c0-44be-a212-a9d4992c12f6 tempest-CreateVolumesFromSnapshotTest-476429753 None] Creating offline snapshot 70779a89-0afd-4b0a-89fc-43d1afe85270 of volume 8233e52a-ed17-47b2-a8ba-ea24fcbdbb96 {{(pid=82485) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 16:00:53 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1bcb0e6-db8b-4ba4-8718-5071f6ffcd94]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:00:53 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-803ac482-b8c0-44be-a212-a9d4992c12f6 tempest-CreateVolumesFromSnapshotTest-476429753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8233e52a-ed17-47b2-a8ba-ea24fcbdbb96 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:53 devstack sudo[90144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8233e52a-ed17-47b2-a8ba-ea24fcbdbb96
Apr 15 16:00:53 devstack sudo[90144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:53 devstack sudo[90144]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:53 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-803ac482-b8c0-44be-a212-a9d4992c12f6 tempest-CreateVolumesFromSnapshotTest-476429753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8233e52a-ed17-47b2-a8ba-ea24fcbdbb96" returned: 0 in 0.463s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:53 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-803ac482-b8c0-44be-a212-a9d4992c12f6 tempest-CreateVolumesFromSnapshotTest-476429753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8233e52a-ed17-47b2-a8ba-ea24fcbdbb96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8233e52a-ed17-47b2-a8ba-ea24fcbdbb96.70779a89-0afd-4b0a-89fc-43d1afe85270 1G {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:53 devstack sudo[90149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8233e52a-ed17-47b2-a8ba-ea24fcbdbb96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8233e52a-ed17-47b2-a8ba-ea24fcbdbb96.70779a89-0afd-4b0a-89fc-43d1afe85270 1G
Apr 15 16:00:53 devstack sudo[90149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:54 devstack sudo[90149]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-803ac482-b8c0-44be-a212-a9d4992c12f6 tempest-CreateVolumesFromSnapshotTest-476429753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8233e52a-ed17-47b2-a8ba-ea24fcbdbb96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8233e52a-ed17-47b2-a8ba-ea24fcbdbb96.70779a89-0afd-4b0a-89fc-43d1afe85270 1G" returned: 0 in 0.464s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-803ac482-b8c0-44be-a212-a9d4992c12f6 tempest-CreateVolumesFromSnapshotTest-476429753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8233e52a-ed17-47b2-a8ba-ea24fcbdbb96 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8233e52a-ed17-47b2-a8ba-ea24fcbdbb96.70779a89-0afd-4b0a-89fc-43d1afe85270 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:54 devstack sudo[90154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8233e52a-ed17-47b2-a8ba-ea24fcbdbb96 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8233e52a-ed17-47b2-a8ba-ea24fcbdbb96.70779a89-0afd-4b0a-89fc-43d1afe85270
Apr 15 16:00:54 devstack sudo[90154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:54 devstack sudo[90154]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-803ac482-b8c0-44be-a212-a9d4992c12f6 tempest-CreateVolumesFromSnapshotTest-476429753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8233e52a-ed17-47b2-a8ba-ea24fcbdbb96 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8233e52a-ed17-47b2-a8ba-ea24fcbdbb96.70779a89-0afd-4b0a-89fc-43d1afe85270" returned: 0 in 0.427s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:54 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-803ac482-b8c0-44be-a212-a9d4992c12f6 tempest-CreateVolumesFromSnapshotTest-476429753 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8233e52a-ed17-47b2-a8ba-ea24fcbdbb96.70779a89-0afd-4b0a-89fc-43d1afe85270 is being set with open permissions: ugo+rw
Apr 15 16:00:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-803ac482-b8c0-44be-a212-a9d4992c12f6 tempest-CreateVolumesFromSnapshotTest-476429753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8233e52a-ed17-47b2-a8ba-ea24fcbdbb96.70779a89-0afd-4b0a-89fc-43d1afe85270 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:54 devstack sudo[90159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8233e52a-ed17-47b2-a8ba-ea24fcbdbb96.70779a89-0afd-4b0a-89fc-43d1afe85270
Apr 15 16:00:54 devstack sudo[90159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:54 devstack sudo[90159]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-803ac482-b8c0-44be-a212-a9d4992c12f6 tempest-CreateVolumesFromSnapshotTest-476429753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8233e52a-ed17-47b2-a8ba-ea24fcbdbb96.70779a89-0afd-4b0a-89fc-43d1afe85270" returned: 0 in 0.407s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-803ac482-b8c0-44be-a212-a9d4992c12f6 tempest-CreateVolumesFromSnapshotTest-476429753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8233e52a-ed17-47b2-a8ba-ea24fcbdbb96.info {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:54 devstack sudo[90163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8233e52a-ed17-47b2-a8ba-ea24fcbdbb96.info
Apr 15 16:00:54 devstack sudo[90163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:55 devstack sudo[90163]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:55 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-803ac482-b8c0-44be-a212-a9d4992c12f6 tempest-CreateVolumesFromSnapshotTest-476429753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8233e52a-ed17-47b2-a8ba-ea24fcbdbb96.info" returned: 0 in 0.423s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:55 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-803ac482-b8c0-44be-a212-a9d4992c12f6 tempest-CreateVolumesFromSnapshotTest-476429753 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8233e52a-ed17-47b2-a8ba-ea24fcbdbb96.info is being set with open permissions: ugo+rw
Apr 15 16:00:55 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-803ac482-b8c0-44be-a212-a9d4992c12f6 tempest-CreateVolumesFromSnapshotTest-476429753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8233e52a-ed17-47b2-a8ba-ea24fcbdbb96.info {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:55 devstack sudo[90166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8233e52a-ed17-47b2-a8ba-ea24fcbdbb96.info
Apr 15 16:00:55 devstack sudo[90166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:55 devstack sudo[90166]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:55 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-803ac482-b8c0-44be-a212-a9d4992c12f6 tempest-CreateVolumesFromSnapshotTest-476429753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8233e52a-ed17-47b2-a8ba-ea24fcbdbb96.info" returned: 0 in 0.410s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:55 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-803ac482-b8c0-44be-a212-a9d4992c12f6 tempest-CreateVolumesFromSnapshotTest-476429753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.654s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:00:55 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-803ac482-b8c0-44be-a212-a9d4992c12f6 tempest-CreateVolumesFromSnapshotTest-476429753 None] Create snapshot completed successfully
Apr 15 16:00:56 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-aac7e1a0-f99a-4b5b-9058-2d713358df6a tempest-CreateVolumesFromSnapshotTest-476429753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:00:56 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-aac7e1a0-f99a-4b5b-9058-2d713358df6a tempest-CreateVolumesFromSnapshotTest-476429753 None] Flow 'volume_create_manager' (ccc8251a-38f4-47ff-bceb-533b186706c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:00:56 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-aac7e1a0-f99a-4b5b-9058-2d713358df6a tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f2fbfc1-9daf-415f-9c8e-2da456c497c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:56 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-aac7e1a0-f99a-4b5b-9058-2d713358df6a tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f2fbfc1-9daf-415f-9c8e-2da456c497c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:00:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-184768854',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a79a062c-70cc-4006-ad9c-b74aed959083,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f4f2a5148284c95a8d197abd2a46434',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:00:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:00:56Z,use_quota=True,user_id='431190175ed04aa3bd5538bd0a33f09b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:56 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-aac7e1a0-f99a-4b5b-9058-2d713358df6a tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (271624f9-bc5a-4c8e-ab29-08cf737d41b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:56 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-aac7e1a0-f99a-4b5b-9058-2d713358df6a tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (271624f9-bc5a-4c8e-ab29-08cf737d41b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:56 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-aac7e1a0-f99a-4b5b-9058-2d713358df6a tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2ff95c1-f0e0-4572-ab74-11531e449cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:56 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-aac7e1a0-f99a-4b5b-9058-2d713358df6a tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2ff95c1-f0e0-4572-ab74-11531e449cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a79a062c-70cc-4006-ad9c-b74aed959083', 'volume_name': 'volume-a79a062c-70cc-4006-ad9c-b74aed959083', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:56 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-aac7e1a0-f99a-4b5b-9058-2d713358df6a tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d534087b-6932-42d5-80ba-db6648c12979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:56 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-aac7e1a0-f99a-4b5b-9058-2d713358df6a tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d534087b-6932-42d5-80ba-db6648c12979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:56 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-aac7e1a0-f99a-4b5b-9058-2d713358df6a tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (383f814a-449a-4853-85c3-15445df6e449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:56 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-aac7e1a0-f99a-4b5b-9058-2d713358df6a tempest-CreateVolumesFromSnapshotTest-476429753 None] Volume a79a062c-70cc-4006-ad9c-b74aed959083: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a79a062c-70cc-4006-ad9c-b74aed959083', 'volume_size': 1}
Apr 15 16:00:56 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-aac7e1a0-f99a-4b5b-9058-2d713358df6a tempest-CreateVolumesFromSnapshotTest-476429753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:00:56 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-aac7e1a0-f99a-4b5b-9058-2d713358df6a tempest-CreateVolumesFromSnapshotTest-476429753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:00:56 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-aac7e1a0-f99a-4b5b-9058-2d713358df6a tempest-CreateVolumesFromSnapshotTest-476429753 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:00:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-184768854',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a79a062c-70cc-4006-ad9c-b74aed959083,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f4f2a5148284c95a8d197abd2a46434',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:00:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:00:56Z,use_quota=True,user_id='431190175ed04aa3bd5538bd0a33f09b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:00:56 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-aac7e1a0-f99a-4b5b-9058-2d713358df6a tempest-CreateVolumesFromSnapshotTest-476429753 None] Creating volume a79a062c-70cc-4006-ad9c-b74aed959083 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:00:56 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-aac7e1a0-f99a-4b5b-9058-2d713358df6a tempest-CreateVolumesFromSnapshotTest-476429753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:00:56 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-aac7e1a0-f99a-4b5b-9058-2d713358df6a tempest-CreateVolumesFromSnapshotTest-476429753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:00:56 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-aac7e1a0-f99a-4b5b-9058-2d713358df6a tempest-CreateVolumesFromSnapshotTest-476429753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:00:56 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-aac7e1a0-f99a-4b5b-9058-2d713358df6a tempest-CreateVolumesFromSnapshotTest-476429753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:00:56 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-aac7e1a0-f99a-4b5b-9058-2d713358df6a tempest-CreateVolumesFromSnapshotTest-476429753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:00:56 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-aac7e1a0-f99a-4b5b-9058-2d713358df6a tempest-CreateVolumesFromSnapshotTest-476429753 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:00:56 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-aac7e1a0-f99a-4b5b-9058-2d713358df6a tempest-CreateVolumesFromSnapshotTest-476429753 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 16:00:56 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-aac7e1a0-f99a-4b5b-9058-2d713358df6a tempest-CreateVolumesFromSnapshotTest-476429753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a79a062c-70cc-4006-ad9c-b74aed959083 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:56 devstack sudo[90171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a79a062c-70cc-4006-ad9c-b74aed959083 1073741824
Apr 15 16:00:56 devstack sudo[90171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:56 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-12e262a5-9d28-4e93-85c0-592ea7c54397 tempest-CreateVolumesFromSnapshotTest-476429753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:00:56 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-12e262a5-9d28-4e93-85c0-592ea7c54397 tempest-CreateVolumesFromSnapshotTest-476429753 None] Flow 'volume_create_manager' (d30e6f53-ac8b-441b-9cd5-50e4095340d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:00:56 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-12e262a5-9d28-4e93-85c0-592ea7c54397 tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bddb7b1-b6ab-4284-ba59-ececfa92c20e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:56 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-12e262a5-9d28-4e93-85c0-592ea7c54397 tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bddb7b1-b6ab-4284-ba59-ececfa92c20e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:00:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1407036011',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2b4e6e6-c5c4-41f4-a6f2-0c1ffade0fb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f4f2a5148284c95a8d197abd2a46434',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:00:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:00:57Z,use_quota=True,user_id='431190175ed04aa3bd5538bd0a33f09b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:56 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-12e262a5-9d28-4e93-85c0-592ea7c54397 tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65e678e2-b5ec-4402-94ff-30084eac1850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:56 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-12e262a5-9d28-4e93-85c0-592ea7c54397 tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65e678e2-b5ec-4402-94ff-30084eac1850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:56 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-12e262a5-9d28-4e93-85c0-592ea7c54397 tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14db166a-a0d4-4586-b7f5-3f10e4cb9cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:56 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-12e262a5-9d28-4e93-85c0-592ea7c54397 tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14db166a-a0d4-4586-b7f5-3f10e4cb9cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2b4e6e6-c5c4-41f4-a6f2-0c1ffade0fb3', 'volume_name': 'volume-a2b4e6e6-c5c4-41f4-a6f2-0c1ffade0fb3', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:56 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-12e262a5-9d28-4e93-85c0-592ea7c54397 tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb11c763-a730-4456-bba1-ac9f9dc822a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:56 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-12e262a5-9d28-4e93-85c0-592ea7c54397 tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb11c763-a730-4456-bba1-ac9f9dc822a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:56 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-12e262a5-9d28-4e93-85c0-592ea7c54397 tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34fee211-0b15-40de-893a-2a350320b68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:56 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-12e262a5-9d28-4e93-85c0-592ea7c54397 tempest-CreateVolumesFromSnapshotTest-476429753 None] Volume a2b4e6e6-c5c4-41f4-a6f2-0c1ffade0fb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2b4e6e6-c5c4-41f4-a6f2-0c1ffade0fb3', 'volume_size': 1}
Apr 15 16:00:56 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-12e262a5-9d28-4e93-85c0-592ea7c54397 tempest-CreateVolumesFromSnapshotTest-476429753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:00:56 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-50466725-25a3-4505-90f4-833007e75af3 tempest-CreateVolumesFromSnapshotTest-476429753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:00:56 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-50466725-25a3-4505-90f4-833007e75af3 tempest-CreateVolumesFromSnapshotTest-476429753 None] Flow 'volume_create_manager' (6ba056b1-124e-482e-8487-024edceb90e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:00:56 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-50466725-25a3-4505-90f4-833007e75af3 tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a49904ca-743c-45e3-9ea2-ad71228f3cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:56 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-50466725-25a3-4505-90f4-833007e75af3 tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a49904ca-743c-45e3-9ea2-ad71228f3cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1116596219',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60cdd2ad-4017-4c2a-a66b-8e319031988b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f4f2a5148284c95a8d197abd2a46434',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:00:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:00:57Z,use_quota=True,user_id='431190175ed04aa3bd5538bd0a33f09b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:56 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-50466725-25a3-4505-90f4-833007e75af3 tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ea6fa36-9f19-4496-9266-76df65414123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:56 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-50466725-25a3-4505-90f4-833007e75af3 tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ea6fa36-9f19-4496-9266-76df65414123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:56 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-50466725-25a3-4505-90f4-833007e75af3 tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (079064d9-2f4e-440f-9644-e14c42801c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:56 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-50466725-25a3-4505-90f4-833007e75af3 tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (079064d9-2f4e-440f-9644-e14c42801c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60cdd2ad-4017-4c2a-a66b-8e319031988b', 'volume_name': 'volume-60cdd2ad-4017-4c2a-a66b-8e319031988b', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:56 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-50466725-25a3-4505-90f4-833007e75af3 tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0364d6d-4542-4387-9136-253473ec301d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:56 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-50466725-25a3-4505-90f4-833007e75af3 tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0364d6d-4542-4387-9136-253473ec301d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:56 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-50466725-25a3-4505-90f4-833007e75af3 tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc009fbe-8d40-47f0-831f-11293feb50b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:56 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-50466725-25a3-4505-90f4-833007e75af3 tempest-CreateVolumesFromSnapshotTest-476429753 None] Volume 60cdd2ad-4017-4c2a-a66b-8e319031988b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60cdd2ad-4017-4c2a-a66b-8e319031988b', 'volume_size': 1}
Apr 15 16:00:56 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-50466725-25a3-4505-90f4-833007e75af3 tempest-CreateVolumesFromSnapshotTest-476429753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:00:56 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-09d0feca-7f15-49a3-8982-135b83d237cb tempest-CreateVolumesFromSnapshotTest-476429753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:00:56 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-09d0feca-7f15-49a3-8982-135b83d237cb tempest-CreateVolumesFromSnapshotTest-476429753 None] Flow 'volume_create_manager' (ba23ecb8-980a-4bde-a0fe-7162ffd5b732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:00:56 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-09d0feca-7f15-49a3-8982-135b83d237cb tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6750ec25-89c1-4a7e-a7d4-feb7791cd772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:56 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-09d0feca-7f15-49a3-8982-135b83d237cb tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6750ec25-89c1-4a7e-a7d4-feb7791cd772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-263878758',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3b74ced-e0b5-480a-8aef-51ce726446db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f4f2a5148284c95a8d197abd2a46434',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:00:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:00:57Z,use_quota=True,user_id='431190175ed04aa3bd5538bd0a33f09b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:56 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-09d0feca-7f15-49a3-8982-135b83d237cb tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2397919a-55d9-4ce7-bd43-fae69813bf40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:56 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-09d0feca-7f15-49a3-8982-135b83d237cb tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2397919a-55d9-4ce7-bd43-fae69813bf40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:56 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-09d0feca-7f15-49a3-8982-135b83d237cb tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec008ffd-82b5-4022-8905-cea189b97cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:56 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-09d0feca-7f15-49a3-8982-135b83d237cb tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec008ffd-82b5-4022-8905-cea189b97cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3b74ced-e0b5-480a-8aef-51ce726446db', 'volume_name': 'volume-e3b74ced-e0b5-480a-8aef-51ce726446db', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:56 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-09d0feca-7f15-49a3-8982-135b83d237cb tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (736b325d-f744-47ed-8c02-70158127cd78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:56 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-09d0feca-7f15-49a3-8982-135b83d237cb tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (736b325d-f744-47ed-8c02-70158127cd78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:57 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-09d0feca-7f15-49a3-8982-135b83d237cb tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7b7c22c-7d44-4149-84b9-c55317450a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:57 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-09d0feca-7f15-49a3-8982-135b83d237cb tempest-CreateVolumesFromSnapshotTest-476429753 None] Volume e3b74ced-e0b5-480a-8aef-51ce726446db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3b74ced-e0b5-480a-8aef-51ce726446db', 'volume_size': 1}
Apr 15 16:00:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-09d0feca-7f15-49a3-8982-135b83d237cb tempest-CreateVolumesFromSnapshotTest-476429753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:00:57 devstack sudo[90171]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-aac7e1a0-f99a-4b5b-9058-2d713358df6a tempest-CreateVolumesFromSnapshotTest-476429753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a79a062c-70cc-4006-ad9c-b74aed959083 1073741824" returned: 0 in 0.552s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-aac7e1a0-f99a-4b5b-9058-2d713358df6a tempest-CreateVolumesFromSnapshotTest-476429753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a79a062c-70cc-4006-ad9c-b74aed959083 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:57 devstack sudo[90176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a79a062c-70cc-4006-ad9c-b74aed959083
Apr 15 16:00:57 devstack sudo[90176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:57 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-02162baf-1ac5-482f-890c-931ca369e006 tempest-CreateVolumesFromSnapshotTest-476429753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:00:57 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-02162baf-1ac5-482f-890c-931ca369e006 tempest-CreateVolumesFromSnapshotTest-476429753 None] Flow 'volume_create_manager' (c3820493-f90d-4f67-9ec4-62cf930fe348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:00:57 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-02162baf-1ac5-482f-890c-931ca369e006 tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90790fd7-4a9b-4437-a332-40b6b3fbd527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:57 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-02162baf-1ac5-482f-890c-931ca369e006 tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90790fd7-4a9b-4437-a332-40b6b3fbd527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1173637360',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c310236c-707f-48dd-a395-782e258c3f14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f4f2a5148284c95a8d197abd2a46434',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:00:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:00:57Z,use_quota=True,user_id='431190175ed04aa3bd5538bd0a33f09b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:57 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-02162baf-1ac5-482f-890c-931ca369e006 tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d078e666-8c3f-4242-842c-eaf495486f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:57 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-02162baf-1ac5-482f-890c-931ca369e006 tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d078e666-8c3f-4242-842c-eaf495486f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:57 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-02162baf-1ac5-482f-890c-931ca369e006 tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b8ee3d9-f3bf-40fa-9e84-14a7d28a0711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:57 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-02162baf-1ac5-482f-890c-931ca369e006 tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b8ee3d9-f3bf-40fa-9e84-14a7d28a0711) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c310236c-707f-48dd-a395-782e258c3f14', 'volume_name': 'volume-c310236c-707f-48dd-a395-782e258c3f14', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:57 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-02162baf-1ac5-482f-890c-931ca369e006 tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d184746-904d-404a-ad92-35bc694920c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:57 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-02162baf-1ac5-482f-890c-931ca369e006 tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d184746-904d-404a-ad92-35bc694920c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:57 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-02162baf-1ac5-482f-890c-931ca369e006 tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7a06fd4-c771-4379-8a6c-3929966a9e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:57 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-02162baf-1ac5-482f-890c-931ca369e006 tempest-CreateVolumesFromSnapshotTest-476429753 None] Volume c310236c-707f-48dd-a395-782e258c3f14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c310236c-707f-48dd-a395-782e258c3f14', 'volume_size': 1}
Apr 15 16:00:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-02162baf-1ac5-482f-890c-931ca369e006 tempest-CreateVolumesFromSnapshotTest-476429753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:00:57 devstack sudo[90176]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-aac7e1a0-f99a-4b5b-9058-2d713358df6a tempest-CreateVolumesFromSnapshotTest-476429753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a79a062c-70cc-4006-ad9c-b74aed959083" returned: 0 in 0.445s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:57 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-aac7e1a0-f99a-4b5b-9058-2d713358df6a tempest-CreateVolumesFromSnapshotTest-476429753 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:00:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-aac7e1a0-f99a-4b5b-9058-2d713358df6a tempest-CreateVolumesFromSnapshotTest-476429753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:00:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-12e262a5-9d28-4e93-85c0-592ea7c54397 tempest-CreateVolumesFromSnapshotTest-476429753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.840s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:00:57 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-12e262a5-9d28-4e93-85c0-592ea7c54397 tempest-CreateVolumesFromSnapshotTest-476429753 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:00:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1407036011',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2b4e6e6-c5c4-41f4-a6f2-0c1ffade0fb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f4f2a5148284c95a8d197abd2a46434',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:00:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:00:57Z,use_quota=True,user_id='431190175ed04aa3bd5538bd0a33f09b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:00:57 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-12e262a5-9d28-4e93-85c0-592ea7c54397 tempest-CreateVolumesFromSnapshotTest-476429753 None] Creating volume a2b4e6e6-c5c4-41f4-a6f2-0c1ffade0fb3 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:00:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-12e262a5-9d28-4e93-85c0-592ea7c54397 tempest-CreateVolumesFromSnapshotTest-476429753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:00:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-12e262a5-9d28-4e93-85c0-592ea7c54397 tempest-CreateVolumesFromSnapshotTest-476429753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:00:57 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-12e262a5-9d28-4e93-85c0-592ea7c54397 tempest-CreateVolumesFromSnapshotTest-476429753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:00:57 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-12e262a5-9d28-4e93-85c0-592ea7c54397 tempest-CreateVolumesFromSnapshotTest-476429753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:00:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-12e262a5-9d28-4e93-85c0-592ea7c54397 tempest-CreateVolumesFromSnapshotTest-476429753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:00:57 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-12e262a5-9d28-4e93-85c0-592ea7c54397 tempest-CreateVolumesFromSnapshotTest-476429753 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:00:57 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-12e262a5-9d28-4e93-85c0-592ea7c54397 tempest-CreateVolumesFromSnapshotTest-476429753 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 16:00:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-12e262a5-9d28-4e93-85c0-592ea7c54397 tempest-CreateVolumesFromSnapshotTest-476429753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a2b4e6e6-c5c4-41f4-a6f2-0c1ffade0fb3 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:57 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-aac7e1a0-f99a-4b5b-9058-2d713358df6a tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (383f814a-449a-4853-85c3-15445df6e449) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a79a062c-70cc-4006-ad9c-b74aed959083', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:57 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-aac7e1a0-f99a-4b5b-9058-2d713358df6a tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (224c882b-0c92-46ec-9cbd-5d45402b85b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:57 devstack sudo[90179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a2b4e6e6-c5c4-41f4-a6f2-0c1ffade0fb3 1073741824
Apr 15 16:00:57 devstack sudo[90179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:57 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-aac7e1a0-f99a-4b5b-9058-2d713358df6a tempest-CreateVolumesFromSnapshotTest-476429753 None] Volume volume-a79a062c-70cc-4006-ad9c-b74aed959083 (a79a062c-70cc-4006-ad9c-b74aed959083): created successfully
Apr 15 16:00:57 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-aac7e1a0-f99a-4b5b-9058-2d713358df6a tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (224c882b-0c92-46ec-9cbd-5d45402b85b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:57 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-aac7e1a0-f99a-4b5b-9058-2d713358df6a tempest-CreateVolumesFromSnapshotTest-476429753 None] Flow 'volume_create_manager' (ccc8251a-38f4-47ff-bceb-533b186706c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:00:57 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-aac7e1a0-f99a-4b5b-9058-2d713358df6a tempest-CreateVolumesFromSnapshotTest-476429753 None] Created volume successfully.
Apr 15 16:00:57 devstack sudo[90179]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-12e262a5-9d28-4e93-85c0-592ea7c54397 tempest-CreateVolumesFromSnapshotTest-476429753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a2b4e6e6-c5c4-41f4-a6f2-0c1ffade0fb3 1073741824" returned: 0 in 0.479s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-12e262a5-9d28-4e93-85c0-592ea7c54397 tempest-CreateVolumesFromSnapshotTest-476429753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a2b4e6e6-c5c4-41f4-a6f2-0c1ffade0fb3 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:58 devstack sudo[90184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a2b4e6e6-c5c4-41f4-a6f2-0c1ffade0fb3
Apr 15 16:00:58 devstack sudo[90184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:58 devstack sudo[90184]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-12e262a5-9d28-4e93-85c0-592ea7c54397 tempest-CreateVolumesFromSnapshotTest-476429753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a2b4e6e6-c5c4-41f4-a6f2-0c1ffade0fb3" returned: 0 in 0.411s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:58 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-12e262a5-9d28-4e93-85c0-592ea7c54397 tempest-CreateVolumesFromSnapshotTest-476429753 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:00:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-12e262a5-9d28-4e93-85c0-592ea7c54397 tempest-CreateVolumesFromSnapshotTest-476429753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:00:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-50466725-25a3-4505-90f4-833007e75af3 tempest-CreateVolumesFromSnapshotTest-476429753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.533s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:00:58 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-50466725-25a3-4505-90f4-833007e75af3 tempest-CreateVolumesFromSnapshotTest-476429753 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1116596219',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60cdd2ad-4017-4c2a-a66b-8e319031988b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f4f2a5148284c95a8d197abd2a46434',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:00:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:00:57Z,use_quota=True,user_id='431190175ed04aa3bd5538bd0a33f09b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:00:58 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-50466725-25a3-4505-90f4-833007e75af3 tempest-CreateVolumesFromSnapshotTest-476429753 None] Creating volume 60cdd2ad-4017-4c2a-a66b-8e319031988b {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:00:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-50466725-25a3-4505-90f4-833007e75af3 tempest-CreateVolumesFromSnapshotTest-476429753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:00:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-50466725-25a3-4505-90f4-833007e75af3 tempest-CreateVolumesFromSnapshotTest-476429753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:00:58 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-50466725-25a3-4505-90f4-833007e75af3 tempest-CreateVolumesFromSnapshotTest-476429753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:00:58 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-50466725-25a3-4505-90f4-833007e75af3 tempest-CreateVolumesFromSnapshotTest-476429753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:00:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-50466725-25a3-4505-90f4-833007e75af3 tempest-CreateVolumesFromSnapshotTest-476429753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:00:58 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-50466725-25a3-4505-90f4-833007e75af3 tempest-CreateVolumesFromSnapshotTest-476429753 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:00:58 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-50466725-25a3-4505-90f4-833007e75af3 tempest-CreateVolumesFromSnapshotTest-476429753 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 16:00:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-50466725-25a3-4505-90f4-833007e75af3 tempest-CreateVolumesFromSnapshotTest-476429753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-60cdd2ad-4017-4c2a-a66b-8e319031988b 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:58 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-12e262a5-9d28-4e93-85c0-592ea7c54397 tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34fee211-0b15-40de-893a-2a350320b68e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2b4e6e6-c5c4-41f4-a6f2-0c1ffade0fb3', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:58 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-12e262a5-9d28-4e93-85c0-592ea7c54397 tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f68b2e5f-a010-4486-bab0-120d3580bae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:58 devstack sudo[90187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-60cdd2ad-4017-4c2a-a66b-8e319031988b 1073741824
Apr 15 16:00:58 devstack sudo[90187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:58 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-12e262a5-9d28-4e93-85c0-592ea7c54397 tempest-CreateVolumesFromSnapshotTest-476429753 None] Volume volume-a2b4e6e6-c5c4-41f4-a6f2-0c1ffade0fb3 (a2b4e6e6-c5c4-41f4-a6f2-0c1ffade0fb3): created successfully
Apr 15 16:00:58 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-12e262a5-9d28-4e93-85c0-592ea7c54397 tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f68b2e5f-a010-4486-bab0-120d3580bae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:58 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-12e262a5-9d28-4e93-85c0-592ea7c54397 tempest-CreateVolumesFromSnapshotTest-476429753 None] Flow 'volume_create_manager' (d30e6f53-ac8b-441b-9cd5-50e4095340d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:00:58 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-12e262a5-9d28-4e93-85c0-592ea7c54397 tempest-CreateVolumesFromSnapshotTest-476429753 None] Created volume successfully.
Apr 15 16:00:58 devstack sudo[90187]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-50466725-25a3-4505-90f4-833007e75af3 tempest-CreateVolumesFromSnapshotTest-476429753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-60cdd2ad-4017-4c2a-a66b-8e319031988b 1073741824" returned: 0 in 0.509s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-50466725-25a3-4505-90f4-833007e75af3 tempest-CreateVolumesFromSnapshotTest-476429753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-60cdd2ad-4017-4c2a-a66b-8e319031988b {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:58 devstack sudo[90192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-60cdd2ad-4017-4c2a-a66b-8e319031988b
Apr 15 16:00:58 devstack sudo[90192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:59 devstack sudo[90192]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:59 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-50466725-25a3-4505-90f4-833007e75af3 tempest-CreateVolumesFromSnapshotTest-476429753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-60cdd2ad-4017-4c2a-a66b-8e319031988b" returned: 0 in 0.411s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:59 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-50466725-25a3-4505-90f4-833007e75af3 tempest-CreateVolumesFromSnapshotTest-476429753 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:00:59 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-50466725-25a3-4505-90f4-833007e75af3 tempest-CreateVolumesFromSnapshotTest-476429753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:00:59 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-09d0feca-7f15-49a3-8982-135b83d237cb tempest-CreateVolumesFromSnapshotTest-476429753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.353s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:00:59 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-09d0feca-7f15-49a3-8982-135b83d237cb tempest-CreateVolumesFromSnapshotTest-476429753 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-263878758',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3b74ced-e0b5-480a-8aef-51ce726446db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f4f2a5148284c95a8d197abd2a46434',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:00:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:00:57Z,use_quota=True,user_id='431190175ed04aa3bd5538bd0a33f09b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:00:59 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-09d0feca-7f15-49a3-8982-135b83d237cb tempest-CreateVolumesFromSnapshotTest-476429753 None] Creating volume e3b74ced-e0b5-480a-8aef-51ce726446db {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:00:59 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-09d0feca-7f15-49a3-8982-135b83d237cb tempest-CreateVolumesFromSnapshotTest-476429753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:00:59 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-09d0feca-7f15-49a3-8982-135b83d237cb tempest-CreateVolumesFromSnapshotTest-476429753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:00:59 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-09d0feca-7f15-49a3-8982-135b83d237cb tempest-CreateVolumesFromSnapshotTest-476429753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:00:59 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-09d0feca-7f15-49a3-8982-135b83d237cb tempest-CreateVolumesFromSnapshotTest-476429753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:00:59 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-09d0feca-7f15-49a3-8982-135b83d237cb tempest-CreateVolumesFromSnapshotTest-476429753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:00:59 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-09d0feca-7f15-49a3-8982-135b83d237cb tempest-CreateVolumesFromSnapshotTest-476429753 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:00:59 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-09d0feca-7f15-49a3-8982-135b83d237cb tempest-CreateVolumesFromSnapshotTest-476429753 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 16:00:59 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-09d0feca-7f15-49a3-8982-135b83d237cb tempest-CreateVolumesFromSnapshotTest-476429753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e3b74ced-e0b5-480a-8aef-51ce726446db 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:59 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-50466725-25a3-4505-90f4-833007e75af3 tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc009fbe-8d40-47f0-831f-11293feb50b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60cdd2ad-4017-4c2a-a66b-8e319031988b', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:59 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-50466725-25a3-4505-90f4-833007e75af3 tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ada14276-df60-405d-84ba-143ba868f400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:00:59 devstack sudo[90195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e3b74ced-e0b5-480a-8aef-51ce726446db 1073741824
Apr 15 16:00:59 devstack sudo[90195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:00:59 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-50466725-25a3-4505-90f4-833007e75af3 tempest-CreateVolumesFromSnapshotTest-476429753 None] Volume volume-60cdd2ad-4017-4c2a-a66b-8e319031988b (60cdd2ad-4017-4c2a-a66b-8e319031988b): created successfully
Apr 15 16:00:59 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-50466725-25a3-4505-90f4-833007e75af3 tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ada14276-df60-405d-84ba-143ba868f400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:00:59 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-50466725-25a3-4505-90f4-833007e75af3 tempest-CreateVolumesFromSnapshotTest-476429753 None] Flow 'volume_create_manager' (6ba056b1-124e-482e-8487-024edceb90e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:00:59 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-50466725-25a3-4505-90f4-833007e75af3 tempest-CreateVolumesFromSnapshotTest-476429753 None] Created volume successfully.
Apr 15 16:00:59 devstack sudo[90195]: pam_unix(sudo:session): session closed for user root
Apr 15 16:00:59 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-09d0feca-7f15-49a3-8982-135b83d237cb tempest-CreateVolumesFromSnapshotTest-476429753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e3b74ced-e0b5-480a-8aef-51ce726446db 1073741824" returned: 0 in 0.466s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:00:59 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-09d0feca-7f15-49a3-8982-135b83d237cb tempest-CreateVolumesFromSnapshotTest-476429753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e3b74ced-e0b5-480a-8aef-51ce726446db {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:00:59 devstack sudo[90200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e3b74ced-e0b5-480a-8aef-51ce726446db
Apr 15 16:00:59 devstack sudo[90200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:00 devstack sudo[90200]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-09d0feca-7f15-49a3-8982-135b83d237cb tempest-CreateVolumesFromSnapshotTest-476429753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e3b74ced-e0b5-480a-8aef-51ce726446db" returned: 0 in 0.411s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:00 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-09d0feca-7f15-49a3-8982-135b83d237cb tempest-CreateVolumesFromSnapshotTest-476429753 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:01:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-09d0feca-7f15-49a3-8982-135b83d237cb tempest-CreateVolumesFromSnapshotTest-476429753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:01:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-02162baf-1ac5-482f-890c-931ca369e006 tempest-CreateVolumesFromSnapshotTest-476429753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.037s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:01:00 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-02162baf-1ac5-482f-890c-931ca369e006 tempest-CreateVolumesFromSnapshotTest-476429753 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1173637360',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c310236c-707f-48dd-a395-782e258c3f14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f4f2a5148284c95a8d197abd2a46434',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:00:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:00:57Z,use_quota=True,user_id='431190175ed04aa3bd5538bd0a33f09b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:01:00 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-02162baf-1ac5-482f-890c-931ca369e006 tempest-CreateVolumesFromSnapshotTest-476429753 None] Creating volume c310236c-707f-48dd-a395-782e258c3f14 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:01:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-02162baf-1ac5-482f-890c-931ca369e006 tempest-CreateVolumesFromSnapshotTest-476429753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:01:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-02162baf-1ac5-482f-890c-931ca369e006 tempest-CreateVolumesFromSnapshotTest-476429753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:01:00 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-02162baf-1ac5-482f-890c-931ca369e006 tempest-CreateVolumesFromSnapshotTest-476429753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:01:00 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-02162baf-1ac5-482f-890c-931ca369e006 tempest-CreateVolumesFromSnapshotTest-476429753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:01:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-02162baf-1ac5-482f-890c-931ca369e006 tempest-CreateVolumesFromSnapshotTest-476429753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:01:00 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-02162baf-1ac5-482f-890c-931ca369e006 tempest-CreateVolumesFromSnapshotTest-476429753 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:01:00 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-02162baf-1ac5-482f-890c-931ca369e006 tempest-CreateVolumesFromSnapshotTest-476429753 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 16:01:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-02162baf-1ac5-482f-890c-931ca369e006 tempest-CreateVolumesFromSnapshotTest-476429753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c310236c-707f-48dd-a395-782e258c3f14 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:00 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-09d0feca-7f15-49a3-8982-135b83d237cb tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7b7c22c-7d44-4149-84b9-c55317450a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3b74ced-e0b5-480a-8aef-51ce726446db', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:00 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-09d0feca-7f15-49a3-8982-135b83d237cb tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f60f9f5-302e-448c-a8a2-271bfa926a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:00 devstack sudo[90203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c310236c-707f-48dd-a395-782e258c3f14 1073741824
Apr 15 16:01:00 devstack sudo[90203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:00 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-09d0feca-7f15-49a3-8982-135b83d237cb tempest-CreateVolumesFromSnapshotTest-476429753 None] Volume volume-e3b74ced-e0b5-480a-8aef-51ce726446db (e3b74ced-e0b5-480a-8aef-51ce726446db): created successfully
Apr 15 16:01:00 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-09d0feca-7f15-49a3-8982-135b83d237cb tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f60f9f5-302e-448c-a8a2-271bfa926a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:00 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-09d0feca-7f15-49a3-8982-135b83d237cb tempest-CreateVolumesFromSnapshotTest-476429753 None] Flow 'volume_create_manager' (ba23ecb8-980a-4bde-a0fe-7162ffd5b732) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:01:00 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-09d0feca-7f15-49a3-8982-135b83d237cb tempest-CreateVolumesFromSnapshotTest-476429753 None] Created volume successfully.
Apr 15 16:01:00 devstack sudo[90203]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-02162baf-1ac5-482f-890c-931ca369e006 tempest-CreateVolumesFromSnapshotTest-476429753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c310236c-707f-48dd-a395-782e258c3f14 1073741824" returned: 0 in 0.479s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-02162baf-1ac5-482f-890c-931ca369e006 tempest-CreateVolumesFromSnapshotTest-476429753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c310236c-707f-48dd-a395-782e258c3f14 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:00 devstack sudo[90208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c310236c-707f-48dd-a395-782e258c3f14
Apr 15 16:01:00 devstack sudo[90208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:01 devstack sudo[90208]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:01 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-02162baf-1ac5-482f-890c-931ca369e006 tempest-CreateVolumesFromSnapshotTest-476429753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c310236c-707f-48dd-a395-782e258c3f14" returned: 0 in 0.396s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:01 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-02162baf-1ac5-482f-890c-931ca369e006 tempest-CreateVolumesFromSnapshotTest-476429753 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:01:01 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-02162baf-1ac5-482f-890c-931ca369e006 tempest-CreateVolumesFromSnapshotTest-476429753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:01:01 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-02162baf-1ac5-482f-890c-931ca369e006 tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7a06fd4-c771-4379-8a6c-3929966a9e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c310236c-707f-48dd-a395-782e258c3f14', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:01 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-02162baf-1ac5-482f-890c-931ca369e006 tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1f70b76-6469-4af8-bff6-ddb98ed84e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:01 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-02162baf-1ac5-482f-890c-931ca369e006 tempest-CreateVolumesFromSnapshotTest-476429753 None] Volume volume-c310236c-707f-48dd-a395-782e258c3f14 (c310236c-707f-48dd-a395-782e258c3f14): created successfully
Apr 15 16:01:01 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-02162baf-1ac5-482f-890c-931ca369e006 tempest-CreateVolumesFromSnapshotTest-476429753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1f70b76-6469-4af8-bff6-ddb98ed84e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:01 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-02162baf-1ac5-482f-890c-931ca369e006 tempest-CreateVolumesFromSnapshotTest-476429753 None] Flow 'volume_create_manager' (c3820493-f90d-4f67-9ec4-62cf930fe348) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:01:01 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-02162baf-1ac5-482f-890c-931ca369e006 tempest-CreateVolumesFromSnapshotTest-476429753 None] Created volume successfully.
Apr 15 16:01:01 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-43feb1a0-0f9f-455d-ab1f-1e658099d2ce tempest-CreateVolumesFromSnapshotTest-476429753 None] Acquiring lock "cinder-c310236c-707f-48dd-a395-782e258c3f14-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:01:01 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-43feb1a0-0f9f-455d-ab1f-1e658099d2ce tempest-CreateVolumesFromSnapshotTest-476429753 None] Lock "cinder-c310236c-707f-48dd-a395-782e258c3f14-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:01:01 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-43feb1a0-0f9f-455d-ab1f-1e658099d2ce tempest-CreateVolumesFromSnapshotTest-476429753 None] Acquiring lock "cinder-quobyte-c310236c-707f-48dd-a395-782e258c3f14" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:01:01 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-43feb1a0-0f9f-455d-ab1f-1e658099d2ce tempest-CreateVolumesFromSnapshotTest-476429753 None] Lock "cinder-quobyte-c310236c-707f-48dd-a395-782e258c3f14" acquired by "delete_volume" :: waited 0.007s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:01:01 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[16678d07-1772-4664-a654-69ef7bcec447]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:01:01 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-43feb1a0-0f9f-455d-ab1f-1e658099d2ce tempest-CreateVolumesFromSnapshotTest-476429753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c310236c-707f-48dd-a395-782e258c3f14 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:01 devstack sudo[90211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c310236c-707f-48dd-a395-782e258c3f14
Apr 15 16:01:01 devstack sudo[90211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:02 devstack sudo[90211]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:02 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-43feb1a0-0f9f-455d-ab1f-1e658099d2ce tempest-CreateVolumesFromSnapshotTest-476429753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c310236c-707f-48dd-a395-782e258c3f14" returned: 0 in 0.464s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:02 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-43feb1a0-0f9f-455d-ab1f-1e658099d2ce tempest-CreateVolumesFromSnapshotTest-476429753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c310236c-707f-48dd-a395-782e258c3f14 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:02 devstack sudo[90216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c310236c-707f-48dd-a395-782e258c3f14
Apr 15 16:01:02 devstack sudo[90216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:02 devstack sudo[90216]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:02 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-43feb1a0-0f9f-455d-ab1f-1e658099d2ce tempest-CreateVolumesFromSnapshotTest-476429753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-c310236c-707f-48dd-a395-782e258c3f14" returned: 0 in 0.414s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:02 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-43feb1a0-0f9f-455d-ab1f-1e658099d2ce tempest-CreateVolumesFromSnapshotTest-476429753 None] Lock "cinder-quobyte-c310236c-707f-48dd-a395-782e258c3f14" released by "delete_volume" :: held 0.899s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:01:02 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-43feb1a0-0f9f-455d-ab1f-1e658099d2ce tempest-CreateVolumesFromSnapshotTest-476429753 None] Created reservations ['43b5e36e-9b59-488a-a348-0a8d870c092d', 'df709298-9f0a-4655-9740-21f889a76326', 'e334e64b-7f49-41a4-b017-b19c9722f2f1', '156286fa-2d7c-4ad8-9820-c959fc29a527'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:01:02 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-43feb1a0-0f9f-455d-ab1f-1e658099d2ce tempest-CreateVolumesFromSnapshotTest-476429753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:01:02 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-43feb1a0-0f9f-455d-ab1f-1e658099d2ce tempest-CreateVolumesFromSnapshotTest-476429753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:01:02 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-43feb1a0-0f9f-455d-ab1f-1e658099d2ce tempest-CreateVolumesFromSnapshotTest-476429753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:01:02 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-43feb1a0-0f9f-455d-ab1f-1e658099d2ce tempest-CreateVolumesFromSnapshotTest-476429753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:01:02 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-43feb1a0-0f9f-455d-ab1f-1e658099d2ce tempest-CreateVolumesFromSnapshotTest-476429753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:01:02 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-43feb1a0-0f9f-455d-ab1f-1e658099d2ce tempest-CreateVolumesFromSnapshotTest-476429753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:02 devstack sudo[90219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 16:01:02 devstack sudo[90219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:02 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-7a5cc97b-d325-4e04-b3bd-0fe4cad1c6c3 tempest-CreateVolumesFromSnapshotTest-476429753 None] Acquiring lock "cinder-e3b74ced-e0b5-480a-8aef-51ce726446db-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:01:02 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-7a5cc97b-d325-4e04-b3bd-0fe4cad1c6c3 tempest-CreateVolumesFromSnapshotTest-476429753 None] Lock "cinder-e3b74ced-e0b5-480a-8aef-51ce726446db-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:01:02 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-7a5cc97b-d325-4e04-b3bd-0fe4cad1c6c3 tempest-CreateVolumesFromSnapshotTest-476429753 None] Acquiring lock "cinder-quobyte-e3b74ced-e0b5-480a-8aef-51ce726446db" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:01:02 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-7a5cc97b-d325-4e04-b3bd-0fe4cad1c6c3 tempest-CreateVolumesFromSnapshotTest-476429753 None] Lock "cinder-quobyte-e3b74ced-e0b5-480a-8aef-51ce726446db" acquired by "delete_volume" :: waited 0.008s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:01:02 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a917abe-766d-43a4-9133-241514b521fb]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:01:02 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7a5cc97b-d325-4e04-b3bd-0fe4cad1c6c3 tempest-CreateVolumesFromSnapshotTest-476429753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e3b74ced-e0b5-480a-8aef-51ce726446db {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:02 devstack sudo[90221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e3b74ced-e0b5-480a-8aef-51ce726446db
Apr 15 16:01:02 devstack sudo[90221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:02 devstack sudo[90219]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:02 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-43feb1a0-0f9f-455d-ab1f-1e658099d2ce tempest-CreateVolumesFromSnapshotTest-476429753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.420s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:02 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-43feb1a0-0f9f-455d-ab1f-1e658099d2ce tempest-CreateVolumesFromSnapshotTest-476429753 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:01:02 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-43feb1a0-0f9f-455d-ab1f-1e658099d2ce tempest-CreateVolumesFromSnapshotTest-476429753 None] Deleted volume successfully.
Apr 15 16:01:02 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-43feb1a0-0f9f-455d-ab1f-1e658099d2ce tempest-CreateVolumesFromSnapshotTest-476429753 None] Lock "cinder-c310236c-707f-48dd-a395-782e258c3f14-delete_volume" released by "delete_volume" :: held 1.439s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:01:03 devstack sudo[90221]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:03 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7a5cc97b-d325-4e04-b3bd-0fe4cad1c6c3 tempest-CreateVolumesFromSnapshotTest-476429753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e3b74ced-e0b5-480a-8aef-51ce726446db" returned: 0 in 0.476s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:03 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7a5cc97b-d325-4e04-b3bd-0fe4cad1c6c3 tempest-CreateVolumesFromSnapshotTest-476429753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e3b74ced-e0b5-480a-8aef-51ce726446db {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:03 devstack sudo[90227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e3b74ced-e0b5-480a-8aef-51ce726446db
Apr 15 16:01:03 devstack sudo[90227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:03 devstack sudo[90227]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:03 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7a5cc97b-d325-4e04-b3bd-0fe4cad1c6c3 tempest-CreateVolumesFromSnapshotTest-476429753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e3b74ced-e0b5-480a-8aef-51ce726446db" returned: 0 in 0.401s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:03 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-7a5cc97b-d325-4e04-b3bd-0fe4cad1c6c3 tempest-CreateVolumesFromSnapshotTest-476429753 None] Lock "cinder-quobyte-e3b74ced-e0b5-480a-8aef-51ce726446db" released by "delete_volume" :: held 0.899s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:01:03 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-7a5cc97b-d325-4e04-b3bd-0fe4cad1c6c3 tempest-CreateVolumesFromSnapshotTest-476429753 None] Created reservations ['24e66f3a-5ab1-4e88-aeb9-116d62e2c074', '7372e916-c2c3-43cd-845b-1213d37ae407', 'dd94386e-e84f-47b0-8421-02b8a0ba4a56', 'baa2203e-49fb-4851-926e-fedeec8e49b9'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:01:03 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7a5cc97b-d325-4e04-b3bd-0fe4cad1c6c3 tempest-CreateVolumesFromSnapshotTest-476429753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:01:03 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7a5cc97b-d325-4e04-b3bd-0fe4cad1c6c3 tempest-CreateVolumesFromSnapshotTest-476429753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:01:03 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-7a5cc97b-d325-4e04-b3bd-0fe4cad1c6c3 tempest-CreateVolumesFromSnapshotTest-476429753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:01:03 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-7a5cc97b-d325-4e04-b3bd-0fe4cad1c6c3 tempest-CreateVolumesFromSnapshotTest-476429753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:01:03 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7a5cc97b-d325-4e04-b3bd-0fe4cad1c6c3 tempest-CreateVolumesFromSnapshotTest-476429753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:01:03 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7a5cc97b-d325-4e04-b3bd-0fe4cad1c6c3 tempest-CreateVolumesFromSnapshotTest-476429753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:03 devstack sudo[90230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 16:01:03 devstack sudo[90230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:03 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-0be429d4-0537-4992-a9ff-5306d9a2bd87 tempest-CreateVolumesFromSnapshotTest-476429753 None] Acquiring lock "cinder-60cdd2ad-4017-4c2a-a66b-8e319031988b-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:01:03 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-0be429d4-0537-4992-a9ff-5306d9a2bd87 tempest-CreateVolumesFromSnapshotTest-476429753 None] Lock "cinder-60cdd2ad-4017-4c2a-a66b-8e319031988b-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:01:03 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-0be429d4-0537-4992-a9ff-5306d9a2bd87 tempest-CreateVolumesFromSnapshotTest-476429753 None] Acquiring lock "cinder-quobyte-60cdd2ad-4017-4c2a-a66b-8e319031988b" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:01:03 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-0be429d4-0537-4992-a9ff-5306d9a2bd87 tempest-CreateVolumesFromSnapshotTest-476429753 None] Lock "cinder-quobyte-60cdd2ad-4017-4c2a-a66b-8e319031988b" acquired by "delete_volume" :: waited 0.008s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:01:03 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[74de0135-ae40-4aa9-9f23-a5dece3a6c9f]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:01:03 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-0be429d4-0537-4992-a9ff-5306d9a2bd87 tempest-CreateVolumesFromSnapshotTest-476429753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-60cdd2ad-4017-4c2a-a66b-8e319031988b {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:03 devstack sudo[90232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-60cdd2ad-4017-4c2a-a66b-8e319031988b
Apr 15 16:01:03 devstack sudo[90232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:04 devstack sudo[90230]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:04 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7a5cc97b-d325-4e04-b3bd-0fe4cad1c6c3 tempest-CreateVolumesFromSnapshotTest-476429753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.428s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:04 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-7a5cc97b-d325-4e04-b3bd-0fe4cad1c6c3 tempest-CreateVolumesFromSnapshotTest-476429753 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:01:04 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-7a5cc97b-d325-4e04-b3bd-0fe4cad1c6c3 tempest-CreateVolumesFromSnapshotTest-476429753 None] Deleted volume successfully.
Apr 15 16:01:04 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-7a5cc97b-d325-4e04-b3bd-0fe4cad1c6c3 tempest-CreateVolumesFromSnapshotTest-476429753 None] Lock "cinder-e3b74ced-e0b5-480a-8aef-51ce726446db-delete_volume" released by "delete_volume" :: held 1.454s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:01:04 devstack sudo[90232]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:04 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-0be429d4-0537-4992-a9ff-5306d9a2bd87 tempest-CreateVolumesFromSnapshotTest-476429753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-60cdd2ad-4017-4c2a-a66b-8e319031988b" returned: 0 in 0.478s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:04 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-0be429d4-0537-4992-a9ff-5306d9a2bd87 tempest-CreateVolumesFromSnapshotTest-476429753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-60cdd2ad-4017-4c2a-a66b-8e319031988b {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:04 devstack sudo[90238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-60cdd2ad-4017-4c2a-a66b-8e319031988b
Apr 15 16:01:04 devstack sudo[90238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:04 devstack sudo[90238]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:04 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-0be429d4-0537-4992-a9ff-5306d9a2bd87 tempest-CreateVolumesFromSnapshotTest-476429753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-60cdd2ad-4017-4c2a-a66b-8e319031988b" returned: 0 in 0.416s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:04 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-0be429d4-0537-4992-a9ff-5306d9a2bd87 tempest-CreateVolumesFromSnapshotTest-476429753 None] Lock "cinder-quobyte-60cdd2ad-4017-4c2a-a66b-8e319031988b" released by "delete_volume" :: held 0.915s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:01:04 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-0be429d4-0537-4992-a9ff-5306d9a2bd87 tempest-CreateVolumesFromSnapshotTest-476429753 None] Created reservations ['6aec5c5f-b69b-48d4-9f50-a528546f8af6', 'ec1ef6b6-b74c-40cd-860d-b3633605a640', '73029376-b5f1-4ca7-b393-e25b9ab405a4', 'dc6280c8-dba1-4aca-8af1-53f68b626d32'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:01:04 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-0be429d4-0537-4992-a9ff-5306d9a2bd87 tempest-CreateVolumesFromSnapshotTest-476429753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:01:04 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-0be429d4-0537-4992-a9ff-5306d9a2bd87 tempest-CreateVolumesFromSnapshotTest-476429753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:01:04 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-0be429d4-0537-4992-a9ff-5306d9a2bd87 tempest-CreateVolumesFromSnapshotTest-476429753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:01:04 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-0be429d4-0537-4992-a9ff-5306d9a2bd87 tempest-CreateVolumesFromSnapshotTest-476429753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:01:04 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-0be429d4-0537-4992-a9ff-5306d9a2bd87 tempest-CreateVolumesFromSnapshotTest-476429753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:01:04 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-0be429d4-0537-4992-a9ff-5306d9a2bd87 tempest-CreateVolumesFromSnapshotTest-476429753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:04 devstack sudo[90242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 16:01:04 devstack sudo[90242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:04 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-2c7d2362-8c79-4c1e-8eaa-72553b821460 tempest-CreateVolumesFromSnapshotTest-476429753 None] Acquiring lock "cinder-a2b4e6e6-c5c4-41f4-a6f2-0c1ffade0fb3-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:01:04 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-2c7d2362-8c79-4c1e-8eaa-72553b821460 tempest-CreateVolumesFromSnapshotTest-476429753 None] Lock "cinder-a2b4e6e6-c5c4-41f4-a6f2-0c1ffade0fb3-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:01:04 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-2c7d2362-8c79-4c1e-8eaa-72553b821460 tempest-CreateVolumesFromSnapshotTest-476429753 None] Acquiring lock "cinder-quobyte-a2b4e6e6-c5c4-41f4-a6f2-0c1ffade0fb3" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:01:04 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-2c7d2362-8c79-4c1e-8eaa-72553b821460 tempest-CreateVolumesFromSnapshotTest-476429753 None] Lock "cinder-quobyte-a2b4e6e6-c5c4-41f4-a6f2-0c1ffade0fb3" acquired by "delete_volume" :: waited 0.007s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:01:04 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3616308-5ecf-4aca-83c8-d16ca4b8e458]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:01:04 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-2c7d2362-8c79-4c1e-8eaa-72553b821460 tempest-CreateVolumesFromSnapshotTest-476429753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a2b4e6e6-c5c4-41f4-a6f2-0c1ffade0fb3 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:04 devstack sudo[90244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a2b4e6e6-c5c4-41f4-a6f2-0c1ffade0fb3
Apr 15 16:01:04 devstack sudo[90244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:05 devstack sudo[90242]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:05 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-0be429d4-0537-4992-a9ff-5306d9a2bd87 tempest-CreateVolumesFromSnapshotTest-476429753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.435s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:05 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-0be429d4-0537-4992-a9ff-5306d9a2bd87 tempest-CreateVolumesFromSnapshotTest-476429753 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:01:05 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-0be429d4-0537-4992-a9ff-5306d9a2bd87 tempest-CreateVolumesFromSnapshotTest-476429753 None] Deleted volume successfully.
Apr 15 16:01:05 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-0be429d4-0537-4992-a9ff-5306d9a2bd87 tempest-CreateVolumesFromSnapshotTest-476429753 None] Lock "cinder-60cdd2ad-4017-4c2a-a66b-8e319031988b-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:01:05 devstack sudo[90244]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:05 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-2c7d2362-8c79-4c1e-8eaa-72553b821460 tempest-CreateVolumesFromSnapshotTest-476429753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a2b4e6e6-c5c4-41f4-a6f2-0c1ffade0fb3" returned: 0 in 0.476s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:05 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-2c7d2362-8c79-4c1e-8eaa-72553b821460 tempest-CreateVolumesFromSnapshotTest-476429753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a2b4e6e6-c5c4-41f4-a6f2-0c1ffade0fb3 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:05 devstack sudo[90250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a2b4e6e6-c5c4-41f4-a6f2-0c1ffade0fb3
Apr 15 16:01:05 devstack sudo[90250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:05 devstack sudo[90250]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:05 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-2c7d2362-8c79-4c1e-8eaa-72553b821460 tempest-CreateVolumesFromSnapshotTest-476429753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a2b4e6e6-c5c4-41f4-a6f2-0c1ffade0fb3" returned: 0 in 0.405s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:05 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-2c7d2362-8c79-4c1e-8eaa-72553b821460 tempest-CreateVolumesFromSnapshotTest-476429753 None] Lock "cinder-quobyte-a2b4e6e6-c5c4-41f4-a6f2-0c1ffade0fb3" released by "delete_volume" :: held 0.906s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:01:05 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-2c7d2362-8c79-4c1e-8eaa-72553b821460 tempest-CreateVolumesFromSnapshotTest-476429753 None] Created reservations ['d5da1d9e-18d6-40fb-baab-41a1b2b5ca1a', 'f1f211a4-f5ec-4847-92f4-9b8d81c253d2', '3c4e6b2e-7e80-49ae-92d2-b578d13b32b2', '2c04eb43-ff0a-4cc0-9e11-f4aaa9100d9d'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:01:05 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-2c7d2362-8c79-4c1e-8eaa-72553b821460 tempest-CreateVolumesFromSnapshotTest-476429753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:01:05 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-2c7d2362-8c79-4c1e-8eaa-72553b821460 tempest-CreateVolumesFromSnapshotTest-476429753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:01:05 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-2c7d2362-8c79-4c1e-8eaa-72553b821460 tempest-CreateVolumesFromSnapshotTest-476429753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:01:05 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-2c7d2362-8c79-4c1e-8eaa-72553b821460 tempest-CreateVolumesFromSnapshotTest-476429753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:01:05 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-2c7d2362-8c79-4c1e-8eaa-72553b821460 tempest-CreateVolumesFromSnapshotTest-476429753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:01:05 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-2c7d2362-8c79-4c1e-8eaa-72553b821460 tempest-CreateVolumesFromSnapshotTest-476429753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:05 devstack sudo[90253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 16:01:05 devstack sudo[90253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:05 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-c8d5bd21-de3f-478e-8cde-357a11c46202 tempest-CreateVolumesFromSnapshotTest-476429753 None] Acquiring lock "cinder-a79a062c-70cc-4006-ad9c-b74aed959083-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:01:05 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-c8d5bd21-de3f-478e-8cde-357a11c46202 tempest-CreateVolumesFromSnapshotTest-476429753 None] Lock "cinder-a79a062c-70cc-4006-ad9c-b74aed959083-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:01:06 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-c8d5bd21-de3f-478e-8cde-357a11c46202 tempest-CreateVolumesFromSnapshotTest-476429753 None] Acquiring lock "cinder-quobyte-a79a062c-70cc-4006-ad9c-b74aed959083" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:01:06 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-c8d5bd21-de3f-478e-8cde-357a11c46202 tempest-CreateVolumesFromSnapshotTest-476429753 None] Lock "cinder-quobyte-a79a062c-70cc-4006-ad9c-b74aed959083" acquired by "delete_volume" :: waited 0.008s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:01:06 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[af733868-bc16-45c9-98d2-284e93e25c0b]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:01:06 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-c8d5bd21-de3f-478e-8cde-357a11c46202 tempest-CreateVolumesFromSnapshotTest-476429753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a79a062c-70cc-4006-ad9c-b74aed959083 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:06 devstack sudo[90255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a79a062c-70cc-4006-ad9c-b74aed959083
Apr 15 16:01:06 devstack sudo[90255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:06 devstack sudo[90253]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:06 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-2c7d2362-8c79-4c1e-8eaa-72553b821460 tempest-CreateVolumesFromSnapshotTest-476429753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.446s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:06 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-2c7d2362-8c79-4c1e-8eaa-72553b821460 tempest-CreateVolumesFromSnapshotTest-476429753 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:01:06 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-2c7d2362-8c79-4c1e-8eaa-72553b821460 tempest-CreateVolumesFromSnapshotTest-476429753 None] Deleted volume successfully.
Apr 15 16:01:06 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-2c7d2362-8c79-4c1e-8eaa-72553b821460 tempest-CreateVolumesFromSnapshotTest-476429753 None] Lock "cinder-a2b4e6e6-c5c4-41f4-a6f2-0c1ffade0fb3-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:01:06 devstack sudo[90255]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:06 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-c8d5bd21-de3f-478e-8cde-357a11c46202 tempest-CreateVolumesFromSnapshotTest-476429753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a79a062c-70cc-4006-ad9c-b74aed959083" returned: 0 in 0.522s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:06 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-c8d5bd21-de3f-478e-8cde-357a11c46202 tempest-CreateVolumesFromSnapshotTest-476429753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a79a062c-70cc-4006-ad9c-b74aed959083 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:06 devstack sudo[90261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a79a062c-70cc-4006-ad9c-b74aed959083
Apr 15 16:01:06 devstack sudo[90261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:06 devstack sudo[90261]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:06 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-c8d5bd21-de3f-478e-8cde-357a11c46202 tempest-CreateVolumesFromSnapshotTest-476429753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a79a062c-70cc-4006-ad9c-b74aed959083" returned: 0 in 0.408s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:06 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-c8d5bd21-de3f-478e-8cde-357a11c46202 tempest-CreateVolumesFromSnapshotTest-476429753 None] Lock "cinder-quobyte-a79a062c-70cc-4006-ad9c-b74aed959083" released by "delete_volume" :: held 0.955s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:01:07 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-c8d5bd21-de3f-478e-8cde-357a11c46202 tempest-CreateVolumesFromSnapshotTest-476429753 None] Created reservations ['b356b017-4a86-42c8-b8e0-08f9a47522f7', 'a7d0edcf-6c83-42c9-a7e4-b507d85afdc8', 'cf55ec95-9ab0-41e9-afd9-58f4ec9d169b', 'be9a7e3f-93fe-454a-925f-817e41efdfb5'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:01:07 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-c8d5bd21-de3f-478e-8cde-357a11c46202 tempest-CreateVolumesFromSnapshotTest-476429753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:01:07 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-c8d5bd21-de3f-478e-8cde-357a11c46202 tempest-CreateVolumesFromSnapshotTest-476429753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:01:07 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-c8d5bd21-de3f-478e-8cde-357a11c46202 tempest-CreateVolumesFromSnapshotTest-476429753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:01:07 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-c8d5bd21-de3f-478e-8cde-357a11c46202 tempest-CreateVolumesFromSnapshotTest-476429753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:01:07 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-c8d5bd21-de3f-478e-8cde-357a11c46202 tempest-CreateVolumesFromSnapshotTest-476429753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:01:07 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-c8d5bd21-de3f-478e-8cde-357a11c46202 tempest-CreateVolumesFromSnapshotTest-476429753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:07 devstack sudo[90264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 16:01:07 devstack sudo[90264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:07 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-87fac00c-3736-40f6-a5da-46e91e54c2fe tempest-CreateVolumesFromSnapshotTest-476429753 None] Acquiring lock "cinder-70779a89-0afd-4b0a-89fc-43d1afe85270-delete_snapshot" by "delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:01:07 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-87fac00c-3736-40f6-a5da-46e91e54c2fe tempest-CreateVolumesFromSnapshotTest-476429753 None] Lock "cinder-70779a89-0afd-4b0a-89fc-43d1afe85270-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:01:07 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-87fac00c-3736-40f6-a5da-46e91e54c2fe tempest-CreateVolumesFromSnapshotTest-476429753 None] Acquiring lock "cinder-quobyte-8233e52a-ed17-47b2-a8ba-ea24fcbdbb96" by "delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:01:07 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-87fac00c-3736-40f6-a5da-46e91e54c2fe tempest-CreateVolumesFromSnapshotTest-476429753 None] Lock "cinder-quobyte-8233e52a-ed17-47b2-a8ba-ea24fcbdbb96" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:01:07 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-87fac00c-3736-40f6-a5da-46e91e54c2fe tempest-CreateVolumesFromSnapshotTest-476429753 None] Acquiring lock "cinder-quobyte-70779a89-0afd-4b0a-89fc-43d1afe85270" by "_delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:01:07 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-87fac00c-3736-40f6-a5da-46e91e54c2fe tempest-CreateVolumesFromSnapshotTest-476429753 None] Lock "cinder-quobyte-70779a89-0afd-4b0a-89fc-43d1afe85270" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:01:07 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-87fac00c-3736-40f6-a5da-46e91e54c2fe tempest-CreateVolumesFromSnapshotTest-476429753 None] Deleting offline snapshot 70779a89-0afd-4b0a-89fc-43d1afe85270 of volume 8233e52a-ed17-47b2-a8ba-ea24fcbdbb96 {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 16:01:07 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-87fac00c-3736-40f6-a5da-46e91e54c2fe tempest-CreateVolumesFromSnapshotTest-476429753 None] snapshot_file for this snap is: volume-8233e52a-ed17-47b2-a8ba-ea24fcbdbb96.70779a89-0afd-4b0a-89fc-43d1afe85270 {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 16:01:07 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef99c652-639c-4157-ba4c-c76da8a59b49]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:01:07 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-87fac00c-3736-40f6-a5da-46e91e54c2fe tempest-CreateVolumesFromSnapshotTest-476429753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8233e52a-ed17-47b2-a8ba-ea24fcbdbb96.70779a89-0afd-4b0a-89fc-43d1afe85270 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:07 devstack sudo[90266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8233e52a-ed17-47b2-a8ba-ea24fcbdbb96.70779a89-0afd-4b0a-89fc-43d1afe85270
Apr 15 16:01:07 devstack sudo[90266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:07 devstack sudo[90264]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:07 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-c8d5bd21-de3f-478e-8cde-357a11c46202 tempest-CreateVolumesFromSnapshotTest-476429753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.459s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:07 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-c8d5bd21-de3f-478e-8cde-357a11c46202 tempest-CreateVolumesFromSnapshotTest-476429753 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:01:07 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-c8d5bd21-de3f-478e-8cde-357a11c46202 tempest-CreateVolumesFromSnapshotTest-476429753 None] Deleted volume successfully.
Apr 15 16:01:07 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-c8d5bd21-de3f-478e-8cde-357a11c46202 tempest-CreateVolumesFromSnapshotTest-476429753 None] Lock "cinder-a79a062c-70cc-4006-ad9c-b74aed959083-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:01:07 devstack sudo[90266]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:07 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-87fac00c-3736-40f6-a5da-46e91e54c2fe tempest-CreateVolumesFromSnapshotTest-476429753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8233e52a-ed17-47b2-a8ba-ea24fcbdbb96.70779a89-0afd-4b0a-89fc-43d1afe85270" returned: 0 in 0.495s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:07 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-87fac00c-3736-40f6-a5da-46e91e54c2fe tempest-CreateVolumesFromSnapshotTest-476429753 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8233e52a-ed17-47b2-a8ba-ea24fcbdbb96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82485) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:01:07 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0481fa-b533-4f4f-8dff-b4adc283675d]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:01:07 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-87fac00c-3736-40f6-a5da-46e91e54c2fe tempest-CreateVolumesFromSnapshotTest-476429753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8233e52a-ed17-47b2-a8ba-ea24fcbdbb96 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:07 devstack sudo[90272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8233e52a-ed17-47b2-a8ba-ea24fcbdbb96
Apr 15 16:01:07 devstack sudo[90272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:08 devstack sudo[90272]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:08 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-87fac00c-3736-40f6-a5da-46e91e54c2fe tempest-CreateVolumesFromSnapshotTest-476429753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8233e52a-ed17-47b2-a8ba-ea24fcbdbb96" returned: 0 in 0.454s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:08 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-87fac00c-3736-40f6-a5da-46e91e54c2fe tempest-CreateVolumesFromSnapshotTest-476429753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8233e52a-ed17-47b2-a8ba-ea24fcbdbb96.70779a89-0afd-4b0a-89fc-43d1afe85270 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:08 devstack sudo[90277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8233e52a-ed17-47b2-a8ba-ea24fcbdbb96.70779a89-0afd-4b0a-89fc-43d1afe85270
Apr 15 16:01:08 devstack sudo[90277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:08 devstack sudo[90277]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:08 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-87fac00c-3736-40f6-a5da-46e91e54c2fe tempest-CreateVolumesFromSnapshotTest-476429753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8233e52a-ed17-47b2-a8ba-ea24fcbdbb96.70779a89-0afd-4b0a-89fc-43d1afe85270" returned: 0 in 0.457s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:08 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-87fac00c-3736-40f6-a5da-46e91e54c2fe tempest-CreateVolumesFromSnapshotTest-476429753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8233e52a-ed17-47b2-a8ba-ea24fcbdbb96.70779a89-0afd-4b0a-89fc-43d1afe85270 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:08 devstack sudo[90282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8233e52a-ed17-47b2-a8ba-ea24fcbdbb96.70779a89-0afd-4b0a-89fc-43d1afe85270
Apr 15 16:01:08 devstack sudo[90282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:08 devstack sudo[90282]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:08 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-87fac00c-3736-40f6-a5da-46e91e54c2fe tempest-CreateVolumesFromSnapshotTest-476429753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8233e52a-ed17-47b2-a8ba-ea24fcbdbb96.70779a89-0afd-4b0a-89fc-43d1afe85270" returned: 0 in 0.403s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:09 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-87fac00c-3736-40f6-a5da-46e91e54c2fe tempest-CreateVolumesFromSnapshotTest-476429753 None] Lock "cinder-quobyte-70779a89-0afd-4b0a-89fc-43d1afe85270" released by "_delete_snapshot" :: held 1.877s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:01:09 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-87fac00c-3736-40f6-a5da-46e91e54c2fe tempest-CreateVolumesFromSnapshotTest-476429753 None] Lock "cinder-quobyte-8233e52a-ed17-47b2-a8ba-ea24fcbdbb96" released by "delete_snapshot" :: held 1.887s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:01:09 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-87fac00c-3736-40f6-a5da-46e91e54c2fe tempest-CreateVolumesFromSnapshotTest-476429753 None] Created reservations ['6738b8ca-3381-4f5c-9661-ff5d7e949558', '6ceb2d2d-af7d-4046-a263-40e789f30691', 'f6e780a8-6cf2-4f7e-9ec9-dd3ec7298d45', 'd8c8156d-6cae-4d7a-b810-dff4e936c507'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:01:09 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-87fac00c-3736-40f6-a5da-46e91e54c2fe tempest-CreateVolumesFromSnapshotTest-476429753 None] Delete snapshot completed successfully.
Apr 15 16:01:09 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-87fac00c-3736-40f6-a5da-46e91e54c2fe tempest-CreateVolumesFromSnapshotTest-476429753 None] Lock "cinder-70779a89-0afd-4b0a-89fc-43d1afe85270-delete_snapshot" released by "delete_snapshot" :: held 1.968s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:01:09 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-2fd16dab-2e78-45b2-a9a1-5c4b34f85a83 tempest-CreateVolumesFromSnapshotTest-476429753 None] Acquiring lock "cinder-8233e52a-ed17-47b2-a8ba-ea24fcbdbb96-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:01:09 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-2fd16dab-2e78-45b2-a9a1-5c4b34f85a83 tempest-CreateVolumesFromSnapshotTest-476429753 None] Lock "cinder-8233e52a-ed17-47b2-a8ba-ea24fcbdbb96-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:01:09 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-2fd16dab-2e78-45b2-a9a1-5c4b34f85a83 tempest-CreateVolumesFromSnapshotTest-476429753 None] Acquiring lock "cinder-quobyte-8233e52a-ed17-47b2-a8ba-ea24fcbdbb96" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:01:09 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-2fd16dab-2e78-45b2-a9a1-5c4b34f85a83 tempest-CreateVolumesFromSnapshotTest-476429753 None] Lock "cinder-quobyte-8233e52a-ed17-47b2-a8ba-ea24fcbdbb96" acquired by "delete_volume" :: waited 0.007s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:01:09 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9c1d21-0aaa-464d-b39a-92d72ac39e75]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:01:09 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-2fd16dab-2e78-45b2-a9a1-5c4b34f85a83 tempest-CreateVolumesFromSnapshotTest-476429753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8233e52a-ed17-47b2-a8ba-ea24fcbdbb96 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:09 devstack sudo[90285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8233e52a-ed17-47b2-a8ba-ea24fcbdbb96
Apr 15 16:01:09 devstack sudo[90285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:09 devstack sudo[90285]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:09 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-2fd16dab-2e78-45b2-a9a1-5c4b34f85a83 tempest-CreateVolumesFromSnapshotTest-476429753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8233e52a-ed17-47b2-a8ba-ea24fcbdbb96" returned: 0 in 0.464s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:09 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-2fd16dab-2e78-45b2-a9a1-5c4b34f85a83 tempest-CreateVolumesFromSnapshotTest-476429753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8233e52a-ed17-47b2-a8ba-ea24fcbdbb96 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:09 devstack sudo[90290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8233e52a-ed17-47b2-a8ba-ea24fcbdbb96
Apr 15 16:01:09 devstack sudo[90290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:10 devstack sudo[90290]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-2fd16dab-2e78-45b2-a9a1-5c4b34f85a83 tempest-CreateVolumesFromSnapshotTest-476429753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8233e52a-ed17-47b2-a8ba-ea24fcbdbb96" returned: 0 in 0.397s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:10 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-2fd16dab-2e78-45b2-a9a1-5c4b34f85a83 tempest-CreateVolumesFromSnapshotTest-476429753 None] Lock "cinder-quobyte-8233e52a-ed17-47b2-a8ba-ea24fcbdbb96" released by "delete_volume" :: held 0.896s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:01:10 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-2fd16dab-2e78-45b2-a9a1-5c4b34f85a83 tempest-CreateVolumesFromSnapshotTest-476429753 None] Created reservations ['4e65e83f-ad85-420b-a3ca-6c53d7d76294', '442397b0-54cb-4ddc-8b1d-8eb7d7587a7f', '381f76e6-78f5-4c5f-92a5-30e7c229f410', '17a75531-d837-4855-8fa7-f74e00e2ef10'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:01:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-2fd16dab-2e78-45b2-a9a1-5c4b34f85a83 tempest-CreateVolumesFromSnapshotTest-476429753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:01:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-2fd16dab-2e78-45b2-a9a1-5c4b34f85a83 tempest-CreateVolumesFromSnapshotTest-476429753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:01:10 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-2fd16dab-2e78-45b2-a9a1-5c4b34f85a83 tempest-CreateVolumesFromSnapshotTest-476429753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:01:10 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-2fd16dab-2e78-45b2-a9a1-5c4b34f85a83 tempest-CreateVolumesFromSnapshotTest-476429753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:01:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-2fd16dab-2e78-45b2-a9a1-5c4b34f85a83 tempest-CreateVolumesFromSnapshotTest-476429753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:01:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-2fd16dab-2e78-45b2-a9a1-5c4b34f85a83 tempest-CreateVolumesFromSnapshotTest-476429753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:10 devstack sudo[90293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 16:01:10 devstack sudo[90293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:10 devstack sudo[90293]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-2fd16dab-2e78-45b2-a9a1-5c4b34f85a83 tempest-CreateVolumesFromSnapshotTest-476429753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.434s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:10 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-2fd16dab-2e78-45b2-a9a1-5c4b34f85a83 tempest-CreateVolumesFromSnapshotTest-476429753 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:01:10 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-2fd16dab-2e78-45b2-a9a1-5c4b34f85a83 tempest-CreateVolumesFromSnapshotTest-476429753 None] Deleted volume successfully.
Apr 15 16:01:10 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-2fd16dab-2e78-45b2-a9a1-5c4b34f85a83 tempest-CreateVolumesFromSnapshotTest-476429753 None] Lock "cinder-8233e52a-ed17-47b2-a8ba-ea24fcbdbb96-delete_volume" released by "delete_volume" :: held 1.454s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:01:12 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-51faa0e7-b4b7-49c0-a50b-29a931116b3f tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:01:12 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-51faa0e7-b4b7-49c0-a50b-29a931116b3f tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Flow 'volume_create_manager' (e40107b1-87e2-4452-86e7-4f54c234c8c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:01:12 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-51faa0e7-b4b7-49c0-a50b-29a931116b3f tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb2c9925-6e08-492e-9378-cbbe799e5b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:12 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-51faa0e7-b4b7-49c0-a50b-29a931116b3f tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb2c9925-6e08-492e-9378-cbbe799e5b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:01:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2102972070',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e922e9b-104e-4585-adf1-7a6ee5b3f6eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3ac41dc5f9244239045ec26ed944eda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:01:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:01:12Z,use_quota=True,user_id='26768296224a40c8ae4c19436593f9f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:12 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-51faa0e7-b4b7-49c0-a50b-29a931116b3f tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1915dc7e-64e9-4971-a61a-2f34dedd0b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:12 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-51faa0e7-b4b7-49c0-a50b-29a931116b3f tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1915dc7e-64e9-4971-a61a-2f34dedd0b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:12 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-51faa0e7-b4b7-49c0-a50b-29a931116b3f tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01ea456a-0d38-4e8e-b9d1-1a7826a706ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:12 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-51faa0e7-b4b7-49c0-a50b-29a931116b3f tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01ea456a-0d38-4e8e-b9d1-1a7826a706ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e922e9b-104e-4585-adf1-7a6ee5b3f6eb', 'volume_name': 'volume-4e922e9b-104e-4585-adf1-7a6ee5b3f6eb', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:12 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-51faa0e7-b4b7-49c0-a50b-29a931116b3f tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51b51654-9e73-440a-9a11-6438c19c471b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:12 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-51faa0e7-b4b7-49c0-a50b-29a931116b3f tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51b51654-9e73-440a-9a11-6438c19c471b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:12 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-51faa0e7-b4b7-49c0-a50b-29a931116b3f tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88a3887d-6fc5-40ba-b9ab-057f1b69869e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:12 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-51faa0e7-b4b7-49c0-a50b-29a931116b3f tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Volume 4e922e9b-104e-4585-adf1-7a6ee5b3f6eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e922e9b-104e-4585-adf1-7a6ee5b3f6eb', 'volume_size': 1}
Apr 15 16:01:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-51faa0e7-b4b7-49c0-a50b-29a931116b3f tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:01:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-51faa0e7-b4b7-49c0-a50b-29a931116b3f tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:01:12 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-51faa0e7-b4b7-49c0-a50b-29a931116b3f tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:01:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2102972070',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e922e9b-104e-4585-adf1-7a6ee5b3f6eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3ac41dc5f9244239045ec26ed944eda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:01:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:01:12Z,use_quota=True,user_id='26768296224a40c8ae4c19436593f9f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:01:12 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-51faa0e7-b4b7-49c0-a50b-29a931116b3f tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Creating volume 4e922e9b-104e-4585-adf1-7a6ee5b3f6eb {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:01:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-51faa0e7-b4b7-49c0-a50b-29a931116b3f tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:01:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-51faa0e7-b4b7-49c0-a50b-29a931116b3f tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:01:12 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-51faa0e7-b4b7-49c0-a50b-29a931116b3f tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:01:12 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-51faa0e7-b4b7-49c0-a50b-29a931116b3f tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:01:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-51faa0e7-b4b7-49c0-a50b-29a931116b3f tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:01:12 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-51faa0e7-b4b7-49c0-a50b-29a931116b3f tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:01:12 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-51faa0e7-b4b7-49c0-a50b-29a931116b3f tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 16:01:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-51faa0e7-b4b7-49c0-a50b-29a931116b3f tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-4e922e9b-104e-4585-adf1-7a6ee5b3f6eb 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:12 devstack sudo[90296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-4e922e9b-104e-4585-adf1-7a6ee5b3f6eb 1073741824
Apr 15 16:01:12 devstack sudo[90296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:12 devstack sudo[90296]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-51faa0e7-b4b7-49c0-a50b-29a931116b3f tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-4e922e9b-104e-4585-adf1-7a6ee5b3f6eb 1073741824" returned: 0 in 0.491s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-51faa0e7-b4b7-49c0-a50b-29a931116b3f tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-4e922e9b-104e-4585-adf1-7a6ee5b3f6eb {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:12 devstack sudo[90301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-4e922e9b-104e-4585-adf1-7a6ee5b3f6eb
Apr 15 16:01:12 devstack sudo[90301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:13 devstack sudo[90301]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:13 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-51faa0e7-b4b7-49c0-a50b-29a931116b3f tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-4e922e9b-104e-4585-adf1-7a6ee5b3f6eb" returned: 0 in 0.408s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:13 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-51faa0e7-b4b7-49c0-a50b-29a931116b3f tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:01:13 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-51faa0e7-b4b7-49c0-a50b-29a931116b3f tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:01:13 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-51faa0e7-b4b7-49c0-a50b-29a931116b3f tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88a3887d-6fc5-40ba-b9ab-057f1b69869e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e922e9b-104e-4585-adf1-7a6ee5b3f6eb', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:13 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-51faa0e7-b4b7-49c0-a50b-29a931116b3f tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8690fbec-902e-464b-b1e9-d19a884f975e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:13 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-51faa0e7-b4b7-49c0-a50b-29a931116b3f tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Volume volume-4e922e9b-104e-4585-adf1-7a6ee5b3f6eb (4e922e9b-104e-4585-adf1-7a6ee5b3f6eb): created successfully
Apr 15 16:01:13 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-51faa0e7-b4b7-49c0-a50b-29a931116b3f tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8690fbec-902e-464b-b1e9-d19a884f975e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:13 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-51faa0e7-b4b7-49c0-a50b-29a931116b3f tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Flow 'volume_create_manager' (e40107b1-87e2-4452-86e7-4f54c234c8c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:01:13 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-51faa0e7-b4b7-49c0-a50b-29a931116b3f tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Created volume successfully.
Apr 15 16:01:14 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-994b3643-8576-458e-baf6-044c7d494da7 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:01:14 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-994b3643-8576-458e-baf6-044c7d494da7 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Flow 'volume_create_manager' (8e4884b0-871b-42db-b646-3a9aa230d4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:01:14 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-994b3643-8576-458e-baf6-044c7d494da7 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90ca0f48-6819-4509-908b-57d06aaec5c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:14 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-994b3643-8576-458e-baf6-044c7d494da7 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90ca0f48-6819-4509-908b-57d06aaec5c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:01:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1250955799',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae1fff32-5c65-4f8c-bf02-7b34fc87544a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3ac41dc5f9244239045ec26ed944eda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:01:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:01:14Z,use_quota=True,user_id='26768296224a40c8ae4c19436593f9f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:14 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-994b3643-8576-458e-baf6-044c7d494da7 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c57b15b5-fcaa-47dd-886c-19df19f039d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:14 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-994b3643-8576-458e-baf6-044c7d494da7 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c57b15b5-fcaa-47dd-886c-19df19f039d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:14 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-994b3643-8576-458e-baf6-044c7d494da7 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecf74ea4-90e8-47a2-808e-a41314581b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:14 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-994b3643-8576-458e-baf6-044c7d494da7 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecf74ea4-90e8-47a2-808e-a41314581b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae1fff32-5c65-4f8c-bf02-7b34fc87544a', 'volume_name': 'volume-ae1fff32-5c65-4f8c-bf02-7b34fc87544a', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:14 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-994b3643-8576-458e-baf6-044c7d494da7 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (117e174f-2769-4828-8fc0-ac58c91d79ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:14 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-994b3643-8576-458e-baf6-044c7d494da7 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (117e174f-2769-4828-8fc0-ac58c91d79ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:14 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-994b3643-8576-458e-baf6-044c7d494da7 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ade8c0b-b62a-437a-97e3-816b7562e8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:14 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-994b3643-8576-458e-baf6-044c7d494da7 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Volume ae1fff32-5c65-4f8c-bf02-7b34fc87544a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae1fff32-5c65-4f8c-bf02-7b34fc87544a', 'volume_size': 1}
Apr 15 16:01:14 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-994b3643-8576-458e-baf6-044c7d494da7 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:01:14 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-994b3643-8576-458e-baf6-044c7d494da7 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:01:14 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-994b3643-8576-458e-baf6-044c7d494da7 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:01:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1250955799',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae1fff32-5c65-4f8c-bf02-7b34fc87544a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3ac41dc5f9244239045ec26ed944eda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:01:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:01:14Z,use_quota=True,user_id='26768296224a40c8ae4c19436593f9f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:01:14 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-994b3643-8576-458e-baf6-044c7d494da7 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Creating volume ae1fff32-5c65-4f8c-bf02-7b34fc87544a {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:01:14 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-994b3643-8576-458e-baf6-044c7d494da7 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:01:14 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-994b3643-8576-458e-baf6-044c7d494da7 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:01:14 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-994b3643-8576-458e-baf6-044c7d494da7 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:01:14 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-994b3643-8576-458e-baf6-044c7d494da7 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:01:14 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-994b3643-8576-458e-baf6-044c7d494da7 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:01:14 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-994b3643-8576-458e-baf6-044c7d494da7 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:01:14 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-994b3643-8576-458e-baf6-044c7d494da7 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 16:01:14 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-994b3643-8576-458e-baf6-044c7d494da7 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ae1fff32-5c65-4f8c-bf02-7b34fc87544a 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:14 devstack sudo[90304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ae1fff32-5c65-4f8c-bf02-7b34fc87544a 1073741824
Apr 15 16:01:14 devstack sudo[90304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:14 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-014e44e5-c583-4098-9255-506fc274e188 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:01:14 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-014e44e5-c583-4098-9255-506fc274e188 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Flow 'volume_create_manager' (fce4e4aa-9766-4a83-bf60-98e1ac7173f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:01:14 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-014e44e5-c583-4098-9255-506fc274e188 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf520195-010b-4d51-ba3d-72e7f4b1a4e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:14 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-014e44e5-c583-4098-9255-506fc274e188 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf520195-010b-4d51-ba3d-72e7f4b1a4e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:01:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-300847911',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f5292dd-8165-45b6-b1a1-1f3080cfb775,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3ac41dc5f9244239045ec26ed944eda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:01:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:01:15Z,use_quota=True,user_id='26768296224a40c8ae4c19436593f9f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:14 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-014e44e5-c583-4098-9255-506fc274e188 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (596f0441-8d48-494d-80c4-b3a449a60092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:14 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-014e44e5-c583-4098-9255-506fc274e188 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (596f0441-8d48-494d-80c4-b3a449a60092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:14 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-014e44e5-c583-4098-9255-506fc274e188 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5d0fd15-d8fa-43d0-a290-aafc79f2359d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:14 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-014e44e5-c583-4098-9255-506fc274e188 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5d0fd15-d8fa-43d0-a290-aafc79f2359d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f5292dd-8165-45b6-b1a1-1f3080cfb775', 'volume_name': 'volume-8f5292dd-8165-45b6-b1a1-1f3080cfb775', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:14 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-014e44e5-c583-4098-9255-506fc274e188 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcf9b1f1-06e5-413a-b373-64a065971592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:14 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-014e44e5-c583-4098-9255-506fc274e188 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcf9b1f1-06e5-413a-b373-64a065971592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:14 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-014e44e5-c583-4098-9255-506fc274e188 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (891dcf06-c8ed-438d-84cd-ccf4afb0af5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:14 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-014e44e5-c583-4098-9255-506fc274e188 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Volume 8f5292dd-8165-45b6-b1a1-1f3080cfb775: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f5292dd-8165-45b6-b1a1-1f3080cfb775', 'volume_size': 1}
Apr 15 16:01:14 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-014e44e5-c583-4098-9255-506fc274e188 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:01:14 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3d53c61-92be-41cc-b94c-f6c76e352559 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:01:14 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-c3d53c61-92be-41cc-b94c-f6c76e352559 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Flow 'volume_create_manager' (1026d5d4-3469-46a3-91bd-68994fa0e619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:01:14 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-c3d53c61-92be-41cc-b94c-f6c76e352559 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (536c010b-3141-4707-9d52-84c98a7bae59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:14 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-c3d53c61-92be-41cc-b94c-f6c76e352559 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (536c010b-3141-4707-9d52-84c98a7bae59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:01:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-411583118',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06542dfe-6b1e-43b8-a966-ea349f55c0c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3ac41dc5f9244239045ec26ed944eda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:01:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:01:15Z,use_quota=True,user_id='26768296224a40c8ae4c19436593f9f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:14 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-c3d53c61-92be-41cc-b94c-f6c76e352559 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9dfba09-8ba3-40c6-b0c9-5b55248206a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:14 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-c3d53c61-92be-41cc-b94c-f6c76e352559 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9dfba09-8ba3-40c6-b0c9-5b55248206a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:14 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-c3d53c61-92be-41cc-b94c-f6c76e352559 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8875fbb7-4341-4e09-ba32-ad9639a2b8e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:14 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-c3d53c61-92be-41cc-b94c-f6c76e352559 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8875fbb7-4341-4e09-ba32-ad9639a2b8e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06542dfe-6b1e-43b8-a966-ea349f55c0c0', 'volume_name': 'volume-06542dfe-6b1e-43b8-a966-ea349f55c0c0', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:14 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-c3d53c61-92be-41cc-b94c-f6c76e352559 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e86c5a8-f853-48cd-9317-1c861d074411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:14 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-c3d53c61-92be-41cc-b94c-f6c76e352559 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e86c5a8-f853-48cd-9317-1c861d074411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:14 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-c3d53c61-92be-41cc-b94c-f6c76e352559 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45fdf755-ebee-425b-88bd-74c0896fdb7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:14 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-c3d53c61-92be-41cc-b94c-f6c76e352559 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Volume 06542dfe-6b1e-43b8-a966-ea349f55c0c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06542dfe-6b1e-43b8-a966-ea349f55c0c0', 'volume_size': 1}
Apr 15 16:01:14 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-c3d53c61-92be-41cc-b94c-f6c76e352559 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:01:15 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b963da5-e22c-40a0-a082-147c45b468b0 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:01:15 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-3b963da5-e22c-40a0-a082-147c45b468b0 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Flow 'volume_create_manager' (a9ee28e6-f310-43b0-872a-fb8680730984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:01:15 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-3b963da5-e22c-40a0-a082-147c45b468b0 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb77818a-8ef7-4964-a191-4df1530bd61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:15 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-3b963da5-e22c-40a0-a082-147c45b468b0 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb77818a-8ef7-4964-a191-4df1530bd61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:01:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1074441583',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3441c07-97e5-42c6-9651-02310dd747da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3ac41dc5f9244239045ec26ed944eda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:01:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:01:15Z,use_quota=True,user_id='26768296224a40c8ae4c19436593f9f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:15 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-3b963da5-e22c-40a0-a082-147c45b468b0 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cb38d95-d90e-48d2-9a57-bc485e8dc42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:15 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-3b963da5-e22c-40a0-a082-147c45b468b0 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cb38d95-d90e-48d2-9a57-bc485e8dc42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:15 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-3b963da5-e22c-40a0-a082-147c45b468b0 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1174150b-7a53-48ae-99a5-b8a580104e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:15 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-3b963da5-e22c-40a0-a082-147c45b468b0 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1174150b-7a53-48ae-99a5-b8a580104e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3441c07-97e5-42c6-9651-02310dd747da', 'volume_name': 'volume-e3441c07-97e5-42c6-9651-02310dd747da', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:15 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-3b963da5-e22c-40a0-a082-147c45b468b0 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93396e1c-0525-4c8b-97eb-6f17c6232736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:15 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-3b963da5-e22c-40a0-a082-147c45b468b0 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93396e1c-0525-4c8b-97eb-6f17c6232736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:15 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-3b963da5-e22c-40a0-a082-147c45b468b0 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83e21b3d-da18-44a4-aadc-a63e81549606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:15 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-3b963da5-e22c-40a0-a082-147c45b468b0 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Volume e3441c07-97e5-42c6-9651-02310dd747da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3441c07-97e5-42c6-9651-02310dd747da', 'volume_size': 1}
Apr 15 16:01:15 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-3b963da5-e22c-40a0-a082-147c45b468b0 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:01:15 devstack sudo[90304]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:15 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-994b3643-8576-458e-baf6-044c7d494da7 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ae1fff32-5c65-4f8c-bf02-7b34fc87544a 1073741824" returned: 0 in 0.633s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:15 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-994b3643-8576-458e-baf6-044c7d494da7 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ae1fff32-5c65-4f8c-bf02-7b34fc87544a {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:15 devstack sudo[90311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ae1fff32-5c65-4f8c-bf02-7b34fc87544a
Apr 15 16:01:15 devstack sudo[90311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:15 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-575ba5df-f368-49d2-8e2f-1210f5d4d69a tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:01:15 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-575ba5df-f368-49d2-8e2f-1210f5d4d69a tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Flow 'volume_create_manager' (e1ad0b77-6723-49ee-869e-d52a06d3fcb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:01:15 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-575ba5df-f368-49d2-8e2f-1210f5d4d69a tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9c88d4b-ecb0-4834-8c08-85499fa88007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:15 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-575ba5df-f368-49d2-8e2f-1210f5d4d69a tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9c88d4b-ecb0-4834-8c08-85499fa88007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:01:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-647015098',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e274d24-f847-4eee-a6c9-384ca6088fc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3ac41dc5f9244239045ec26ed944eda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:01:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:01:15Z,use_quota=True,user_id='26768296224a40c8ae4c19436593f9f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:15 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-575ba5df-f368-49d2-8e2f-1210f5d4d69a tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf0735b8-f043-472e-b779-affc2f94366a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:15 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-575ba5df-f368-49d2-8e2f-1210f5d4d69a tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf0735b8-f043-472e-b779-affc2f94366a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:15 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-575ba5df-f368-49d2-8e2f-1210f5d4d69a tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (333722e6-59b7-4876-a136-cd392db1c9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:15 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-575ba5df-f368-49d2-8e2f-1210f5d4d69a tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (333722e6-59b7-4876-a136-cd392db1c9db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e274d24-f847-4eee-a6c9-384ca6088fc7', 'volume_name': 'volume-6e274d24-f847-4eee-a6c9-384ca6088fc7', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:15 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-575ba5df-f368-49d2-8e2f-1210f5d4d69a tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a841f1e6-e7c5-4ecf-b200-7f84edd83fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:15 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-575ba5df-f368-49d2-8e2f-1210f5d4d69a tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a841f1e6-e7c5-4ecf-b200-7f84edd83fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:15 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-575ba5df-f368-49d2-8e2f-1210f5d4d69a tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60952200-b7e9-4ca4-a848-8fc3be0af161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:15 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-575ba5df-f368-49d2-8e2f-1210f5d4d69a tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Volume 6e274d24-f847-4eee-a6c9-384ca6088fc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e274d24-f847-4eee-a6c9-384ca6088fc7', 'volume_size': 1}
Apr 15 16:01:15 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-575ba5df-f368-49d2-8e2f-1210f5d4d69a tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:01:15 devstack sudo[90311]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:15 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-994b3643-8576-458e-baf6-044c7d494da7 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ae1fff32-5c65-4f8c-bf02-7b34fc87544a" returned: 0 in 0.421s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:15 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-994b3643-8576-458e-baf6-044c7d494da7 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:01:15 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-994b3643-8576-458e-baf6-044c7d494da7 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:01:15 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-014e44e5-c583-4098-9255-506fc274e188 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.879s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:01:15 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-014e44e5-c583-4098-9255-506fc274e188 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:01:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-300847911',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f5292dd-8165-45b6-b1a1-1f3080cfb775,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3ac41dc5f9244239045ec26ed944eda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:01:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:01:15Z,use_quota=True,user_id='26768296224a40c8ae4c19436593f9f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:01:15 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-014e44e5-c583-4098-9255-506fc274e188 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Creating volume 8f5292dd-8165-45b6-b1a1-1f3080cfb775 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:01:15 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-014e44e5-c583-4098-9255-506fc274e188 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:01:15 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-014e44e5-c583-4098-9255-506fc274e188 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:01:15 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-014e44e5-c583-4098-9255-506fc274e188 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:01:15 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-014e44e5-c583-4098-9255-506fc274e188 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:01:15 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-014e44e5-c583-4098-9255-506fc274e188 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:01:15 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-014e44e5-c583-4098-9255-506fc274e188 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:01:15 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-014e44e5-c583-4098-9255-506fc274e188 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 16:01:15 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-014e44e5-c583-4098-9255-506fc274e188 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8f5292dd-8165-45b6-b1a1-1f3080cfb775 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:15 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-994b3643-8576-458e-baf6-044c7d494da7 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ade8c0b-b62a-437a-97e3-816b7562e8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae1fff32-5c65-4f8c-bf02-7b34fc87544a', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:15 devstack sudo[90314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8f5292dd-8165-45b6-b1a1-1f3080cfb775 1073741824
Apr 15 16:01:15 devstack sudo[90314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:15 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-994b3643-8576-458e-baf6-044c7d494da7 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98273cd6-3675-4114-a066-947d0d37de2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:15 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-994b3643-8576-458e-baf6-044c7d494da7 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Volume volume-ae1fff32-5c65-4f8c-bf02-7b34fc87544a (ae1fff32-5c65-4f8c-bf02-7b34fc87544a): created successfully
Apr 15 16:01:15 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-994b3643-8576-458e-baf6-044c7d494da7 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98273cd6-3675-4114-a066-947d0d37de2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:15 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-994b3643-8576-458e-baf6-044c7d494da7 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Flow 'volume_create_manager' (8e4884b0-871b-42db-b646-3a9aa230d4a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:01:15 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-994b3643-8576-458e-baf6-044c7d494da7 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Created volume successfully.
Apr 15 16:01:16 devstack sudo[90314]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:16 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-014e44e5-c583-4098-9255-506fc274e188 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8f5292dd-8165-45b6-b1a1-1f3080cfb775 1073741824" returned: 0 in 0.507s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:16 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-014e44e5-c583-4098-9255-506fc274e188 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8f5292dd-8165-45b6-b1a1-1f3080cfb775 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:16 devstack sudo[90319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8f5292dd-8165-45b6-b1a1-1f3080cfb775
Apr 15 16:01:16 devstack sudo[90319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:16 devstack sudo[90319]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:16 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-014e44e5-c583-4098-9255-506fc274e188 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8f5292dd-8165-45b6-b1a1-1f3080cfb775" returned: 0 in 0.411s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:16 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-014e44e5-c583-4098-9255-506fc274e188 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:01:16 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-014e44e5-c583-4098-9255-506fc274e188 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:01:16 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-c3d53c61-92be-41cc-b94c-f6c76e352559 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.618s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:01:16 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-c3d53c61-92be-41cc-b94c-f6c76e352559 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:01:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-411583118',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06542dfe-6b1e-43b8-a966-ea349f55c0c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3ac41dc5f9244239045ec26ed944eda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:01:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:01:15Z,use_quota=True,user_id='26768296224a40c8ae4c19436593f9f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:01:16 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-c3d53c61-92be-41cc-b94c-f6c76e352559 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Creating volume 06542dfe-6b1e-43b8-a966-ea349f55c0c0 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:01:16 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-c3d53c61-92be-41cc-b94c-f6c76e352559 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:01:16 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-c3d53c61-92be-41cc-b94c-f6c76e352559 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:01:16 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-c3d53c61-92be-41cc-b94c-f6c76e352559 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:01:16 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-c3d53c61-92be-41cc-b94c-f6c76e352559 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:01:16 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-c3d53c61-92be-41cc-b94c-f6c76e352559 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:01:16 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-c3d53c61-92be-41cc-b94c-f6c76e352559 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:01:16 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-c3d53c61-92be-41cc-b94c-f6c76e352559 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 16:01:16 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-c3d53c61-92be-41cc-b94c-f6c76e352559 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-06542dfe-6b1e-43b8-a966-ea349f55c0c0 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:16 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-014e44e5-c583-4098-9255-506fc274e188 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (891dcf06-c8ed-438d-84cd-ccf4afb0af5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f5292dd-8165-45b6-b1a1-1f3080cfb775', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:16 devstack sudo[90322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-06542dfe-6b1e-43b8-a966-ea349f55c0c0 1073741824
Apr 15 16:01:16 devstack sudo[90322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:16 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-014e44e5-c583-4098-9255-506fc274e188 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a44adb1e-aeeb-490d-8362-1ee12890441e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:16 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-014e44e5-c583-4098-9255-506fc274e188 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Volume volume-8f5292dd-8165-45b6-b1a1-1f3080cfb775 (8f5292dd-8165-45b6-b1a1-1f3080cfb775): created successfully
Apr 15 16:01:16 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-014e44e5-c583-4098-9255-506fc274e188 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a44adb1e-aeeb-490d-8362-1ee12890441e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:16 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-014e44e5-c583-4098-9255-506fc274e188 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Flow 'volume_create_manager' (fce4e4aa-9766-4a83-bf60-98e1ac7173f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:01:16 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-014e44e5-c583-4098-9255-506fc274e188 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Created volume successfully.
Apr 15 16:01:17 devstack sudo[90322]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:17 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-c3d53c61-92be-41cc-b94c-f6c76e352559 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-06542dfe-6b1e-43b8-a966-ea349f55c0c0 1073741824" returned: 0 in 0.475s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:17 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-c3d53c61-92be-41cc-b94c-f6c76e352559 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-06542dfe-6b1e-43b8-a966-ea349f55c0c0 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:17 devstack sudo[90327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-06542dfe-6b1e-43b8-a966-ea349f55c0c0
Apr 15 16:01:17 devstack sudo[90327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:17 devstack sudo[90327]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:17 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-c3d53c61-92be-41cc-b94c-f6c76e352559 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-06542dfe-6b1e-43b8-a966-ea349f55c0c0" returned: 0 in 0.425s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:17 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-c3d53c61-92be-41cc-b94c-f6c76e352559 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:01:17 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-c3d53c61-92be-41cc-b94c-f6c76e352559 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:01:17 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-3b963da5-e22c-40a0-a082-147c45b468b0 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.353s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:01:17 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-3b963da5-e22c-40a0-a082-147c45b468b0 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:01:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1074441583',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3441c07-97e5-42c6-9651-02310dd747da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3ac41dc5f9244239045ec26ed944eda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:01:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:01:15Z,use_quota=True,user_id='26768296224a40c8ae4c19436593f9f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:01:17 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-3b963da5-e22c-40a0-a082-147c45b468b0 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Creating volume e3441c07-97e5-42c6-9651-02310dd747da {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:01:17 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-3b963da5-e22c-40a0-a082-147c45b468b0 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:01:17 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-3b963da5-e22c-40a0-a082-147c45b468b0 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:01:17 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-3b963da5-e22c-40a0-a082-147c45b468b0 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:01:17 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-3b963da5-e22c-40a0-a082-147c45b468b0 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:01:17 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-3b963da5-e22c-40a0-a082-147c45b468b0 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:01:17 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-3b963da5-e22c-40a0-a082-147c45b468b0 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:01:17 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-3b963da5-e22c-40a0-a082-147c45b468b0 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 16:01:17 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3b963da5-e22c-40a0-a082-147c45b468b0 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e3441c07-97e5-42c6-9651-02310dd747da 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:17 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-c3d53c61-92be-41cc-b94c-f6c76e352559 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45fdf755-ebee-425b-88bd-74c0896fdb7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06542dfe-6b1e-43b8-a966-ea349f55c0c0', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:17 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-c3d53c61-92be-41cc-b94c-f6c76e352559 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44166233-1d62-4e74-a548-93035ef1f3fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:17 devstack sudo[90330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e3441c07-97e5-42c6-9651-02310dd747da 1073741824
Apr 15 16:01:17 devstack sudo[90330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:17 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-c3d53c61-92be-41cc-b94c-f6c76e352559 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Volume volume-06542dfe-6b1e-43b8-a966-ea349f55c0c0 (06542dfe-6b1e-43b8-a966-ea349f55c0c0): created successfully
Apr 15 16:01:17 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-c3d53c61-92be-41cc-b94c-f6c76e352559 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44166233-1d62-4e74-a548-93035ef1f3fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:17 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-c3d53c61-92be-41cc-b94c-f6c76e352559 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Flow 'volume_create_manager' (1026d5d4-3469-46a3-91bd-68994fa0e619) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:01:17 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-c3d53c61-92be-41cc-b94c-f6c76e352559 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Created volume successfully.
Apr 15 16:01:17 devstack sudo[90330]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:17 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3b963da5-e22c-40a0-a082-147c45b468b0 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e3441c07-97e5-42c6-9651-02310dd747da 1073741824" returned: 0 in 0.450s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:17 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3b963da5-e22c-40a0-a082-147c45b468b0 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e3441c07-97e5-42c6-9651-02310dd747da {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:17 devstack sudo[90335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e3441c07-97e5-42c6-9651-02310dd747da
Apr 15 16:01:17 devstack sudo[90335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:18 devstack sudo[90335]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3b963da5-e22c-40a0-a082-147c45b468b0 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e3441c07-97e5-42c6-9651-02310dd747da" returned: 0 in 0.398s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:18 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-3b963da5-e22c-40a0-a082-147c45b468b0 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:01:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-3b963da5-e22c-40a0-a082-147c45b468b0 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:01:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-575ba5df-f368-49d2-8e2f-1210f5d4d69a tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.027s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:01:18 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-575ba5df-f368-49d2-8e2f-1210f5d4d69a tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:01:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-647015098',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e274d24-f847-4eee-a6c9-384ca6088fc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3ac41dc5f9244239045ec26ed944eda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:01:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:01:15Z,use_quota=True,user_id='26768296224a40c8ae4c19436593f9f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:01:18 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-575ba5df-f368-49d2-8e2f-1210f5d4d69a tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Creating volume 6e274d24-f847-4eee-a6c9-384ca6088fc7 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:01:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-575ba5df-f368-49d2-8e2f-1210f5d4d69a tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:01:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-575ba5df-f368-49d2-8e2f-1210f5d4d69a tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:01:18 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-575ba5df-f368-49d2-8e2f-1210f5d4d69a tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:01:18 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-575ba5df-f368-49d2-8e2f-1210f5d4d69a tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:01:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-575ba5df-f368-49d2-8e2f-1210f5d4d69a tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:01:18 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-575ba5df-f368-49d2-8e2f-1210f5d4d69a tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:01:18 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-575ba5df-f368-49d2-8e2f-1210f5d4d69a tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 16:01:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-575ba5df-f368-49d2-8e2f-1210f5d4d69a tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e274d24-f847-4eee-a6c9-384ca6088fc7 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:18 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-3b963da5-e22c-40a0-a082-147c45b468b0 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83e21b3d-da18-44a4-aadc-a63e81549606) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3441c07-97e5-42c6-9651-02310dd747da', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:18 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-3b963da5-e22c-40a0-a082-147c45b468b0 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaf892f9-81aa-417e-a9c6-e18e63b3f1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:18 devstack sudo[90338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e274d24-f847-4eee-a6c9-384ca6088fc7 1073741824
Apr 15 16:01:18 devstack sudo[90338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:18 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-3b963da5-e22c-40a0-a082-147c45b468b0 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Volume volume-e3441c07-97e5-42c6-9651-02310dd747da (e3441c07-97e5-42c6-9651-02310dd747da): created successfully
Apr 15 16:01:18 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-3b963da5-e22c-40a0-a082-147c45b468b0 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaf892f9-81aa-417e-a9c6-e18e63b3f1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:18 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-3b963da5-e22c-40a0-a082-147c45b468b0 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Flow 'volume_create_manager' (a9ee28e6-f310-43b0-872a-fb8680730984) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:01:18 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-3b963da5-e22c-40a0-a082-147c45b468b0 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Created volume successfully.
Apr 15 16:01:18 devstack sudo[90338]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-575ba5df-f368-49d2-8e2f-1210f5d4d69a tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e274d24-f847-4eee-a6c9-384ca6088fc7 1073741824" returned: 0 in 0.478s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-575ba5df-f368-49d2-8e2f-1210f5d4d69a tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e274d24-f847-4eee-a6c9-384ca6088fc7 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:18 devstack sudo[90343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e274d24-f847-4eee-a6c9-384ca6088fc7
Apr 15 16:01:18 devstack sudo[90343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:19 devstack sudo[90343]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-575ba5df-f368-49d2-8e2f-1210f5d4d69a tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e274d24-f847-4eee-a6c9-384ca6088fc7" returned: 0 in 0.406s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:19 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-575ba5df-f368-49d2-8e2f-1210f5d4d69a tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:01:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-575ba5df-f368-49d2-8e2f-1210f5d4d69a tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:01:19 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-575ba5df-f368-49d2-8e2f-1210f5d4d69a tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60952200-b7e9-4ca4-a848-8fc3be0af161) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e274d24-f847-4eee-a6c9-384ca6088fc7', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:19 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-575ba5df-f368-49d2-8e2f-1210f5d4d69a tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0c3d8ac-882c-4d57-9b6e-43d5732d6404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:19 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-575ba5df-f368-49d2-8e2f-1210f5d4d69a tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Volume volume-6e274d24-f847-4eee-a6c9-384ca6088fc7 (6e274d24-f847-4eee-a6c9-384ca6088fc7): created successfully
Apr 15 16:01:19 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-575ba5df-f368-49d2-8e2f-1210f5d4d69a tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0c3d8ac-882c-4d57-9b6e-43d5732d6404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:19 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-575ba5df-f368-49d2-8e2f-1210f5d4d69a tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Flow 'volume_create_manager' (e1ad0b77-6723-49ee-869e-d52a06d3fcb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:01:19 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-575ba5df-f368-49d2-8e2f-1210f5d4d69a tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Created volume successfully.
Apr 15 16:01:19 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-eb792297-355c-4e3d-b78e-fa089cd5ce1a tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Acquiring lock "cinder-6e274d24-f847-4eee-a6c9-384ca6088fc7-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:01:19 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-eb792297-355c-4e3d-b78e-fa089cd5ce1a tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Lock "cinder-6e274d24-f847-4eee-a6c9-384ca6088fc7-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:01:19 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-eb792297-355c-4e3d-b78e-fa089cd5ce1a tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Acquiring lock "cinder-quobyte-6e274d24-f847-4eee-a6c9-384ca6088fc7" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:01:19 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-eb792297-355c-4e3d-b78e-fa089cd5ce1a tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Lock "cinder-quobyte-6e274d24-f847-4eee-a6c9-384ca6088fc7" acquired by "delete_volume" :: waited 0.012s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:01:19 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[53427b52-db1a-4dd9-aa42-7e8953e35bb4]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:01:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-eb792297-355c-4e3d-b78e-fa089cd5ce1a tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e274d24-f847-4eee-a6c9-384ca6088fc7 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:19 devstack sudo[90346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e274d24-f847-4eee-a6c9-384ca6088fc7
Apr 15 16:01:19 devstack sudo[90346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:20 devstack sudo[90346]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:20 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-eb792297-355c-4e3d-b78e-fa089cd5ce1a tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e274d24-f847-4eee-a6c9-384ca6088fc7" returned: 0 in 0.446s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:20 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-eb792297-355c-4e3d-b78e-fa089cd5ce1a tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e274d24-f847-4eee-a6c9-384ca6088fc7 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:20 devstack sudo[90351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e274d24-f847-4eee-a6c9-384ca6088fc7
Apr 15 16:01:20 devstack sudo[90351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:20 devstack sudo[90351]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:20 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-eb792297-355c-4e3d-b78e-fa089cd5ce1a tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e274d24-f847-4eee-a6c9-384ca6088fc7" returned: 0 in 0.391s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:20 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-eb792297-355c-4e3d-b78e-fa089cd5ce1a tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Lock "cinder-quobyte-6e274d24-f847-4eee-a6c9-384ca6088fc7" released by "delete_volume" :: held 0.859s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:01:20 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-eb792297-355c-4e3d-b78e-fa089cd5ce1a tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Created reservations ['808a8096-73c1-42e1-907c-17bed169f1a2', '6549f8c7-b33c-4ad2-903c-32f270c7efe8', '7ac6448c-efb3-48df-a66f-3da875ae7603', '1dbbeb79-5ce8-49e5-947d-1c7ce5104363'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:01:20 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-eb792297-355c-4e3d-b78e-fa089cd5ce1a tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:01:20 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-eb792297-355c-4e3d-b78e-fa089cd5ce1a tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:01:20 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-eb792297-355c-4e3d-b78e-fa089cd5ce1a tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:01:20 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-eb792297-355c-4e3d-b78e-fa089cd5ce1a tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:01:20 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-eb792297-355c-4e3d-b78e-fa089cd5ce1a tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:01:20 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-eb792297-355c-4e3d-b78e-fa089cd5ce1a tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:20 devstack sudo[90354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 16:01:20 devstack sudo[90354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:20 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-b4c0f5f1-88d8-4500-98b9-a0acecb209a4 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Acquiring lock "cinder-e3441c07-97e5-42c6-9651-02310dd747da-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:01:20 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-b4c0f5f1-88d8-4500-98b9-a0acecb209a4 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Lock "cinder-e3441c07-97e5-42c6-9651-02310dd747da-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:01:20 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-b4c0f5f1-88d8-4500-98b9-a0acecb209a4 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Acquiring lock "cinder-quobyte-e3441c07-97e5-42c6-9651-02310dd747da" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:01:20 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-b4c0f5f1-88d8-4500-98b9-a0acecb209a4 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Lock "cinder-quobyte-e3441c07-97e5-42c6-9651-02310dd747da" acquired by "delete_volume" :: waited 0.007s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:01:20 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d586558-762b-4be8-a23a-5bcbc3fe3ffc]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:01:20 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b4c0f5f1-88d8-4500-98b9-a0acecb209a4 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e3441c07-97e5-42c6-9651-02310dd747da {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:20 devstack sudo[90356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e3441c07-97e5-42c6-9651-02310dd747da
Apr 15 16:01:20 devstack sudo[90356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:21 devstack sudo[90354]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-eb792297-355c-4e3d-b78e-fa089cd5ce1a tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.427s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:21 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-eb792297-355c-4e3d-b78e-fa089cd5ce1a tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:01:21 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-eb792297-355c-4e3d-b78e-fa089cd5ce1a tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Deleted volume successfully.
Apr 15 16:01:21 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-eb792297-355c-4e3d-b78e-fa089cd5ce1a tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Lock "cinder-6e274d24-f847-4eee-a6c9-384ca6088fc7-delete_volume" released by "delete_volume" :: held 1.412s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:01:21 devstack sudo[90356]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b4c0f5f1-88d8-4500-98b9-a0acecb209a4 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e3441c07-97e5-42c6-9651-02310dd747da" returned: 0 in 0.460s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b4c0f5f1-88d8-4500-98b9-a0acecb209a4 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e3441c07-97e5-42c6-9651-02310dd747da {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:21 devstack sudo[90362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e3441c07-97e5-42c6-9651-02310dd747da
Apr 15 16:01:21 devstack sudo[90362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:21 devstack sudo[90362]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b4c0f5f1-88d8-4500-98b9-a0acecb209a4 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-e3441c07-97e5-42c6-9651-02310dd747da" returned: 0 in 0.388s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:21 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-b4c0f5f1-88d8-4500-98b9-a0acecb209a4 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Lock "cinder-quobyte-e3441c07-97e5-42c6-9651-02310dd747da" released by "delete_volume" :: held 0.868s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:01:21 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-b4c0f5f1-88d8-4500-98b9-a0acecb209a4 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Created reservations ['b496443c-00aa-4291-9db1-700fedd39843', 'cb11da50-1e35-418b-bd11-45d50ce36bf4', '72a9485a-02a5-438d-b343-76f3634eb7c2', '8d5fb284-f1ce-45d9-b7be-c971ad7a10e1'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:01:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-b4c0f5f1-88d8-4500-98b9-a0acecb209a4 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:01:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-b4c0f5f1-88d8-4500-98b9-a0acecb209a4 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:01:21 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-b4c0f5f1-88d8-4500-98b9-a0acecb209a4 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:01:21 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-b4c0f5f1-88d8-4500-98b9-a0acecb209a4 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:01:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-b4c0f5f1-88d8-4500-98b9-a0acecb209a4 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:01:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b4c0f5f1-88d8-4500-98b9-a0acecb209a4 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:21 devstack sudo[90365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 16:01:21 devstack sudo[90365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:21 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-9e23715b-05d7-4bf7-8e69-b8ce6141cc72 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Acquiring lock "cinder-06542dfe-6b1e-43b8-a966-ea349f55c0c0-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:01:21 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-9e23715b-05d7-4bf7-8e69-b8ce6141cc72 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Lock "cinder-06542dfe-6b1e-43b8-a966-ea349f55c0c0-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:01:21 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-9e23715b-05d7-4bf7-8e69-b8ce6141cc72 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Acquiring lock "cinder-quobyte-06542dfe-6b1e-43b8-a966-ea349f55c0c0" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:01:21 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-9e23715b-05d7-4bf7-8e69-b8ce6141cc72 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Lock "cinder-quobyte-06542dfe-6b1e-43b8-a966-ea349f55c0c0" acquired by "delete_volume" :: waited 0.007s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:01:21 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9a688f-d514-4131-a348-ca308c71f3e6]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:01:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9e23715b-05d7-4bf7-8e69-b8ce6141cc72 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-06542dfe-6b1e-43b8-a966-ea349f55c0c0 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:21 devstack sudo[90367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-06542dfe-6b1e-43b8-a966-ea349f55c0c0
Apr 15 16:01:22 devstack sudo[90367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:22 devstack sudo[90365]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:22 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b4c0f5f1-88d8-4500-98b9-a0acecb209a4 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.417s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:22 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-b4c0f5f1-88d8-4500-98b9-a0acecb209a4 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:01:22 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-b4c0f5f1-88d8-4500-98b9-a0acecb209a4 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Deleted volume successfully.
Apr 15 16:01:22 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-b4c0f5f1-88d8-4500-98b9-a0acecb209a4 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Lock "cinder-e3441c07-97e5-42c6-9651-02310dd747da-delete_volume" released by "delete_volume" :: held 1.415s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:01:22 devstack sudo[90367]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:22 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9e23715b-05d7-4bf7-8e69-b8ce6141cc72 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-06542dfe-6b1e-43b8-a966-ea349f55c0c0" returned: 0 in 0.472s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:22 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9e23715b-05d7-4bf7-8e69-b8ce6141cc72 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-06542dfe-6b1e-43b8-a966-ea349f55c0c0 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:22 devstack sudo[90373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-06542dfe-6b1e-43b8-a966-ea349f55c0c0
Apr 15 16:01:22 devstack sudo[90373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:22 devstack sudo[90373]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:22 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9e23715b-05d7-4bf7-8e69-b8ce6141cc72 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-06542dfe-6b1e-43b8-a966-ea349f55c0c0" returned: 0 in 0.391s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:22 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-9e23715b-05d7-4bf7-8e69-b8ce6141cc72 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Lock "cinder-quobyte-06542dfe-6b1e-43b8-a966-ea349f55c0c0" released by "delete_volume" :: held 0.886s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:01:22 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-9e23715b-05d7-4bf7-8e69-b8ce6141cc72 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Created reservations ['a85d6cbf-6582-40eb-83f1-ad1c0e3c68e1', 'caedd1b1-ce80-40ee-b3ef-c32e217a168b', 'd6a3fb2d-013d-43de-a5a4-fef9090184d9', '816eeee7-8c73-4deb-88fe-ff87fe746e71'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:01:22 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-9e23715b-05d7-4bf7-8e69-b8ce6141cc72 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:01:22 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-9e23715b-05d7-4bf7-8e69-b8ce6141cc72 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:01:22 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-9e23715b-05d7-4bf7-8e69-b8ce6141cc72 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:01:22 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-9e23715b-05d7-4bf7-8e69-b8ce6141cc72 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:01:22 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-9e23715b-05d7-4bf7-8e69-b8ce6141cc72 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:01:22 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9e23715b-05d7-4bf7-8e69-b8ce6141cc72 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:22 devstack sudo[90376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 16:01:22 devstack sudo[90376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:22 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-6427e8e9-1b45-4318-bf7f-b592ec14e502 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Acquiring lock "cinder-8f5292dd-8165-45b6-b1a1-1f3080cfb775-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:01:23 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-6427e8e9-1b45-4318-bf7f-b592ec14e502 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Lock "cinder-8f5292dd-8165-45b6-b1a1-1f3080cfb775-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:01:23 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-6427e8e9-1b45-4318-bf7f-b592ec14e502 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Acquiring lock "cinder-quobyte-8f5292dd-8165-45b6-b1a1-1f3080cfb775" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:01:23 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-6427e8e9-1b45-4318-bf7f-b592ec14e502 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Lock "cinder-quobyte-8f5292dd-8165-45b6-b1a1-1f3080cfb775" acquired by "delete_volume" :: waited 0.018s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:01:23 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[7391e0cd-6dec-42b9-b7ce-6f8da3fb530b]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:01:23 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6427e8e9-1b45-4318-bf7f-b592ec14e502 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8f5292dd-8165-45b6-b1a1-1f3080cfb775 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:23 devstack sudo[90378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8f5292dd-8165-45b6-b1a1-1f3080cfb775
Apr 15 16:01:23 devstack sudo[90378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:23 devstack sudo[90376]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:23 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9e23715b-05d7-4bf7-8e69-b8ce6141cc72 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.425s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:23 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-9e23715b-05d7-4bf7-8e69-b8ce6141cc72 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:01:23 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-9e23715b-05d7-4bf7-8e69-b8ce6141cc72 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Deleted volume successfully.
Apr 15 16:01:23 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-9e23715b-05d7-4bf7-8e69-b8ce6141cc72 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Lock "cinder-06542dfe-6b1e-43b8-a966-ea349f55c0c0-delete_volume" released by "delete_volume" :: held 1.436s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:01:23 devstack sudo[90378]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:23 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6427e8e9-1b45-4318-bf7f-b592ec14e502 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8f5292dd-8165-45b6-b1a1-1f3080cfb775" returned: 0 in 0.477s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:23 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6427e8e9-1b45-4318-bf7f-b592ec14e502 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8f5292dd-8165-45b6-b1a1-1f3080cfb775 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:23 devstack sudo[90384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8f5292dd-8165-45b6-b1a1-1f3080cfb775
Apr 15 16:01:23 devstack sudo[90384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:23 devstack sudo[90384]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:23 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6427e8e9-1b45-4318-bf7f-b592ec14e502 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-8f5292dd-8165-45b6-b1a1-1f3080cfb775" returned: 0 in 0.402s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:23 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-6427e8e9-1b45-4318-bf7f-b592ec14e502 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Lock "cinder-quobyte-8f5292dd-8165-45b6-b1a1-1f3080cfb775" released by "delete_volume" :: held 0.900s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:01:23 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-6427e8e9-1b45-4318-bf7f-b592ec14e502 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Created reservations ['15f956e1-9d39-4e1f-92dc-81c118048472', 'b45f7705-ca47-4b45-8e53-4ad0d787b762', '311c365f-163c-4ac1-810e-5eeb7ff71b6a', 'c97fb329-9ee9-4c20-8730-c73700f7972f'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:01:24 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-6427e8e9-1b45-4318-bf7f-b592ec14e502 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:01:24 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-6427e8e9-1b45-4318-bf7f-b592ec14e502 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:01:24 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-6427e8e9-1b45-4318-bf7f-b592ec14e502 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:01:24 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-6427e8e9-1b45-4318-bf7f-b592ec14e502 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:01:24 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-6427e8e9-1b45-4318-bf7f-b592ec14e502 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:01:24 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6427e8e9-1b45-4318-bf7f-b592ec14e502 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:24 devstack sudo[90387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 16:01:24 devstack sudo[90387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:24 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-7ccd33e9-b84f-482b-aa4d-acb37d438a66 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Acquiring lock "cinder-ae1fff32-5c65-4f8c-bf02-7b34fc87544a-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:01:24 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-7ccd33e9-b84f-482b-aa4d-acb37d438a66 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Lock "cinder-ae1fff32-5c65-4f8c-bf02-7b34fc87544a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:01:24 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-7ccd33e9-b84f-482b-aa4d-acb37d438a66 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Acquiring lock "cinder-quobyte-ae1fff32-5c65-4f8c-bf02-7b34fc87544a" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:01:24 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-7ccd33e9-b84f-482b-aa4d-acb37d438a66 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Lock "cinder-quobyte-ae1fff32-5c65-4f8c-bf02-7b34fc87544a" acquired by "delete_volume" :: waited 0.007s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:01:24 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[2681b9db-5fe6-44f1-a0f9-c3d147b6f8ab]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:01:24 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7ccd33e9-b84f-482b-aa4d-acb37d438a66 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ae1fff32-5c65-4f8c-bf02-7b34fc87544a {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:24 devstack sudo[90389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ae1fff32-5c65-4f8c-bf02-7b34fc87544a
Apr 15 16:01:24 devstack sudo[90389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:24 devstack sudo[90387]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:24 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6427e8e9-1b45-4318-bf7f-b592ec14e502 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.409s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:24 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-6427e8e9-1b45-4318-bf7f-b592ec14e502 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:01:24 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-6427e8e9-1b45-4318-bf7f-b592ec14e502 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Deleted volume successfully.
Apr 15 16:01:24 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-6427e8e9-1b45-4318-bf7f-b592ec14e502 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Lock "cinder-8f5292dd-8165-45b6-b1a1-1f3080cfb775-delete_volume" released by "delete_volume" :: held 1.439s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:01:24 devstack sudo[90389]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:24 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7ccd33e9-b84f-482b-aa4d-acb37d438a66 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ae1fff32-5c65-4f8c-bf02-7b34fc87544a" returned: 0 in 0.490s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:24 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7ccd33e9-b84f-482b-aa4d-acb37d438a66 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ae1fff32-5c65-4f8c-bf02-7b34fc87544a {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:24 devstack sudo[90396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ae1fff32-5c65-4f8c-bf02-7b34fc87544a
Apr 15 16:01:24 devstack sudo[90396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:25 devstack sudo[90396]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:25 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7ccd33e9-b84f-482b-aa4d-acb37d438a66 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-ae1fff32-5c65-4f8c-bf02-7b34fc87544a" returned: 0 in 0.417s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:25 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-7ccd33e9-b84f-482b-aa4d-acb37d438a66 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Lock "cinder-quobyte-ae1fff32-5c65-4f8c-bf02-7b34fc87544a" released by "delete_volume" :: held 0.933s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:01:25 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-7ccd33e9-b84f-482b-aa4d-acb37d438a66 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Created reservations ['05bffc3c-41ae-432a-986a-76f2d41f090e', 'ba7fe6af-eebc-4f34-96fc-13d328d105f3', '63c953f8-1804-4950-8daf-fb2e307847ab', 'f8b03a85-d680-4460-8a39-84d05cfd5a4b'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:01:25 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7ccd33e9-b84f-482b-aa4d-acb37d438a66 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:01:25 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7ccd33e9-b84f-482b-aa4d-acb37d438a66 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:01:25 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-7ccd33e9-b84f-482b-aa4d-acb37d438a66 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:01:25 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-7ccd33e9-b84f-482b-aa4d-acb37d438a66 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:01:25 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7ccd33e9-b84f-482b-aa4d-acb37d438a66 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:01:25 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7ccd33e9-b84f-482b-aa4d-acb37d438a66 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:25 devstack sudo[90399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 16:01:25 devstack sudo[90399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:25 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-5e912e67-3fcd-4abc-8848-70e8c71ac841 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Acquiring lock "cinder-4e922e9b-104e-4585-adf1-7a6ee5b3f6eb-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:01:25 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-5e912e67-3fcd-4abc-8848-70e8c71ac841 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Lock "cinder-4e922e9b-104e-4585-adf1-7a6ee5b3f6eb-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:01:25 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-5e912e67-3fcd-4abc-8848-70e8c71ac841 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Acquiring lock "cinder-quobyte-4e922e9b-104e-4585-adf1-7a6ee5b3f6eb" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:01:25 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-5e912e67-3fcd-4abc-8848-70e8c71ac841 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Lock "cinder-quobyte-4e922e9b-104e-4585-adf1-7a6ee5b3f6eb" acquired by "delete_volume" :: waited 0.007s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:01:25 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e01683e-c875-4f63-bdf9-686a8b15f10c]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:01:25 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-5e912e67-3fcd-4abc-8848-70e8c71ac841 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-4e922e9b-104e-4585-adf1-7a6ee5b3f6eb {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:25 devstack sudo[90401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-4e922e9b-104e-4585-adf1-7a6ee5b3f6eb
Apr 15 16:01:25 devstack sudo[90401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:25 devstack sudo[90399]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:25 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7ccd33e9-b84f-482b-aa4d-acb37d438a66 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.420s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:25 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-7ccd33e9-b84f-482b-aa4d-acb37d438a66 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:01:25 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-7ccd33e9-b84f-482b-aa4d-acb37d438a66 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Deleted volume successfully.
Apr 15 16:01:25 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-7ccd33e9-b84f-482b-aa4d-acb37d438a66 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Lock "cinder-ae1fff32-5c65-4f8c-bf02-7b34fc87544a-delete_volume" released by "delete_volume" :: held 1.473s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:01:25 devstack sudo[90401]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:25 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-5e912e67-3fcd-4abc-8848-70e8c71ac841 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-4e922e9b-104e-4585-adf1-7a6ee5b3f6eb" returned: 0 in 0.473s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:25 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-5e912e67-3fcd-4abc-8848-70e8c71ac841 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-4e922e9b-104e-4585-adf1-7a6ee5b3f6eb {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:25 devstack sudo[90407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-4e922e9b-104e-4585-adf1-7a6ee5b3f6eb
Apr 15 16:01:25 devstack sudo[90407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:26 devstack sudo[90407]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-5e912e67-3fcd-4abc-8848-70e8c71ac841 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-4e922e9b-104e-4585-adf1-7a6ee5b3f6eb" returned: 0 in 0.400s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:26 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-5e912e67-3fcd-4abc-8848-70e8c71ac841 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Lock "cinder-quobyte-4e922e9b-104e-4585-adf1-7a6ee5b3f6eb" released by "delete_volume" :: held 0.899s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:01:26 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-5e912e67-3fcd-4abc-8848-70e8c71ac841 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Created reservations ['2e77920a-a38c-40db-b794-a9b1ebdfa000', 'c9ef083c-ab82-42e8-bd66-e86130e884b3', '407d4846-52d9-426b-912b-943f1c08d3f5', '6b451830-5532-4f03-8309-b1272ddd0cb1'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:01:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-5e912e67-3fcd-4abc-8848-70e8c71ac841 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:01:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-5e912e67-3fcd-4abc-8848-70e8c71ac841 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:01:26 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-5e912e67-3fcd-4abc-8848-70e8c71ac841 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:01:26 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-5e912e67-3fcd-4abc-8848-70e8c71ac841 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:01:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-5e912e67-3fcd-4abc-8848-70e8c71ac841 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:01:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-5e912e67-3fcd-4abc-8848-70e8c71ac841 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:26 devstack sudo[90410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 16:01:26 devstack sudo[90410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:26 devstack sudo[90410]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-5e912e67-3fcd-4abc-8848-70e8c71ac841 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.476s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:26 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-5e912e67-3fcd-4abc-8848-70e8c71ac841 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:01:26 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-5e912e67-3fcd-4abc-8848-70e8c71ac841 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Deleted volume successfully.
Apr 15 16:01:26 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-5e912e67-3fcd-4abc-8848-70e8c71ac841 tempest-CreateVolumesFromSourceVolumeTest-1274280723 None] Lock "cinder-4e922e9b-104e-4585-adf1-7a6ee5b3f6eb-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:01:33 devstack cinder-volume[82485]: DEBUG dbcounter [-] [82485] Writing DB stats cinder:SELECT=130,cinder:INSERT=46,cinder:UPDATE=207,cinder:DELETE=16 {{(pid=82485) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 16:01:33 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-94a2223d-ccb7-4ed7-b277-81fdf6fcb6f3 tempest-CreateVolumesFromImageTest-674786425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:01:33 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-94a2223d-ccb7-4ed7-b277-81fdf6fcb6f3 tempest-CreateVolumesFromImageTest-674786425 None] Flow 'volume_create_manager' (7b8654d3-944b-4505-af11-9a1b0da0a1e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:01:33 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-94a2223d-ccb7-4ed7-b277-81fdf6fcb6f3 tempest-CreateVolumesFromImageTest-674786425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8126fabc-80f3-4a0c-86a5-8c4c226b9fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:33 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-9771f442-0bcf-4b7f-9c5f-0fb83c0f36bb tempest-VolumeDependencyTests-972921078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:01:33 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9771f442-0bcf-4b7f-9c5f-0fb83c0f36bb tempest-VolumeDependencyTests-972921078 None] Flow 'volume_create_manager' (30b8d59f-1abe-4432-b3bc-fc0ba371291e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:01:33 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9771f442-0bcf-4b7f-9c5f-0fb83c0f36bb tempest-VolumeDependencyTests-972921078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d12c48d-de81-4fea-bbeb-5dd5efb98b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:33 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9771f442-0bcf-4b7f-9c5f-0fb83c0f36bb tempest-VolumeDependencyTests-972921078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d12c48d-de81-4fea-bbeb-5dd5efb98b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:01:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1143862684',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d363d48ee3e40b5a9f7d410914be77e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:01:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:01:34Z,use_quota=True,user_id='da5723df3b9d48f09a9929ddb60988ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:33 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9771f442-0bcf-4b7f-9c5f-0fb83c0f36bb tempest-VolumeDependencyTests-972921078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ce5d4f1-5de3-48a7-b3dd-fa8da470b489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:33 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9771f442-0bcf-4b7f-9c5f-0fb83c0f36bb tempest-VolumeDependencyTests-972921078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ce5d4f1-5de3-48a7-b3dd-fa8da470b489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:33 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9771f442-0bcf-4b7f-9c5f-0fb83c0f36bb tempest-VolumeDependencyTests-972921078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3c40f40-6c36-47be-b981-4bd977a60660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:33 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9771f442-0bcf-4b7f-9c5f-0fb83c0f36bb tempest-VolumeDependencyTests-972921078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3c40f40-6c36-47be-b981-4bd977a60660) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e', 'volume_name': 'volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:33 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9771f442-0bcf-4b7f-9c5f-0fb83c0f36bb tempest-VolumeDependencyTests-972921078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a6c6b0d-87bf-4181-a95b-ec7bec937744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:33 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9771f442-0bcf-4b7f-9c5f-0fb83c0f36bb tempest-VolumeDependencyTests-972921078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a6c6b0d-87bf-4181-a95b-ec7bec937744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:33 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9771f442-0bcf-4b7f-9c5f-0fb83c0f36bb tempest-VolumeDependencyTests-972921078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81660fe8-5818-4928-b9ce-0ea113cc4e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:33 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-9771f442-0bcf-4b7f-9c5f-0fb83c0f36bb tempest-VolumeDependencyTests-972921078 None] Volume 6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e', 'volume_size': 1}
Apr 15 16:01:33 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-9771f442-0bcf-4b7f-9c5f-0fb83c0f36bb tempest-VolumeDependencyTests-972921078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:01:33 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-9771f442-0bcf-4b7f-9c5f-0fb83c0f36bb tempest-VolumeDependencyTests-972921078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:01:33 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-9771f442-0bcf-4b7f-9c5f-0fb83c0f36bb tempest-VolumeDependencyTests-972921078 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:01:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1143862684',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d363d48ee3e40b5a9f7d410914be77e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:01:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:01:34Z,use_quota=True,user_id='da5723df3b9d48f09a9929ddb60988ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:01:33 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-9771f442-0bcf-4b7f-9c5f-0fb83c0f36bb tempest-VolumeDependencyTests-972921078 None] Creating volume 6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:01:33 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-9771f442-0bcf-4b7f-9c5f-0fb83c0f36bb tempest-VolumeDependencyTests-972921078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:01:33 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-9771f442-0bcf-4b7f-9c5f-0fb83c0f36bb tempest-VolumeDependencyTests-972921078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:01:33 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-9771f442-0bcf-4b7f-9c5f-0fb83c0f36bb tempest-VolumeDependencyTests-972921078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:01:33 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-9771f442-0bcf-4b7f-9c5f-0fb83c0f36bb tempest-VolumeDependencyTests-972921078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:01:33 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-9771f442-0bcf-4b7f-9c5f-0fb83c0f36bb tempest-VolumeDependencyTests-972921078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:01:33 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-9771f442-0bcf-4b7f-9c5f-0fb83c0f36bb tempest-VolumeDependencyTests-972921078 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:01:33 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-9771f442-0bcf-4b7f-9c5f-0fb83c0f36bb tempest-VolumeDependencyTests-972921078 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 16:01:33 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9771f442-0bcf-4b7f-9c5f-0fb83c0f36bb tempest-VolumeDependencyTests-972921078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:33 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-94a2223d-ccb7-4ed7-b277-81fdf6fcb6f3 tempest-CreateVolumesFromImageTest-674786425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8126fabc-80f3-4a0c-86a5-8c4c226b9fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:01:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-829086719',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2993beb2-5457-4aea-9cac-cc4b320ed87e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e7042a89147490fb10984314ce2d6f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:01:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:01:34Z,use_quota=True,user_id='fef39af0c3504c6693f4eea214ebb639',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:33 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-94a2223d-ccb7-4ed7-b277-81fdf6fcb6f3 tempest-CreateVolumesFromImageTest-674786425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2c4b017-5baa-4a15-913b-ae4599e3c702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:33 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-94a2223d-ccb7-4ed7-b277-81fdf6fcb6f3 tempest-CreateVolumesFromImageTest-674786425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2c4b017-5baa-4a15-913b-ae4599e3c702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:33 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-94a2223d-ccb7-4ed7-b277-81fdf6fcb6f3 tempest-CreateVolumesFromImageTest-674786425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1785322d-8697-42f9-8732-ecfbe523643c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:33 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-94a2223d-ccb7-4ed7-b277-81fdf6fcb6f3 tempest-CreateVolumesFromImageTest-674786425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1785322d-8697-42f9-8732-ecfbe523643c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2993beb2-5457-4aea-9cac-cc4b320ed87e', 'volume_name': 'volume-2993beb2-5457-4aea-9cac-cc4b320ed87e', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:33 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-94a2223d-ccb7-4ed7-b277-81fdf6fcb6f3 tempest-CreateVolumesFromImageTest-674786425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f8edf45-1ca2-40ec-b7c8-63db2dcd567c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:33 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-94a2223d-ccb7-4ed7-b277-81fdf6fcb6f3 tempest-CreateVolumesFromImageTest-674786425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f8edf45-1ca2-40ec-b7c8-63db2dcd567c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:33 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-94a2223d-ccb7-4ed7-b277-81fdf6fcb6f3 tempest-CreateVolumesFromImageTest-674786425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51e3b350-d176-45f2-8bdb-ced8c0e58c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:33 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-94a2223d-ccb7-4ed7-b277-81fdf6fcb6f3 tempest-CreateVolumesFromImageTest-674786425 None] Volume 2993beb2-5457-4aea-9cac-cc4b320ed87e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2993beb2-5457-4aea-9cac-cc4b320ed87e', 'volume_size': 1}
Apr 15 16:01:33 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-94a2223d-ccb7-4ed7-b277-81fdf6fcb6f3 tempest-CreateVolumesFromImageTest-674786425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:01:33 devstack sudo[90454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e 1073741824
Apr 15 16:01:33 devstack sudo[90454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:33 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3faeff0-59d9-410b-9c9b-9adda7e6c286 tempest-CreateVolumesFromImageTest-674786425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:01:33 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d3faeff0-59d9-410b-9c9b-9adda7e6c286 tempest-CreateVolumesFromImageTest-674786425 None] Flow 'volume_create_manager' (f9fe4476-e234-4cdd-87c5-82e9508f057b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:01:33 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d3faeff0-59d9-410b-9c9b-9adda7e6c286 tempest-CreateVolumesFromImageTest-674786425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63c6aa43-1c07-4bcd-9179-52e8d1273ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:33 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d3faeff0-59d9-410b-9c9b-9adda7e6c286 tempest-CreateVolumesFromImageTest-674786425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63c6aa43-1c07-4bcd-9179-52e8d1273ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:01:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1608486953',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61b77847-5f78-42a7-8b82-faf531b8caff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e7042a89147490fb10984314ce2d6f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:01:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:01:34Z,use_quota=True,user_id='fef39af0c3504c6693f4eea214ebb639',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d3faeff0-59d9-410b-9c9b-9adda7e6c286 tempest-CreateVolumesFromImageTest-674786425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2f850ea-28fc-4708-b659-4a5deda95ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d3faeff0-59d9-410b-9c9b-9adda7e6c286 tempest-CreateVolumesFromImageTest-674786425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2f850ea-28fc-4708-b659-4a5deda95ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d3faeff0-59d9-410b-9c9b-9adda7e6c286 tempest-CreateVolumesFromImageTest-674786425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d35f8a0a-3217-49d7-96b1-d32f292c55a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d3faeff0-59d9-410b-9c9b-9adda7e6c286 tempest-CreateVolumesFromImageTest-674786425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d35f8a0a-3217-49d7-96b1-d32f292c55a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61b77847-5f78-42a7-8b82-faf531b8caff', 'volume_name': 'volume-61b77847-5f78-42a7-8b82-faf531b8caff', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d3faeff0-59d9-410b-9c9b-9adda7e6c286 tempest-CreateVolumesFromImageTest-674786425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (128afab5-908c-4e31-b62d-34b1b54fa412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d3faeff0-59d9-410b-9c9b-9adda7e6c286 tempest-CreateVolumesFromImageTest-674786425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (128afab5-908c-4e31-b62d-34b1b54fa412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d3faeff0-59d9-410b-9c9b-9adda7e6c286 tempest-CreateVolumesFromImageTest-674786425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f26f93b-7a7d-4c58-af1d-e063a5bc81d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:34 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-d3faeff0-59d9-410b-9c9b-9adda7e6c286 tempest-CreateVolumesFromImageTest-674786425 None] Volume 61b77847-5f78-42a7-8b82-faf531b8caff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61b77847-5f78-42a7-8b82-faf531b8caff', 'volume_size': 1}
Apr 15 16:01:34 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-d3faeff0-59d9-410b-9c9b-9adda7e6c286 tempest-CreateVolumesFromImageTest-674786425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:01:34 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-9371e651-bbe8-450f-912a-49a44297696f tempest-CreateVolumesFromSnapshotTest-222009090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:01:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9371e651-bbe8-450f-912a-49a44297696f tempest-CreateVolumesFromSnapshotTest-222009090 None] Flow 'volume_create_manager' (172a58f1-0877-470f-b205-de2bfa914c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:01:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9371e651-bbe8-450f-912a-49a44297696f tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cec1c12-3eba-490b-9117-bf4730c45bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9371e651-bbe8-450f-912a-49a44297696f tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cec1c12-3eba-490b-9117-bf4730c45bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:01:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2092337905',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7443389655b74f149df0a24eb30d8dc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:01:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:01:34Z,use_quota=True,user_id='652d06f55c70440e9cb36b14ad2e5e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9371e651-bbe8-450f-912a-49a44297696f tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d655127-1a0f-4a3f-8745-bd16910df7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9371e651-bbe8-450f-912a-49a44297696f tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d655127-1a0f-4a3f-8745-bd16910df7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9371e651-bbe8-450f-912a-49a44297696f tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c7c6a05-39e0-44d2-b256-6dad35ac2fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9371e651-bbe8-450f-912a-49a44297696f tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c7c6a05-39e0-44d2-b256-6dad35ac2fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304', 'volume_name': 'volume-a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9371e651-bbe8-450f-912a-49a44297696f tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5bfd510-e739-43a6-87ae-e2b75ea45e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9371e651-bbe8-450f-912a-49a44297696f tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5bfd510-e739-43a6-87ae-e2b75ea45e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9371e651-bbe8-450f-912a-49a44297696f tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86ee276c-6309-4fb2-8eef-b7f1eb509f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:34 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-9371e651-bbe8-450f-912a-49a44297696f tempest-CreateVolumesFromSnapshotTest-222009090 None] Volume a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304', 'volume_size': 1}
Apr 15 16:01:34 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-9371e651-bbe8-450f-912a-49a44297696f tempest-CreateVolumesFromSnapshotTest-222009090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:01:34 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-7281e066-9cfe-4658-8454-d5593fb6d028 tempest-CreateVolumesFromImageTest-674786425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:01:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7281e066-9cfe-4658-8454-d5593fb6d028 tempest-CreateVolumesFromImageTest-674786425 None] Flow 'volume_create_manager' (1bc07653-49cc-470f-b7af-71664e29933f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:01:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7281e066-9cfe-4658-8454-d5593fb6d028 tempest-CreateVolumesFromImageTest-674786425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a30c56a-7386-4aa4-b959-624cab0a6b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7281e066-9cfe-4658-8454-d5593fb6d028 tempest-CreateVolumesFromImageTest-674786425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a30c56a-7386-4aa4-b959-624cab0a6b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:01:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1852009413',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a66db6bf-7a50-4cb6-b299-bc8ea36ef2a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e7042a89147490fb10984314ce2d6f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:01:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:01:34Z,use_quota=True,user_id='fef39af0c3504c6693f4eea214ebb639',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7281e066-9cfe-4658-8454-d5593fb6d028 tempest-CreateVolumesFromImageTest-674786425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fda98a4-0ab2-493a-96b5-5ae5047788fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7281e066-9cfe-4658-8454-d5593fb6d028 tempest-CreateVolumesFromImageTest-674786425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fda98a4-0ab2-493a-96b5-5ae5047788fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7281e066-9cfe-4658-8454-d5593fb6d028 tempest-CreateVolumesFromImageTest-674786425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7450133-dc4b-4258-8f97-2b1beb5fdc55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7281e066-9cfe-4658-8454-d5593fb6d028 tempest-CreateVolumesFromImageTest-674786425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7450133-dc4b-4258-8f97-2b1beb5fdc55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a66db6bf-7a50-4cb6-b299-bc8ea36ef2a6', 'volume_name': 'volume-a66db6bf-7a50-4cb6-b299-bc8ea36ef2a6', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7281e066-9cfe-4658-8454-d5593fb6d028 tempest-CreateVolumesFromImageTest-674786425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc70e35a-b133-478f-8cd1-b7bda0675313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7281e066-9cfe-4658-8454-d5593fb6d028 tempest-CreateVolumesFromImageTest-674786425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc70e35a-b133-478f-8cd1-b7bda0675313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7281e066-9cfe-4658-8454-d5593fb6d028 tempest-CreateVolumesFromImageTest-674786425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (181fd42f-f4a0-487c-8622-f785e99e433d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:34 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-7281e066-9cfe-4658-8454-d5593fb6d028 tempest-CreateVolumesFromImageTest-674786425 None] Volume a66db6bf-7a50-4cb6-b299-bc8ea36ef2a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a66db6bf-7a50-4cb6-b299-bc8ea36ef2a6', 'volume_size': 1}
Apr 15 16:01:34 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7281e066-9cfe-4658-8454-d5593fb6d028 tempest-CreateVolumesFromImageTest-674786425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:01:34 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-413c3cd4-1fdd-4b13-b808-d1d280d0371b tempest-CreateVolumesFromImageTest-674786425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:01:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-413c3cd4-1fdd-4b13-b808-d1d280d0371b tempest-CreateVolumesFromImageTest-674786425 None] Flow 'volume_create_manager' (c3476d41-ec16-4ea4-ae2b-64a6fc4f7182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:01:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-413c3cd4-1fdd-4b13-b808-d1d280d0371b tempest-CreateVolumesFromImageTest-674786425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e43e0622-0921-42cf-afd1-beecc238aed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-413c3cd4-1fdd-4b13-b808-d1d280d0371b tempest-CreateVolumesFromImageTest-674786425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e43e0622-0921-42cf-afd1-beecc238aed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:01:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1113667216',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=389f2bc9-81d7-4c96-b61c-ef1cd1299f4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e7042a89147490fb10984314ce2d6f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:01:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:01:34Z,use_quota=True,user_id='fef39af0c3504c6693f4eea214ebb639',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-413c3cd4-1fdd-4b13-b808-d1d280d0371b tempest-CreateVolumesFromImageTest-674786425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d53ee99-0c45-4991-ba0a-90c13ce3db3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-413c3cd4-1fdd-4b13-b808-d1d280d0371b tempest-CreateVolumesFromImageTest-674786425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d53ee99-0c45-4991-ba0a-90c13ce3db3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-413c3cd4-1fdd-4b13-b808-d1d280d0371b tempest-CreateVolumesFromImageTest-674786425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8584967b-dcc5-40c9-a1a0-9af5854f3479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-413c3cd4-1fdd-4b13-b808-d1d280d0371b tempest-CreateVolumesFromImageTest-674786425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8584967b-dcc5-40c9-a1a0-9af5854f3479) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '389f2bc9-81d7-4c96-b61c-ef1cd1299f4c', 'volume_name': 'volume-389f2bc9-81d7-4c96-b61c-ef1cd1299f4c', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-413c3cd4-1fdd-4b13-b808-d1d280d0371b tempest-CreateVolumesFromImageTest-674786425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (878021b4-28a2-47a9-b2c4-7d78a1b4a9c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-413c3cd4-1fdd-4b13-b808-d1d280d0371b tempest-CreateVolumesFromImageTest-674786425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (878021b4-28a2-47a9-b2c4-7d78a1b4a9c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-413c3cd4-1fdd-4b13-b808-d1d280d0371b tempest-CreateVolumesFromImageTest-674786425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce5e5887-306d-46f4-901b-7449800b4587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:34 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-413c3cd4-1fdd-4b13-b808-d1d280d0371b tempest-CreateVolumesFromImageTest-674786425 None] Volume 389f2bc9-81d7-4c96-b61c-ef1cd1299f4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-389f2bc9-81d7-4c96-b61c-ef1cd1299f4c', 'volume_size': 1}
Apr 15 16:01:34 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-413c3cd4-1fdd-4b13-b808-d1d280d0371b tempest-CreateVolumesFromImageTest-674786425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:01:34 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-41171272-eab7-4e01-bf1f-d8a2173a930a tempest-CreateVolumesFromImageTest-674786425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:01:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-41171272-eab7-4e01-bf1f-d8a2173a930a tempest-CreateVolumesFromImageTest-674786425 None] Flow 'volume_create_manager' (8ba760d7-1afc-43dd-a2d8-f7359ff7e4aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:01:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-41171272-eab7-4e01-bf1f-d8a2173a930a tempest-CreateVolumesFromImageTest-674786425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4feafb0d-a72f-4c16-8e6a-f7a58065c419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:34 devstack sudo[90454]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:34 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9771f442-0bcf-4b7f-9c5f-0fb83c0f36bb tempest-VolumeDependencyTests-972921078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e 1073741824" returned: 0 in 0.773s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-41171272-eab7-4e01-bf1f-d8a2173a930a tempest-CreateVolumesFromImageTest-674786425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4feafb0d-a72f-4c16-8e6a-f7a58065c419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:01:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2026769825',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0bc6280-a73b-44fd-9836-6c7d3afbd02e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e7042a89147490fb10984314ce2d6f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:01:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:01:35Z,use_quota=True,user_id='fef39af0c3504c6693f4eea214ebb639',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-41171272-eab7-4e01-bf1f-d8a2173a930a tempest-CreateVolumesFromImageTest-674786425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ce53b9d-fbd3-4353-8224-0f619891ec36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-41171272-eab7-4e01-bf1f-d8a2173a930a tempest-CreateVolumesFromImageTest-674786425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ce53b9d-fbd3-4353-8224-0f619891ec36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-41171272-eab7-4e01-bf1f-d8a2173a930a tempest-CreateVolumesFromImageTest-674786425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42210e3a-1625-4fec-9fa6-dccce6617f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-41171272-eab7-4e01-bf1f-d8a2173a930a tempest-CreateVolumesFromImageTest-674786425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42210e3a-1625-4fec-9fa6-dccce6617f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0bc6280-a73b-44fd-9836-6c7d3afbd02e', 'volume_name': 'volume-b0bc6280-a73b-44fd-9836-6c7d3afbd02e', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-41171272-eab7-4e01-bf1f-d8a2173a930a tempest-CreateVolumesFromImageTest-674786425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be6955f7-6705-473f-bd21-2fd11f4c4622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-41171272-eab7-4e01-bf1f-d8a2173a930a tempest-CreateVolumesFromImageTest-674786425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be6955f7-6705-473f-bd21-2fd11f4c4622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:34 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-41171272-eab7-4e01-bf1f-d8a2173a930a tempest-CreateVolumesFromImageTest-674786425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (851ffb51-b9a0-4d32-b7bb-e80f6ab6f5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:34 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-41171272-eab7-4e01-bf1f-d8a2173a930a tempest-CreateVolumesFromImageTest-674786425 None] Volume b0bc6280-a73b-44fd-9836-6c7d3afbd02e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0bc6280-a73b-44fd-9836-6c7d3afbd02e', 'volume_size': 1}
Apr 15 16:01:34 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-41171272-eab7-4e01-bf1f-d8a2173a930a tempest-CreateVolumesFromImageTest-674786425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:01:34 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9771f442-0bcf-4b7f-9c5f-0fb83c0f36bb tempest-VolumeDependencyTests-972921078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:34 devstack sudo[90460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e
Apr 15 16:01:34 devstack sudo[90460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:35 devstack sudo[90460]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:35 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9771f442-0bcf-4b7f-9c5f-0fb83c0f36bb tempest-VolumeDependencyTests-972921078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e" returned: 0 in 0.455s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:35 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-9771f442-0bcf-4b7f-9c5f-0fb83c0f36bb tempest-VolumeDependencyTests-972921078 None] <== create_volume: return (1294ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:01:35 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-9771f442-0bcf-4b7f-9c5f-0fb83c0f36bb tempest-VolumeDependencyTests-972921078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.296s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:01:35 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-94a2223d-ccb7-4ed7-b277-81fdf6fcb6f3 tempest-CreateVolumesFromImageTest-674786425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.235s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:01:35 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-94a2223d-ccb7-4ed7-b277-81fdf6fcb6f3 tempest-CreateVolumesFromImageTest-674786425 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:01:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-829086719',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2993beb2-5457-4aea-9cac-cc4b320ed87e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e7042a89147490fb10984314ce2d6f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:01:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:01:34Z,use_quota=True,user_id='fef39af0c3504c6693f4eea214ebb639',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:01:35 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-94a2223d-ccb7-4ed7-b277-81fdf6fcb6f3 tempest-CreateVolumesFromImageTest-674786425 None] Creating volume 2993beb2-5457-4aea-9cac-cc4b320ed87e {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:01:35 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-94a2223d-ccb7-4ed7-b277-81fdf6fcb6f3 tempest-CreateVolumesFromImageTest-674786425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:01:35 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-94a2223d-ccb7-4ed7-b277-81fdf6fcb6f3 tempest-CreateVolumesFromImageTest-674786425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:01:35 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-94a2223d-ccb7-4ed7-b277-81fdf6fcb6f3 tempest-CreateVolumesFromImageTest-674786425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:01:35 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-94a2223d-ccb7-4ed7-b277-81fdf6fcb6f3 tempest-CreateVolumesFromImageTest-674786425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:01:35 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-94a2223d-ccb7-4ed7-b277-81fdf6fcb6f3 tempest-CreateVolumesFromImageTest-674786425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:01:35 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-94a2223d-ccb7-4ed7-b277-81fdf6fcb6f3 tempest-CreateVolumesFromImageTest-674786425 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:01:35 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-94a2223d-ccb7-4ed7-b277-81fdf6fcb6f3 tempest-CreateVolumesFromImageTest-674786425 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 16:01:35 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-94a2223d-ccb7-4ed7-b277-81fdf6fcb6f3 tempest-CreateVolumesFromImageTest-674786425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-2993beb2-5457-4aea-9cac-cc4b320ed87e 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:35 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9771f442-0bcf-4b7f-9c5f-0fb83c0f36bb tempest-VolumeDependencyTests-972921078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81660fe8-5818-4928-b9ce-0ea113cc4e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:35 devstack sudo[90469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-2993beb2-5457-4aea-9cac-cc4b320ed87e 1073741824
Apr 15 16:01:35 devstack sudo[90469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:35 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9771f442-0bcf-4b7f-9c5f-0fb83c0f36bb tempest-VolumeDependencyTests-972921078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ca79e3e-9131-44bf-bd84-8a158cb1dc9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:35 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-9771f442-0bcf-4b7f-9c5f-0fb83c0f36bb tempest-VolumeDependencyTests-972921078 None] Volume volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e (6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e): created successfully
Apr 15 16:01:35 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9771f442-0bcf-4b7f-9c5f-0fb83c0f36bb tempest-VolumeDependencyTests-972921078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ca79e3e-9131-44bf-bd84-8a158cb1dc9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:35 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9771f442-0bcf-4b7f-9c5f-0fb83c0f36bb tempest-VolumeDependencyTests-972921078 None] Flow 'volume_create_manager' (30b8d59f-1abe-4432-b3bc-fc0ba371291e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:01:35 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-9771f442-0bcf-4b7f-9c5f-0fb83c0f36bb tempest-VolumeDependencyTests-972921078 None] Created volume successfully.
Apr 15 16:01:35 devstack sudo[90469]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:35 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-94a2223d-ccb7-4ed7-b277-81fdf6fcb6f3 tempest-CreateVolumesFromImageTest-674786425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-2993beb2-5457-4aea-9cac-cc4b320ed87e 1073741824" returned: 0 in 0.595s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:35 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-94a2223d-ccb7-4ed7-b277-81fdf6fcb6f3 tempest-CreateVolumesFromImageTest-674786425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-2993beb2-5457-4aea-9cac-cc4b320ed87e {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:35 devstack sudo[90474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-2993beb2-5457-4aea-9cac-cc4b320ed87e
Apr 15 16:01:35 devstack sudo[90474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:36 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-21155e68-aa00-4576-9986-62ed60c29f7c tempest-VolumeDependencyTests-972921078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:01:36 devstack sudo[90474]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:36 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-94a2223d-ccb7-4ed7-b277-81fdf6fcb6f3 tempest-CreateVolumesFromImageTest-674786425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-2993beb2-5457-4aea-9cac-cc4b320ed87e" returned: 0 in 0.539s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:36 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-94a2223d-ccb7-4ed7-b277-81fdf6fcb6f3 tempest-CreateVolumesFromImageTest-674786425 None] <== create_volume: return (1162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:01:36 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-94a2223d-ccb7-4ed7-b277-81fdf6fcb6f3 tempest-CreateVolumesFromImageTest-674786425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:01:36 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-d3faeff0-59d9-410b-9c9b-9adda7e6c286 tempest-CreateVolumesFromImageTest-674786425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.313s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:01:36 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-d3faeff0-59d9-410b-9c9b-9adda7e6c286 tempest-CreateVolumesFromImageTest-674786425 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:01:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1608486953',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61b77847-5f78-42a7-8b82-faf531b8caff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e7042a89147490fb10984314ce2d6f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:01:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:01:34Z,use_quota=True,user_id='fef39af0c3504c6693f4eea214ebb639',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:01:36 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-d3faeff0-59d9-410b-9c9b-9adda7e6c286 tempest-CreateVolumesFromImageTest-674786425 None] Creating volume 61b77847-5f78-42a7-8b82-faf531b8caff {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:01:36 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-d3faeff0-59d9-410b-9c9b-9adda7e6c286 tempest-CreateVolumesFromImageTest-674786425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:01:36 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-d3faeff0-59d9-410b-9c9b-9adda7e6c286 tempest-CreateVolumesFromImageTest-674786425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:01:36 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-d3faeff0-59d9-410b-9c9b-9adda7e6c286 tempest-CreateVolumesFromImageTest-674786425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:01:36 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-d3faeff0-59d9-410b-9c9b-9adda7e6c286 tempest-CreateVolumesFromImageTest-674786425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:01:36 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-d3faeff0-59d9-410b-9c9b-9adda7e6c286 tempest-CreateVolumesFromImageTest-674786425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:01:36 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-d3faeff0-59d9-410b-9c9b-9adda7e6c286 tempest-CreateVolumesFromImageTest-674786425 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:01:36 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-d3faeff0-59d9-410b-9c9b-9adda7e6c286 tempest-CreateVolumesFromImageTest-674786425 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 16:01:36 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-d3faeff0-59d9-410b-9c9b-9adda7e6c286 tempest-CreateVolumesFromImageTest-674786425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-61b77847-5f78-42a7-8b82-faf531b8caff 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:36 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-94a2223d-ccb7-4ed7-b277-81fdf6fcb6f3 tempest-CreateVolumesFromImageTest-674786425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51e3b350-d176-45f2-8bdb-ced8c0e58c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2993beb2-5457-4aea-9cac-cc4b320ed87e', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:36 devstack sudo[90477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-61b77847-5f78-42a7-8b82-faf531b8caff 1073741824
Apr 15 16:01:36 devstack sudo[90477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:36 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-94a2223d-ccb7-4ed7-b277-81fdf6fcb6f3 tempest-CreateVolumesFromImageTest-674786425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5ec203f-73f4-45ff-a5ee-263b9edc35e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:36 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-94a2223d-ccb7-4ed7-b277-81fdf6fcb6f3 tempest-CreateVolumesFromImageTest-674786425 None] Volume volume-2993beb2-5457-4aea-9cac-cc4b320ed87e (2993beb2-5457-4aea-9cac-cc4b320ed87e): created successfully
Apr 15 16:01:36 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-94a2223d-ccb7-4ed7-b277-81fdf6fcb6f3 tempest-CreateVolumesFromImageTest-674786425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5ec203f-73f4-45ff-a5ee-263b9edc35e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:36 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-94a2223d-ccb7-4ed7-b277-81fdf6fcb6f3 tempest-CreateVolumesFromImageTest-674786425 None] Flow 'volume_create_manager' (7b8654d3-944b-4505-af11-9a1b0da0a1e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:01:36 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-94a2223d-ccb7-4ed7-b277-81fdf6fcb6f3 tempest-CreateVolumesFromImageTest-674786425 None] Created volume successfully.
Apr 15 16:01:36 devstack sudo[90477]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:36 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-d3faeff0-59d9-410b-9c9b-9adda7e6c286 tempest-CreateVolumesFromImageTest-674786425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-61b77847-5f78-42a7-8b82-faf531b8caff 1073741824" returned: 0 in 0.574s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:36 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-d3faeff0-59d9-410b-9c9b-9adda7e6c286 tempest-CreateVolumesFromImageTest-674786425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-61b77847-5f78-42a7-8b82-faf531b8caff {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:36 devstack sudo[90482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-61b77847-5f78-42a7-8b82-faf531b8caff
Apr 15 16:01:36 devstack sudo[90482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:37 devstack sudo[90482]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:37 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-d3faeff0-59d9-410b-9c9b-9adda7e6c286 tempest-CreateVolumesFromImageTest-674786425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-61b77847-5f78-42a7-8b82-faf531b8caff" returned: 0 in 0.525s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:37 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-d3faeff0-59d9-410b-9c9b-9adda7e6c286 tempest-CreateVolumesFromImageTest-674786425 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:01:37 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-d3faeff0-59d9-410b-9c9b-9adda7e6c286 tempest-CreateVolumesFromImageTest-674786425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:01:37 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-9371e651-bbe8-450f-912a-49a44297696f tempest-CreateVolumesFromSnapshotTest-222009090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.269s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:01:37 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-9371e651-bbe8-450f-912a-49a44297696f tempest-CreateVolumesFromSnapshotTest-222009090 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:01:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2092337905',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7443389655b74f149df0a24eb30d8dc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:01:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:01:34Z,use_quota=True,user_id='652d06f55c70440e9cb36b14ad2e5e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:01:37 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-9371e651-bbe8-450f-912a-49a44297696f tempest-CreateVolumesFromSnapshotTest-222009090 None] Creating volume a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:01:37 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-9371e651-bbe8-450f-912a-49a44297696f tempest-CreateVolumesFromSnapshotTest-222009090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:01:37 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-9371e651-bbe8-450f-912a-49a44297696f tempest-CreateVolumesFromSnapshotTest-222009090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:01:37 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-9371e651-bbe8-450f-912a-49a44297696f tempest-CreateVolumesFromSnapshotTest-222009090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:01:37 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-9371e651-bbe8-450f-912a-49a44297696f tempest-CreateVolumesFromSnapshotTest-222009090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:01:37 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-9371e651-bbe8-450f-912a-49a44297696f tempest-CreateVolumesFromSnapshotTest-222009090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:01:37 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-9371e651-bbe8-450f-912a-49a44297696f tempest-CreateVolumesFromSnapshotTest-222009090 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:01:37 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-9371e651-bbe8-450f-912a-49a44297696f tempest-CreateVolumesFromSnapshotTest-222009090 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 16:01:37 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9371e651-bbe8-450f-912a-49a44297696f tempest-CreateVolumesFromSnapshotTest-222009090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:37 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d3faeff0-59d9-410b-9c9b-9adda7e6c286 tempest-CreateVolumesFromImageTest-674786425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f26f93b-7a7d-4c58-af1d-e063a5bc81d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61b77847-5f78-42a7-8b82-faf531b8caff', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:37 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d3faeff0-59d9-410b-9c9b-9adda7e6c286 tempest-CreateVolumesFromImageTest-674786425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c07e64fa-437b-4272-b34d-e9dc0264e4bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:37 devstack sudo[90485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304 1073741824
Apr 15 16:01:37 devstack sudo[90485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:37 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-d3faeff0-59d9-410b-9c9b-9adda7e6c286 tempest-CreateVolumesFromImageTest-674786425 None] Volume volume-61b77847-5f78-42a7-8b82-faf531b8caff (61b77847-5f78-42a7-8b82-faf531b8caff): created successfully
Apr 15 16:01:37 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d3faeff0-59d9-410b-9c9b-9adda7e6c286 tempest-CreateVolumesFromImageTest-674786425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c07e64fa-437b-4272-b34d-e9dc0264e4bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:37 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-d3faeff0-59d9-410b-9c9b-9adda7e6c286 tempest-CreateVolumesFromImageTest-674786425 None] Flow 'volume_create_manager' (f9fe4476-e234-4cdd-87c5-82e9508f057b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:01:37 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-d3faeff0-59d9-410b-9c9b-9adda7e6c286 tempest-CreateVolumesFromImageTest-674786425 None] Created volume successfully.
Apr 15 16:01:38 devstack sudo[90485]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:38 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9371e651-bbe8-450f-912a-49a44297696f tempest-CreateVolumesFromSnapshotTest-222009090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304 1073741824" returned: 0 in 0.633s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:38 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9371e651-bbe8-450f-912a-49a44297696f tempest-CreateVolumesFromSnapshotTest-222009090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:38 devstack sudo[90490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304
Apr 15 16:01:38 devstack sudo[90490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:38 devstack sudo[90490]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:38 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9371e651-bbe8-450f-912a-49a44297696f tempest-CreateVolumesFromSnapshotTest-222009090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304" returned: 0 in 0.510s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:38 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-9371e651-bbe8-450f-912a-49a44297696f tempest-CreateVolumesFromSnapshotTest-222009090 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:01:38 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-9371e651-bbe8-450f-912a-49a44297696f tempest-CreateVolumesFromSnapshotTest-222009090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:01:38 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7281e066-9cfe-4658-8454-d5593fb6d028 tempest-CreateVolumesFromImageTest-674786425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.395s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:01:38 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-7281e066-9cfe-4658-8454-d5593fb6d028 tempest-CreateVolumesFromImageTest-674786425 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:01:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1852009413',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a66db6bf-7a50-4cb6-b299-bc8ea36ef2a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e7042a89147490fb10984314ce2d6f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:01:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:01:34Z,use_quota=True,user_id='fef39af0c3504c6693f4eea214ebb639',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:01:38 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-7281e066-9cfe-4658-8454-d5593fb6d028 tempest-CreateVolumesFromImageTest-674786425 None] Creating volume a66db6bf-7a50-4cb6-b299-bc8ea36ef2a6 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:01:38 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7281e066-9cfe-4658-8454-d5593fb6d028 tempest-CreateVolumesFromImageTest-674786425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:01:38 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7281e066-9cfe-4658-8454-d5593fb6d028 tempest-CreateVolumesFromImageTest-674786425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:01:38 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-7281e066-9cfe-4658-8454-d5593fb6d028 tempest-CreateVolumesFromImageTest-674786425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:01:38 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-7281e066-9cfe-4658-8454-d5593fb6d028 tempest-CreateVolumesFromImageTest-674786425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:01:38 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7281e066-9cfe-4658-8454-d5593fb6d028 tempest-CreateVolumesFromImageTest-674786425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:01:38 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-7281e066-9cfe-4658-8454-d5593fb6d028 tempest-CreateVolumesFromImageTest-674786425 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:01:38 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-7281e066-9cfe-4658-8454-d5593fb6d028 tempest-CreateVolumesFromImageTest-674786425 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 16:01:38 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7281e066-9cfe-4658-8454-d5593fb6d028 tempest-CreateVolumesFromImageTest-674786425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a66db6bf-7a50-4cb6-b299-bc8ea36ef2a6 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:38 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9371e651-bbe8-450f-912a-49a44297696f tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86ee276c-6309-4fb2-8eef-b7f1eb509f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:38 devstack sudo[90493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a66db6bf-7a50-4cb6-b299-bc8ea36ef2a6 1073741824
Apr 15 16:01:38 devstack sudo[90493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:38 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9371e651-bbe8-450f-912a-49a44297696f tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fdb59e2-c5f3-405a-934c-ffc017db202b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:38 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-9371e651-bbe8-450f-912a-49a44297696f tempest-CreateVolumesFromSnapshotTest-222009090 None] Volume volume-a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304 (a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304): created successfully
Apr 15 16:01:38 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9371e651-bbe8-450f-912a-49a44297696f tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fdb59e2-c5f3-405a-934c-ffc017db202b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:38 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-9371e651-bbe8-450f-912a-49a44297696f tempest-CreateVolumesFromSnapshotTest-222009090 None] Flow 'volume_create_manager' (172a58f1-0877-470f-b205-de2bfa914c1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:01:38 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-9371e651-bbe8-450f-912a-49a44297696f tempest-CreateVolumesFromSnapshotTest-222009090 None] Created volume successfully.
Apr 15 16:01:39 devstack sudo[90493]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:39 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7281e066-9cfe-4658-8454-d5593fb6d028 tempest-CreateVolumesFromImageTest-674786425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a66db6bf-7a50-4cb6-b299-bc8ea36ef2a6 1073741824" returned: 0 in 0.564s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:39 devstack cinder-volume[82485]: DEBUG dbcounter [-] [82485] Writing DB stats cinder:UPDATE=169,cinder:SELECT=124,cinder:INSERT=47,cinder:DELETE=17 {{(pid=82485) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 16:01:39 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7281e066-9cfe-4658-8454-d5593fb6d028 tempest-CreateVolumesFromImageTest-674786425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a66db6bf-7a50-4cb6-b299-bc8ea36ef2a6 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:39 devstack sudo[90498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a66db6bf-7a50-4cb6-b299-bc8ea36ef2a6
Apr 15 16:01:39 devstack sudo[90498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:39 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-6e1ad15a-9ce7-46bc-a26e-642aa8853fee tempest-CreateVolumesFromSnapshotTest-222009090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:01:39 devstack sudo[90498]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:39 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7281e066-9cfe-4658-8454-d5593fb6d028 tempest-CreateVolumesFromImageTest-674786425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a66db6bf-7a50-4cb6-b299-bc8ea36ef2a6" returned: 0 in 0.464s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:39 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-7281e066-9cfe-4658-8454-d5593fb6d028 tempest-CreateVolumesFromImageTest-674786425 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:01:39 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7281e066-9cfe-4658-8454-d5593fb6d028 tempest-CreateVolumesFromImageTest-674786425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:01:39 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-413c3cd4-1fdd-4b13-b808-d1d280d0371b tempest-CreateVolumesFromImageTest-674786425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.279s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:01:39 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-413c3cd4-1fdd-4b13-b808-d1d280d0371b tempest-CreateVolumesFromImageTest-674786425 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:01:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1113667216',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=389f2bc9-81d7-4c96-b61c-ef1cd1299f4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e7042a89147490fb10984314ce2d6f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:01:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:01:34Z,use_quota=True,user_id='fef39af0c3504c6693f4eea214ebb639',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:01:39 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-413c3cd4-1fdd-4b13-b808-d1d280d0371b tempest-CreateVolumesFromImageTest-674786425 None] Creating volume 389f2bc9-81d7-4c96-b61c-ef1cd1299f4c {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:01:39 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-413c3cd4-1fdd-4b13-b808-d1d280d0371b tempest-CreateVolumesFromImageTest-674786425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:01:39 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-413c3cd4-1fdd-4b13-b808-d1d280d0371b tempest-CreateVolumesFromImageTest-674786425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:01:39 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-413c3cd4-1fdd-4b13-b808-d1d280d0371b tempest-CreateVolumesFromImageTest-674786425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:01:39 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-413c3cd4-1fdd-4b13-b808-d1d280d0371b tempest-CreateVolumesFromImageTest-674786425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:01:39 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-413c3cd4-1fdd-4b13-b808-d1d280d0371b tempest-CreateVolumesFromImageTest-674786425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:01:39 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-413c3cd4-1fdd-4b13-b808-d1d280d0371b tempest-CreateVolumesFromImageTest-674786425 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:01:39 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-413c3cd4-1fdd-4b13-b808-d1d280d0371b tempest-CreateVolumesFromImageTest-674786425 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 16:01:39 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-413c3cd4-1fdd-4b13-b808-d1d280d0371b tempest-CreateVolumesFromImageTest-674786425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-389f2bc9-81d7-4c96-b61c-ef1cd1299f4c 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:39 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7281e066-9cfe-4658-8454-d5593fb6d028 tempest-CreateVolumesFromImageTest-674786425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (181fd42f-f4a0-487c-8622-f785e99e433d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a66db6bf-7a50-4cb6-b299-bc8ea36ef2a6', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:39 devstack sudo[90501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-389f2bc9-81d7-4c96-b61c-ef1cd1299f4c 1073741824
Apr 15 16:01:39 devstack sudo[90501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:39 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7281e066-9cfe-4658-8454-d5593fb6d028 tempest-CreateVolumesFromImageTest-674786425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eb97928-3c8c-40bc-9cb5-733eb7371eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:39 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-7281e066-9cfe-4658-8454-d5593fb6d028 tempest-CreateVolumesFromImageTest-674786425 None] Volume volume-a66db6bf-7a50-4cb6-b299-bc8ea36ef2a6 (a66db6bf-7a50-4cb6-b299-bc8ea36ef2a6): created successfully
Apr 15 16:01:39 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7281e066-9cfe-4658-8454-d5593fb6d028 tempest-CreateVolumesFromImageTest-674786425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eb97928-3c8c-40bc-9cb5-733eb7371eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:39 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7281e066-9cfe-4658-8454-d5593fb6d028 tempest-CreateVolumesFromImageTest-674786425 None] Flow 'volume_create_manager' (1bc07653-49cc-470f-b7af-71664e29933f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:01:39 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-7281e066-9cfe-4658-8454-d5593fb6d028 tempest-CreateVolumesFromImageTest-674786425 None] Created volume successfully.
Apr 15 16:01:40 devstack sudo[90501]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:40 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-413c3cd4-1fdd-4b13-b808-d1d280d0371b tempest-CreateVolumesFromImageTest-674786425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-389f2bc9-81d7-4c96-b61c-ef1cd1299f4c 1073741824" returned: 0 in 0.554s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:40 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-413c3cd4-1fdd-4b13-b808-d1d280d0371b tempest-CreateVolumesFromImageTest-674786425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-389f2bc9-81d7-4c96-b61c-ef1cd1299f4c {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:40 devstack sudo[90506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-389f2bc9-81d7-4c96-b61c-ef1cd1299f4c
Apr 15 16:01:40 devstack sudo[90506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:40 devstack sudo[90506]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:40 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-413c3cd4-1fdd-4b13-b808-d1d280d0371b tempest-CreateVolumesFromImageTest-674786425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-389f2bc9-81d7-4c96-b61c-ef1cd1299f4c" returned: 0 in 0.470s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:40 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-413c3cd4-1fdd-4b13-b808-d1d280d0371b tempest-CreateVolumesFromImageTest-674786425 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:01:40 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-413c3cd4-1fdd-4b13-b808-d1d280d0371b tempest-CreateVolumesFromImageTest-674786425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:01:40 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-41171272-eab7-4e01-bf1f-d8a2173a930a tempest-CreateVolumesFromImageTest-674786425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.109s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:01:40 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-41171272-eab7-4e01-bf1f-d8a2173a930a tempest-CreateVolumesFromImageTest-674786425 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:01:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2026769825',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0bc6280-a73b-44fd-9836-6c7d3afbd02e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e7042a89147490fb10984314ce2d6f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:01:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:01:35Z,use_quota=True,user_id='fef39af0c3504c6693f4eea214ebb639',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:01:40 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-41171272-eab7-4e01-bf1f-d8a2173a930a tempest-CreateVolumesFromImageTest-674786425 None] Creating volume b0bc6280-a73b-44fd-9836-6c7d3afbd02e {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:01:40 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-41171272-eab7-4e01-bf1f-d8a2173a930a tempest-CreateVolumesFromImageTest-674786425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:01:40 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-41171272-eab7-4e01-bf1f-d8a2173a930a tempest-CreateVolumesFromImageTest-674786425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:01:40 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-41171272-eab7-4e01-bf1f-d8a2173a930a tempest-CreateVolumesFromImageTest-674786425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:01:40 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-41171272-eab7-4e01-bf1f-d8a2173a930a tempest-CreateVolumesFromImageTest-674786425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:01:40 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-41171272-eab7-4e01-bf1f-d8a2173a930a tempest-CreateVolumesFromImageTest-674786425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:01:40 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-41171272-eab7-4e01-bf1f-d8a2173a930a tempest-CreateVolumesFromImageTest-674786425 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:01:40 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-41171272-eab7-4e01-bf1f-d8a2173a930a tempest-CreateVolumesFromImageTest-674786425 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 16:01:40 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-41171272-eab7-4e01-bf1f-d8a2173a930a tempest-CreateVolumesFromImageTest-674786425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b0bc6280-a73b-44fd-9836-6c7d3afbd02e 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:40 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-413c3cd4-1fdd-4b13-b808-d1d280d0371b tempest-CreateVolumesFromImageTest-674786425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce5e5887-306d-46f4-901b-7449800b4587) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-389f2bc9-81d7-4c96-b61c-ef1cd1299f4c', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:40 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-413c3cd4-1fdd-4b13-b808-d1d280d0371b tempest-CreateVolumesFromImageTest-674786425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3405165-64f7-465f-bf0c-459ec28745ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:40 devstack sudo[90509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b0bc6280-a73b-44fd-9836-6c7d3afbd02e 1073741824
Apr 15 16:01:40 devstack sudo[90509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:40 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-413c3cd4-1fdd-4b13-b808-d1d280d0371b tempest-CreateVolumesFromImageTest-674786425 None] Volume volume-389f2bc9-81d7-4c96-b61c-ef1cd1299f4c (389f2bc9-81d7-4c96-b61c-ef1cd1299f4c): created successfully
Apr 15 16:01:40 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-413c3cd4-1fdd-4b13-b808-d1d280d0371b tempest-CreateVolumesFromImageTest-674786425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3405165-64f7-465f-bf0c-459ec28745ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:40 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-413c3cd4-1fdd-4b13-b808-d1d280d0371b tempest-CreateVolumesFromImageTest-674786425 None] Flow 'volume_create_manager' (c3476d41-ec16-4ea4-ae2b-64a6fc4f7182) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:01:40 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-413c3cd4-1fdd-4b13-b808-d1d280d0371b tempest-CreateVolumesFromImageTest-674786425 None] Created volume successfully.
Apr 15 16:01:41 devstack sudo[90509]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:41 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-41171272-eab7-4e01-bf1f-d8a2173a930a tempest-CreateVolumesFromImageTest-674786425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b0bc6280-a73b-44fd-9836-6c7d3afbd02e 1073741824" returned: 0 in 0.574s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:41 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-41171272-eab7-4e01-bf1f-d8a2173a930a tempest-CreateVolumesFromImageTest-674786425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b0bc6280-a73b-44fd-9836-6c7d3afbd02e {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:41 devstack sudo[90514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b0bc6280-a73b-44fd-9836-6c7d3afbd02e
Apr 15 16:01:41 devstack sudo[90514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:41 devstack sudo[90514]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:41 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-41171272-eab7-4e01-bf1f-d8a2173a930a tempest-CreateVolumesFromImageTest-674786425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b0bc6280-a73b-44fd-9836-6c7d3afbd02e" returned: 0 in 0.440s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:41 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-41171272-eab7-4e01-bf1f-d8a2173a930a tempest-CreateVolumesFromImageTest-674786425 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:01:41 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-41171272-eab7-4e01-bf1f-d8a2173a930a tempest-CreateVolumesFromImageTest-674786425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:01:41 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-21155e68-aa00-4576-9986-62ed60c29f7c tempest-VolumeDependencyTests-972921078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.700s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:01:41 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-21155e68-aa00-4576-9986-62ed60c29f7c tempest-VolumeDependencyTests-972921078 None] Creating offline snapshot 3f2607ca-5f77-4633-9f70-a20dfb08e793 of volume 6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e {{(pid=82485) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 16:01:41 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-41171272-eab7-4e01-bf1f-d8a2173a930a tempest-CreateVolumesFromImageTest-674786425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (851ffb51-b9a0-4d32-b7bb-e80f6ab6f5ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0bc6280-a73b-44fd-9836-6c7d3afbd02e', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:41 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-41171272-eab7-4e01-bf1f-d8a2173a930a tempest-CreateVolumesFromImageTest-674786425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15b6f440-9f29-477f-b737-48245742282c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:41 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[366a91bc-fb66-4402-855d-0a09f37c2390]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:01:41 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-21155e68-aa00-4576-9986-62ed60c29f7c tempest-VolumeDependencyTests-972921078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:41 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-41171272-eab7-4e01-bf1f-d8a2173a930a tempest-CreateVolumesFromImageTest-674786425 None] Volume volume-b0bc6280-a73b-44fd-9836-6c7d3afbd02e (b0bc6280-a73b-44fd-9836-6c7d3afbd02e): created successfully
Apr 15 16:01:41 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-41171272-eab7-4e01-bf1f-d8a2173a930a tempest-CreateVolumesFromImageTest-674786425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15b6f440-9f29-477f-b737-48245742282c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:41 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-41171272-eab7-4e01-bf1f-d8a2173a930a tempest-CreateVolumesFromImageTest-674786425 None] Flow 'volume_create_manager' (8ba760d7-1afc-43dd-a2d8-f7359ff7e4aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:01:41 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-41171272-eab7-4e01-bf1f-d8a2173a930a tempest-CreateVolumesFromImageTest-674786425 None] Created volume successfully.
Apr 15 16:01:41 devstack sudo[90549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e
Apr 15 16:01:41 devstack sudo[90549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:42 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-e2a9fd2a-b04a-40b5-8437-62fa34b8a707 tempest-CreateVolumesFromImageTest-674786425 None] Acquiring lock "cinder-b0bc6280-a73b-44fd-9836-6c7d3afbd02e-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:01:42 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-e2a9fd2a-b04a-40b5-8437-62fa34b8a707 tempest-CreateVolumesFromImageTest-674786425 None] Lock "cinder-b0bc6280-a73b-44fd-9836-6c7d3afbd02e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:01:42 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-e2a9fd2a-b04a-40b5-8437-62fa34b8a707 tempest-CreateVolumesFromImageTest-674786425 None] Acquiring lock "cinder-quobyte-b0bc6280-a73b-44fd-9836-6c7d3afbd02e" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:01:42 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-e2a9fd2a-b04a-40b5-8437-62fa34b8a707 tempest-CreateVolumesFromImageTest-674786425 None] Lock "cinder-quobyte-b0bc6280-a73b-44fd-9836-6c7d3afbd02e" acquired by "delete_volume" :: waited 0.012s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:01:42 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[935d9564-9ec7-48d7-bd0f-179f6753516b]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:01:42 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-e2a9fd2a-b04a-40b5-8437-62fa34b8a707 tempest-CreateVolumesFromImageTest-674786425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b0bc6280-a73b-44fd-9836-6c7d3afbd02e {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:42 devstack sudo[90553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b0bc6280-a73b-44fd-9836-6c7d3afbd02e
Apr 15 16:01:42 devstack sudo[90553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:42 devstack sudo[90549]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:42 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-21155e68-aa00-4576-9986-62ed60c29f7c tempest-VolumeDependencyTests-972921078 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e" returned: 0 in 0.555s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:42 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-21155e68-aa00-4576-9986-62ed60c29f7c tempest-VolumeDependencyTests-972921078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e.3f2607ca-5f77-4633-9f70-a20dfb08e793 1G {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:42 devstack sudo[90558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e.3f2607ca-5f77-4633-9f70-a20dfb08e793 1G
Apr 15 16:01:42 devstack sudo[90558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:42 devstack sudo[90553]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:42 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-e2a9fd2a-b04a-40b5-8437-62fa34b8a707 tempest-CreateVolumesFromImageTest-674786425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b0bc6280-a73b-44fd-9836-6c7d3afbd02e" returned: 0 in 0.530s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:42 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-e2a9fd2a-b04a-40b5-8437-62fa34b8a707 tempest-CreateVolumesFromImageTest-674786425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b0bc6280-a73b-44fd-9836-6c7d3afbd02e {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:42 devstack sudo[90566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b0bc6280-a73b-44fd-9836-6c7d3afbd02e
Apr 15 16:01:42 devstack sudo[90566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:43 devstack sudo[90558]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:43 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-21155e68-aa00-4576-9986-62ed60c29f7c tempest-VolumeDependencyTests-972921078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e.3f2607ca-5f77-4633-9f70-a20dfb08e793 1G" returned: 0 in 0.584s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:43 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-21155e68-aa00-4576-9986-62ed60c29f7c tempest-VolumeDependencyTests-972921078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e.3f2607ca-5f77-4633-9f70-a20dfb08e793 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:43 devstack sudo[90568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e.3f2607ca-5f77-4633-9f70-a20dfb08e793
Apr 15 16:01:43 devstack sudo[90568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:43 devstack sudo[90566]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:43 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-e2a9fd2a-b04a-40b5-8437-62fa34b8a707 tempest-CreateVolumesFromImageTest-674786425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b0bc6280-a73b-44fd-9836-6c7d3afbd02e" returned: 0 in 0.495s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:43 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-e2a9fd2a-b04a-40b5-8437-62fa34b8a707 tempest-CreateVolumesFromImageTest-674786425 None] Lock "cinder-quobyte-b0bc6280-a73b-44fd-9836-6c7d3afbd02e" released by "delete_volume" :: held 1.054s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:01:43 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-e2a9fd2a-b04a-40b5-8437-62fa34b8a707 tempest-CreateVolumesFromImageTest-674786425 None] Created reservations ['1d24c235-c12c-41bf-a399-3801d40e272a', '00561784-24c7-482e-a01d-f5f58fbf222f', '347b2c72-fa80-4102-a6f9-bc5780f55bd7', 'f7a96fe1-ccbe-49c4-9f5a-8f53377ee7b6'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:01:43 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-e2a9fd2a-b04a-40b5-8437-62fa34b8a707 tempest-CreateVolumesFromImageTest-674786425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:01:43 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-e2a9fd2a-b04a-40b5-8437-62fa34b8a707 tempest-CreateVolumesFromImageTest-674786425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:01:43 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-e2a9fd2a-b04a-40b5-8437-62fa34b8a707 tempest-CreateVolumesFromImageTest-674786425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:01:43 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-e2a9fd2a-b04a-40b5-8437-62fa34b8a707 tempest-CreateVolumesFromImageTest-674786425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:01:43 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-e2a9fd2a-b04a-40b5-8437-62fa34b8a707 tempest-CreateVolumesFromImageTest-674786425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:01:43 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-e2a9fd2a-b04a-40b5-8437-62fa34b8a707 tempest-CreateVolumesFromImageTest-674786425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:43 devstack sudo[90574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 16:01:43 devstack sudo[90574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:43 devstack sudo[90568]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:43 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-21155e68-aa00-4576-9986-62ed60c29f7c tempest-VolumeDependencyTests-972921078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e.3f2607ca-5f77-4633-9f70-a20dfb08e793" returned: 0 in 0.500s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:43 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-21155e68-aa00-4576-9986-62ed60c29f7c tempest-VolumeDependencyTests-972921078 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e.3f2607ca-5f77-4633-9f70-a20dfb08e793 is being set with open permissions: ugo+rw
Apr 15 16:01:43 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-21155e68-aa00-4576-9986-62ed60c29f7c tempest-VolumeDependencyTests-972921078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e.3f2607ca-5f77-4633-9f70-a20dfb08e793 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:43 devstack sudo[90576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e.3f2607ca-5f77-4633-9f70-a20dfb08e793
Apr 15 16:01:43 devstack sudo[90576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:43 devstack sudo[90574]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:43 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-e2a9fd2a-b04a-40b5-8437-62fa34b8a707 tempest-CreateVolumesFromImageTest-674786425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.428s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:43 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-e2a9fd2a-b04a-40b5-8437-62fa34b8a707 tempest-CreateVolumesFromImageTest-674786425 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:01:43 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-e2a9fd2a-b04a-40b5-8437-62fa34b8a707 tempest-CreateVolumesFromImageTest-674786425 None] Deleted volume successfully.
Apr 15 16:01:43 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-e2a9fd2a-b04a-40b5-8437-62fa34b8a707 tempest-CreateVolumesFromImageTest-674786425 None] Lock "cinder-b0bc6280-a73b-44fd-9836-6c7d3afbd02e-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:01:44 devstack sudo[90576]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-21155e68-aa00-4576-9986-62ed60c29f7c tempest-VolumeDependencyTests-972921078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e.3f2607ca-5f77-4633-9f70-a20dfb08e793" returned: 0 in 0.488s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-21155e68-aa00-4576-9986-62ed60c29f7c tempest-VolumeDependencyTests-972921078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e.info {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:44 devstack sudo[90580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e.info
Apr 15 16:01:44 devstack sudo[90580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:44 devstack cinder-volume[82485]: DEBUG oslo_service.periodic_task [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82485) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 15 16:01:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:01:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:01:44 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:01:44 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:01:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:01:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:44 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-ad54043a-e0da-4b5b-ba0f-f079a62c182d tempest-CreateVolumesFromImageTest-674786425 None] Acquiring lock "cinder-389f2bc9-81d7-4c96-b61c-ef1cd1299f4c-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:01:44 devstack sudo[90583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 16:01:44 devstack sudo[90583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:44 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-ad54043a-e0da-4b5b-ba0f-f079a62c182d tempest-CreateVolumesFromImageTest-674786425 None] Lock "cinder-389f2bc9-81d7-4c96-b61c-ef1cd1299f4c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:01:44 devstack sudo[90580]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-21155e68-aa00-4576-9986-62ed60c29f7c tempest-VolumeDependencyTests-972921078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e.info" returned: 0 in 0.443s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:44 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-21155e68-aa00-4576-9986-62ed60c29f7c tempest-VolumeDependencyTests-972921078 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e.info is being set with open permissions: ugo+rw
Apr 15 16:01:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-21155e68-aa00-4576-9986-62ed60c29f7c tempest-VolumeDependencyTests-972921078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e.info {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:44 devstack sudo[90585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e.info
Apr 15 16:01:44 devstack sudo[90585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:44 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-ad54043a-e0da-4b5b-ba0f-f079a62c182d tempest-CreateVolumesFromImageTest-674786425 None] Acquiring lock "cinder-quobyte-389f2bc9-81d7-4c96-b61c-ef1cd1299f4c" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:01:44 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-ad54043a-e0da-4b5b-ba0f-f079a62c182d tempest-CreateVolumesFromImageTest-674786425 None] Lock "cinder-quobyte-389f2bc9-81d7-4c96-b61c-ef1cd1299f4c" acquired by "delete_volume" :: waited 0.008s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:01:44 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc54fc3-7909-485c-859f-ed033c040df2]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:01:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ad54043a-e0da-4b5b-ba0f-f079a62c182d tempest-CreateVolumesFromImageTest-674786425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-389f2bc9-81d7-4c96-b61c-ef1cd1299f4c {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:44 devstack sudo[90588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-389f2bc9-81d7-4c96-b61c-ef1cd1299f4c
Apr 15 16:01:44 devstack sudo[90588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:45 devstack sudo[90585]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:45 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-21155e68-aa00-4576-9986-62ed60c29f7c tempest-VolumeDependencyTests-972921078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e.info" returned: 0 in 0.583s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:45 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-21155e68-aa00-4576-9986-62ed60c29f7c tempest-VolumeDependencyTests-972921078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.256s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:01:45 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-6e1ad15a-9ce7-46bc-a26e-642aa8853fee tempest-CreateVolumesFromSnapshotTest-222009090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.690s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:01:45 devstack sudo[90583]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:45 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-6e1ad15a-9ce7-46bc-a26e-642aa8853fee tempest-CreateVolumesFromSnapshotTest-222009090 None] Creating offline snapshot 6eb6b0a0-2e0f-46d4-a1b5-f0bdbb745443 of volume a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304 {{(pid=82485) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 16:01:45 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.720s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:45 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:01:45 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb65d43-d58a-412a-a9d5-78569d16b906]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:01:45 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6e1ad15a-9ce7-46bc-a26e-642aa8853fee tempest-CreateVolumesFromSnapshotTest-222009090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:45 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-21155e68-aa00-4576-9986-62ed60c29f7c tempest-VolumeDependencyTests-972921078 None] Create snapshot completed successfully
Apr 15 16:01:45 devstack sudo[90588]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:45 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ad54043a-e0da-4b5b-ba0f-f079a62c182d tempest-CreateVolumesFromImageTest-674786425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-389f2bc9-81d7-4c96-b61c-ef1cd1299f4c" returned: 0 in 0.631s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:45 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ad54043a-e0da-4b5b-ba0f-f079a62c182d tempest-CreateVolumesFromImageTest-674786425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-389f2bc9-81d7-4c96-b61c-ef1cd1299f4c {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:45 devstack sudo[90596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-389f2bc9-81d7-4c96-b61c-ef1cd1299f4c
Apr 15 16:01:45 devstack sudo[90596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:45 devstack sudo[90595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304
Apr 15 16:01:45 devstack sudo[90595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:45 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-35135252-6891-479a-907c-d3ef8bffd735 tempest-VolumeDependencyTests-972921078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:01:45 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-35135252-6891-479a-907c-d3ef8bffd735 tempest-VolumeDependencyTests-972921078 None] Flow 'volume_create_manager' (4fae1d89-da1c-481a-bd04-a7fafac156c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:01:45 devstack sudo[90596]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:45 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-35135252-6891-479a-907c-d3ef8bffd735 tempest-VolumeDependencyTests-972921078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78f669d8-82d2-479a-86f2-f8862a9cd996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:45 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ad54043a-e0da-4b5b-ba0f-f079a62c182d tempest-CreateVolumesFromImageTest-674786425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-389f2bc9-81d7-4c96-b61c-ef1cd1299f4c" returned: 0 in 0.593s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:45 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-35135252-6891-479a-907c-d3ef8bffd735 tempest-VolumeDependencyTests-972921078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78f669d8-82d2-479a-86f2-f8862a9cd996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-71705982',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f55628c3-c48d-4c04-9eda-3b29eb054b09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d363d48ee3e40b5a9f7d410914be77e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3f2607ca-5f77-4633-9f70-a20dfb08e793,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:01:46Z,use_quota=True,user_id='da5723df3b9d48f09a9929ddb60988ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:45 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-35135252-6891-479a-907c-d3ef8bffd735 tempest-VolumeDependencyTests-972921078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6f832a4-7bb9-4453-bd51-a7ed285897c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:45 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-35135252-6891-479a-907c-d3ef8bffd735 tempest-VolumeDependencyTests-972921078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6f832a4-7bb9-4453-bd51-a7ed285897c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:45 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-35135252-6891-479a-907c-d3ef8bffd735 tempest-VolumeDependencyTests-972921078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43856ef9-0a63-4324-81ab-0fdc56ed0594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:45 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-35135252-6891-479a-907c-d3ef8bffd735 tempest-VolumeDependencyTests-972921078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43856ef9-0a63-4324-81ab-0fdc56ed0594) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f55628c3-c48d-4c04-9eda-3b29eb054b09', 'volume_name': 'volume-f55628c3-c48d-4c04-9eda-3b29eb054b09', 'volume_size': 1, 'snapshot_id': '3f2607ca-5f77-4633-9f70-a20dfb08e793'}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:45 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-35135252-6891-479a-907c-d3ef8bffd735 tempest-VolumeDependencyTests-972921078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d2d8290-027a-4b2f-b99a-c45f68ab99ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:45 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-35135252-6891-479a-907c-d3ef8bffd735 tempest-VolumeDependencyTests-972921078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d2d8290-027a-4b2f-b99a-c45f68ab99ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:45 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-35135252-6891-479a-907c-d3ef8bffd735 tempest-VolumeDependencyTests-972921078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0a02bfb-b2cc-460f-a8f8-100c3acdea8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:45 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-35135252-6891-479a-907c-d3ef8bffd735 tempest-VolumeDependencyTests-972921078 None] Volume f55628c3-c48d-4c04-9eda-3b29eb054b09: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f55628c3-c48d-4c04-9eda-3b29eb054b09', 'volume_size': 1, 'snapshot_id': '3f2607ca-5f77-4633-9f70-a20dfb08e793'}
Apr 15 16:01:45 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-ad54043a-e0da-4b5b-ba0f-f079a62c182d tempest-CreateVolumesFromImageTest-674786425 None] Lock "cinder-quobyte-389f2bc9-81d7-4c96-b61c-ef1cd1299f4c" released by "delete_volume" :: held 1.283s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:01:45 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-35135252-6891-479a-907c-d3ef8bffd735 tempest-VolumeDependencyTests-972921078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:01:45 devstack sudo[90595]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:45 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6e1ad15a-9ce7-46bc-a26e-642aa8853fee tempest-CreateVolumesFromSnapshotTest-222009090 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304" returned: 0 in 0.703s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:45 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6e1ad15a-9ce7-46bc-a26e-642aa8853fee tempest-CreateVolumesFromSnapshotTest-222009090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304.6eb6b0a0-2e0f-46d4-a1b5-f0bdbb745443 1G {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:45 devstack sudo[90603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304.6eb6b0a0-2e0f-46d4-a1b5-f0bdbb745443 1G
Apr 15 16:01:45 devstack sudo[90603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:45 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-ad54043a-e0da-4b5b-ba0f-f079a62c182d tempest-CreateVolumesFromImageTest-674786425 None] Created reservations ['3cbbd2bd-ce6e-46c7-8b8b-200540625d14', '60cec282-2635-48b9-9705-592c39b69507', '55ea78ac-1b76-4405-bfc4-300caff158aa', 'e3f19221-a749-4faa-944f-fda670e9897c'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:01:45 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-ad54043a-e0da-4b5b-ba0f-f079a62c182d tempest-CreateVolumesFromImageTest-674786425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:01:45 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-ad54043a-e0da-4b5b-ba0f-f079a62c182d tempest-CreateVolumesFromImageTest-674786425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:01:45 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-ad54043a-e0da-4b5b-ba0f-f079a62c182d tempest-CreateVolumesFromImageTest-674786425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:01:45 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-ad54043a-e0da-4b5b-ba0f-f079a62c182d tempest-CreateVolumesFromImageTest-674786425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:01:45 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-ad54043a-e0da-4b5b-ba0f-f079a62c182d tempest-CreateVolumesFromImageTest-674786425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:01:45 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ad54043a-e0da-4b5b-ba0f-f079a62c182d tempest-CreateVolumesFromImageTest-674786425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:45 devstack sudo[90605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 16:01:45 devstack sudo[90605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:46 devstack sudo[90605]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:46 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ad54043a-e0da-4b5b-ba0f-f079a62c182d tempest-CreateVolumesFromImageTest-674786425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.526s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:46 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-ad54043a-e0da-4b5b-ba0f-f079a62c182d tempest-CreateVolumesFromImageTest-674786425 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:01:46 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-ad54043a-e0da-4b5b-ba0f-f079a62c182d tempest-CreateVolumesFromImageTest-674786425 None] Deleted volume successfully.
Apr 15 16:01:46 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-ad54043a-e0da-4b5b-ba0f-f079a62c182d tempest-CreateVolumesFromImageTest-674786425 None] Lock "cinder-389f2bc9-81d7-4c96-b61c-ef1cd1299f4c-delete_volume" released by "delete_volume" :: held 2.005s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:01:46 devstack sudo[90603]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:46 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6e1ad15a-9ce7-46bc-a26e-642aa8853fee tempest-CreateVolumesFromSnapshotTest-222009090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304.6eb6b0a0-2e0f-46d4-a1b5-f0bdbb745443 1G" returned: 0 in 0.674s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:46 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6e1ad15a-9ce7-46bc-a26e-642aa8853fee tempest-CreateVolumesFromSnapshotTest-222009090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304.6eb6b0a0-2e0f-46d4-a1b5-f0bdbb745443 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:46 devstack sudo[90612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304.6eb6b0a0-2e0f-46d4-a1b5-f0bdbb745443
Apr 15 16:01:46 devstack sudo[90612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:46 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-3f403792-10fc-4047-98b3-e40b4cca2444 tempest-CreateVolumesFromImageTest-674786425 None] Acquiring lock "cinder-a66db6bf-7a50-4cb6-b299-bc8ea36ef2a6-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:01:46 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-3f403792-10fc-4047-98b3-e40b4cca2444 tempest-CreateVolumesFromImageTest-674786425 None] Lock "cinder-a66db6bf-7a50-4cb6-b299-bc8ea36ef2a6-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:01:46 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-3f403792-10fc-4047-98b3-e40b4cca2444 tempest-CreateVolumesFromImageTest-674786425 None] Acquiring lock "cinder-quobyte-a66db6bf-7a50-4cb6-b299-bc8ea36ef2a6" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:01:46 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-3f403792-10fc-4047-98b3-e40b4cca2444 tempest-CreateVolumesFromImageTest-674786425 None] Lock "cinder-quobyte-a66db6bf-7a50-4cb6-b299-bc8ea36ef2a6" acquired by "delete_volume" :: waited 0.010s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:01:46 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4fec8b-3503-4800-85c3-d75dac327d23]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:01:46 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3f403792-10fc-4047-98b3-e40b4cca2444 tempest-CreateVolumesFromImageTest-674786425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a66db6bf-7a50-4cb6-b299-bc8ea36ef2a6 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:46 devstack sudo[90614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a66db6bf-7a50-4cb6-b299-bc8ea36ef2a6
Apr 15 16:01:46 devstack sudo[90614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:47 devstack sudo[90612]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:47 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6e1ad15a-9ce7-46bc-a26e-642aa8853fee tempest-CreateVolumesFromSnapshotTest-222009090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304.6eb6b0a0-2e0f-46d4-a1b5-f0bdbb745443" returned: 0 in 0.633s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:47 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-6e1ad15a-9ce7-46bc-a26e-642aa8853fee tempest-CreateVolumesFromSnapshotTest-222009090 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304.6eb6b0a0-2e0f-46d4-a1b5-f0bdbb745443 is being set with open permissions: ugo+rw
Apr 15 16:01:47 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6e1ad15a-9ce7-46bc-a26e-642aa8853fee tempest-CreateVolumesFromSnapshotTest-222009090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304.6eb6b0a0-2e0f-46d4-a1b5-f0bdbb745443 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:47 devstack sudo[90619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304.6eb6b0a0-2e0f-46d4-a1b5-f0bdbb745443
Apr 15 16:01:47 devstack sudo[90619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:47 devstack sudo[90614]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:47 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3f403792-10fc-4047-98b3-e40b4cca2444 tempest-CreateVolumesFromImageTest-674786425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a66db6bf-7a50-4cb6-b299-bc8ea36ef2a6" returned: 0 in 0.592s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:47 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3f403792-10fc-4047-98b3-e40b4cca2444 tempest-CreateVolumesFromImageTest-674786425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a66db6bf-7a50-4cb6-b299-bc8ea36ef2a6 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:47 devstack sudo[90624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a66db6bf-7a50-4cb6-b299-bc8ea36ef2a6
Apr 15 16:01:47 devstack sudo[90624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:47 devstack sudo[90619]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:47 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6e1ad15a-9ce7-46bc-a26e-642aa8853fee tempest-CreateVolumesFromSnapshotTest-222009090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304.6eb6b0a0-2e0f-46d4-a1b5-f0bdbb745443" returned: 0 in 0.498s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:47 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6e1ad15a-9ce7-46bc-a26e-642aa8853fee tempest-CreateVolumesFromSnapshotTest-222009090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304.info {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:47 devstack sudo[90627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304.info
Apr 15 16:01:47 devstack sudo[90627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:47 devstack sudo[90624]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:47 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3f403792-10fc-4047-98b3-e40b4cca2444 tempest-CreateVolumesFromImageTest-674786425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a66db6bf-7a50-4cb6-b299-bc8ea36ef2a6" returned: 0 in 0.511s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:47 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-3f403792-10fc-4047-98b3-e40b4cca2444 tempest-CreateVolumesFromImageTest-674786425 None] Lock "cinder-quobyte-a66db6bf-7a50-4cb6-b299-bc8ea36ef2a6" released by "delete_volume" :: held 1.137s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:01:47 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-3f403792-10fc-4047-98b3-e40b4cca2444 tempest-CreateVolumesFromImageTest-674786425 None] Created reservations ['2f31b283-f1aa-4c98-8ed4-0bd9549eb4ec', 'f1688160-00b2-4ae0-85e8-678d6a142048', 'b22e1260-e8a7-418c-8bf4-483db3e4c502', '9780acf1-ec4f-4673-83c6-630bb5720af4'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:01:47 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-3f403792-10fc-4047-98b3-e40b4cca2444 tempest-CreateVolumesFromImageTest-674786425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:01:47 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-3f403792-10fc-4047-98b3-e40b4cca2444 tempest-CreateVolumesFromImageTest-674786425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:01:47 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-3f403792-10fc-4047-98b3-e40b4cca2444 tempest-CreateVolumesFromImageTest-674786425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:01:47 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-3f403792-10fc-4047-98b3-e40b4cca2444 tempest-CreateVolumesFromImageTest-674786425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:01:47 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-3f403792-10fc-4047-98b3-e40b4cca2444 tempest-CreateVolumesFromImageTest-674786425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:01:47 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3f403792-10fc-4047-98b3-e40b4cca2444 tempest-CreateVolumesFromImageTest-674786425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:48 devstack sudo[90630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 16:01:48 devstack sudo[90630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:48 devstack sudo[90627]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:48 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6e1ad15a-9ce7-46bc-a26e-642aa8853fee tempest-CreateVolumesFromSnapshotTest-222009090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304.info" returned: 0 in 0.527s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:48 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-6e1ad15a-9ce7-46bc-a26e-642aa8853fee tempest-CreateVolumesFromSnapshotTest-222009090 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304.info is being set with open permissions: ugo+rw
Apr 15 16:01:48 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6e1ad15a-9ce7-46bc-a26e-642aa8853fee tempest-CreateVolumesFromSnapshotTest-222009090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304.info {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:48 devstack sudo[90633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304.info
Apr 15 16:01:48 devstack sudo[90633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:48 devstack sudo[90630]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:48 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3f403792-10fc-4047-98b3-e40b4cca2444 tempest-CreateVolumesFromImageTest-674786425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.497s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:48 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-3f403792-10fc-4047-98b3-e40b4cca2444 tempest-CreateVolumesFromImageTest-674786425 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:01:48 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-3f403792-10fc-4047-98b3-e40b4cca2444 tempest-CreateVolumesFromImageTest-674786425 None] Deleted volume successfully.
Apr 15 16:01:48 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-3f403792-10fc-4047-98b3-e40b4cca2444 tempest-CreateVolumesFromImageTest-674786425 None] Lock "cinder-a66db6bf-7a50-4cb6-b299-bc8ea36ef2a6-delete_volume" released by "delete_volume" :: held 1.985s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:01:48 devstack sudo[90633]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:48 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6e1ad15a-9ce7-46bc-a26e-642aa8853fee tempest-CreateVolumesFromSnapshotTest-222009090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304.info" returned: 0 in 0.466s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:48 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-6e1ad15a-9ce7-46bc-a26e-642aa8853fee tempest-CreateVolumesFromSnapshotTest-222009090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.595s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:01:48 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-35135252-6891-479a-907c-d3ef8bffd735 tempest-VolumeDependencyTests-972921078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.854s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:01:48 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-35135252-6891-479a-907c-d3ef8bffd735 tempest-VolumeDependencyTests-972921078 None] Acquiring lock "cinder-quobyte-3f2607ca-5f77-4633-9f70-a20dfb08e793-f55628c3-c48d-4c04-9eda-3b29eb054b09" by "_create_volume_from_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:01:48 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-35135252-6891-479a-907c-d3ef8bffd735 tempest-VolumeDependencyTests-972921078 None] Lock "cinder-quobyte-3f2607ca-5f77-4633-9f70-a20dfb08e793-f55628c3-c48d-4c04-9eda-3b29eb054b09" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:01:48 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-35135252-6891-479a-907c-d3ef8bffd735 tempest-VolumeDependencyTests-972921078 None] Creating volume f55628c3-c48d-4c04-9eda-3b29eb054b09 from snapshot 3f2607ca-5f77-4633-9f70-a20dfb08e793 {{(pid=82485) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 15 16:01:48 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-35135252-6891-479a-907c-d3ef8bffd735 tempest-VolumeDependencyTests-972921078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:01:48 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-35135252-6891-479a-907c-d3ef8bffd735 tempest-VolumeDependencyTests-972921078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:01:48 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-35135252-6891-479a-907c-d3ef8bffd735 tempest-VolumeDependencyTests-972921078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:01:48 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-35135252-6891-479a-907c-d3ef8bffd735 tempest-VolumeDependencyTests-972921078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:01:48 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-35135252-6891-479a-907c-d3ef8bffd735 tempest-VolumeDependencyTests-972921078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:01:48 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-35135252-6891-479a-907c-d3ef8bffd735 tempest-VolumeDependencyTests-972921078 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:01:48 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-35135252-6891-479a-907c-d3ef8bffd735 tempest-VolumeDependencyTests-972921078 None] Acquiring lock "cinder-quobyte-f55628c3-c48d-4c04-9eda-3b29eb054b09" by "_copy_volume_from_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:01:48 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-35135252-6891-479a-907c-d3ef8bffd735 tempest-VolumeDependencyTests-972921078 None] Lock "cinder-quobyte-f55628c3-c48d-4c04-9eda-3b29eb054b09" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:01:48 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-35135252-6891-479a-907c-d3ef8bffd735 tempest-VolumeDependencyTests-972921078 None] snapshot: 3f2607ca-5f77-4633-9f70-a20dfb08e793, volume: f55628c3-c48d-4c04-9eda-3b29eb054b09,  {{(pid=82485) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 15 16:01:48 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-6e1ad15a-9ce7-46bc-a26e-642aa8853fee tempest-CreateVolumesFromSnapshotTest-222009090 None] Create snapshot completed successfully
Apr 15 16:01:48 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-35135252-6891-479a-907c-d3ef8bffd735 tempest-VolumeDependencyTests-972921078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:01:48 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-35135252-6891-479a-907c-d3ef8bffd735 tempest-VolumeDependencyTests-972921078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:01:48 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-35135252-6891-479a-907c-d3ef8bffd735 tempest-VolumeDependencyTests-972921078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:01:48 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-35135252-6891-479a-907c-d3ef8bffd735 tempest-VolumeDependencyTests-972921078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:01:48 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-35135252-6891-479a-907c-d3ef8bffd735 tempest-VolumeDependencyTests-972921078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:01:48 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[610a6f24-84f8-43cd-a0f8-b13bbe78b9bf]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:01:48 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-35135252-6891-479a-907c-d3ef8bffd735 tempest-VolumeDependencyTests-972921078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e.3f2607ca-5f77-4633-9f70-a20dfb08e793 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:48 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-3c4f60c9-c723-4af8-9482-81a10f829464 tempest-CreateVolumesFromImageTest-674786425 None] Acquiring lock "cinder-61b77847-5f78-42a7-8b82-faf531b8caff-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:01:48 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-3c4f60c9-c723-4af8-9482-81a10f829464 tempest-CreateVolumesFromImageTest-674786425 None] Lock "cinder-61b77847-5f78-42a7-8b82-faf531b8caff-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:01:48 devstack sudo[90637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e.3f2607ca-5f77-4633-9f70-a20dfb08e793
Apr 15 16:01:48 devstack sudo[90637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:48 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-3c4f60c9-c723-4af8-9482-81a10f829464 tempest-CreateVolumesFromImageTest-674786425 None] Acquiring lock "cinder-quobyte-61b77847-5f78-42a7-8b82-faf531b8caff" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:01:48 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-3c4f60c9-c723-4af8-9482-81a10f829464 tempest-CreateVolumesFromImageTest-674786425 None] Lock "cinder-quobyte-61b77847-5f78-42a7-8b82-faf531b8caff" acquired by "delete_volume" :: waited 0.019s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:01:48 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64e067f-4a61-4d33-a0b7-0c82ec793e84]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:01:48 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3c4f60c9-c723-4af8-9482-81a10f829464 tempest-CreateVolumesFromImageTest-674786425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-61b77847-5f78-42a7-8b82-faf531b8caff {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:49 devstack sudo[90639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-61b77847-5f78-42a7-8b82-faf531b8caff
Apr 15 16:01:49 devstack sudo[90639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:49 devstack sudo[90637]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:49 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-35135252-6891-479a-907c-d3ef8bffd735 tempest-VolumeDependencyTests-972921078 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e.3f2607ca-5f77-4633-9f70-a20dfb08e793" returned: 0 in 0.576s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:49 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-35135252-6891-479a-907c-d3ef8bffd735 tempest-VolumeDependencyTests-972921078 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82485) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:01:49 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-35135252-6891-479a-907c-d3ef8bffd735 tempest-VolumeDependencyTests-972921078 None] will copy from snapshot at /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e {{(pid=82485) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 15 16:01:49 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-35135252-6891-479a-907c-d3ef8bffd735 tempest-VolumeDependencyTests-972921078 None] Creating direct copy from snapshot {{(pid=82485) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 15 16:01:49 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b6efb3-23cb-4ec9-8830-bc3260cd66d2]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:01:49 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-35135252-6891-479a-907c-d3ef8bffd735 tempest-VolumeDependencyTests-972921078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:49 devstack sudo[90644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e
Apr 15 16:01:49 devstack sudo[90644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:49 devstack sudo[90639]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:49 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3c4f60c9-c723-4af8-9482-81a10f829464 tempest-CreateVolumesFromImageTest-674786425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-61b77847-5f78-42a7-8b82-faf531b8caff" returned: 0 in 0.664s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:49 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3c4f60c9-c723-4af8-9482-81a10f829464 tempest-CreateVolumesFromImageTest-674786425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-61b77847-5f78-42a7-8b82-faf531b8caff {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:49 devstack sudo[90649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-61b77847-5f78-42a7-8b82-faf531b8caff
Apr 15 16:01:49 devstack sudo[90649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:49 devstack sudo[90644]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:49 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-35135252-6891-479a-907c-d3ef8bffd735 tempest-VolumeDependencyTests-972921078 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e" returned: 0 in 0.617s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:50 devstack cinder-volume[82485]: DEBUG cinder.utils [None req-35135252-6891-479a-907c-d3ef8bffd735 tempest-VolumeDependencyTests-972921078 None] Path /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f55628c3-c48d-4c04-9eda-3b29eb054b09 not found in is_blk_device check {{(pid=82485) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 15 16:01:50 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-35135252-6891-479a-907c-d3ef8bffd735 tempest-VolumeDependencyTests-972921078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f55628c3-c48d-4c04-9eda-3b29eb054b09 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:50 devstack sudo[90655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f55628c3-c48d-4c04-9eda-3b29eb054b09
Apr 15 16:01:50 devstack sudo[90655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:50 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-26d25adc-b335-46f6-9925-33a188415ac7 tempest-CreateVolumesFromSnapshotTest-222009090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:01:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-26d25adc-b335-46f6-9925-33a188415ac7 tempest-CreateVolumesFromSnapshotTest-222009090 None] Flow 'volume_create_manager' (6aa16b3e-8351-4a2b-9557-ca826440c69e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:01:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-26d25adc-b335-46f6-9925-33a188415ac7 tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f45113f-91e8-40cd-b448-9d725ab1fbef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-26d25adc-b335-46f6-9925-33a188415ac7 tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f45113f-91e8-40cd-b448-9d725ab1fbef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1744613216',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67ba2cee-04e1-4a3c-aa22-9d49cb4ccb38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7443389655b74f149df0a24eb30d8dc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:01:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:01:50Z,use_quota=True,user_id='652d06f55c70440e9cb36b14ad2e5e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-26d25adc-b335-46f6-9925-33a188415ac7 tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64ce22e6-916c-4041-8540-a8d308334937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-26d25adc-b335-46f6-9925-33a188415ac7 tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64ce22e6-916c-4041-8540-a8d308334937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-26d25adc-b335-46f6-9925-33a188415ac7 tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c89420a-6aa5-42f5-8e8b-c9a006382fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-26d25adc-b335-46f6-9925-33a188415ac7 tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c89420a-6aa5-42f5-8e8b-c9a006382fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67ba2cee-04e1-4a3c-aa22-9d49cb4ccb38', 'volume_name': 'volume-67ba2cee-04e1-4a3c-aa22-9d49cb4ccb38', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-26d25adc-b335-46f6-9925-33a188415ac7 tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3323cde6-7703-462f-a372-b35eb1cb7351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:50 devstack sudo[90649]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-26d25adc-b335-46f6-9925-33a188415ac7 tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3323cde6-7703-462f-a372-b35eb1cb7351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-26d25adc-b335-46f6-9925-33a188415ac7 tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b645d96-be50-4391-b310-18987c2d655c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:50 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-26d25adc-b335-46f6-9925-33a188415ac7 tempest-CreateVolumesFromSnapshotTest-222009090 None] Volume 67ba2cee-04e1-4a3c-aa22-9d49cb4ccb38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67ba2cee-04e1-4a3c-aa22-9d49cb4ccb38', 'volume_size': 1}
Apr 15 16:01:50 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-26d25adc-b335-46f6-9925-33a188415ac7 tempest-CreateVolumesFromSnapshotTest-222009090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:01:50 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3c4f60c9-c723-4af8-9482-81a10f829464 tempest-CreateVolumesFromImageTest-674786425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-61b77847-5f78-42a7-8b82-faf531b8caff" returned: 0 in 0.614s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:50 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-3c4f60c9-c723-4af8-9482-81a10f829464 tempest-CreateVolumesFromImageTest-674786425 None] Lock "cinder-quobyte-61b77847-5f78-42a7-8b82-faf531b8caff" released by "delete_volume" :: held 1.313s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:01:50 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-3c4f60c9-c723-4af8-9482-81a10f829464 tempest-CreateVolumesFromImageTest-674786425 None] Created reservations ['8a57fc1d-14bb-4819-b651-aba0a7993801', '65567a07-222f-4a76-ab5f-ba318264e06d', 'f789ccaf-eb83-4895-93ca-4ff1fb6dd3af', 'da32df5e-bd3f-412e-ac1c-94028876113c'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:01:50 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c42e2f9-b60e-4e0e-9948-e575ac76d987 tempest-CreateVolumesFromSnapshotTest-222009090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:01:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-6c42e2f9-b60e-4e0e-9948-e575ac76d987 tempest-CreateVolumesFromSnapshotTest-222009090 None] Flow 'volume_create_manager' (5aabe5b2-579f-4bbf-b396-a41df99d9932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:01:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-6c42e2f9-b60e-4e0e-9948-e575ac76d987 tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ff17145-a80f-4929-942d-e24f89394d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-6c42e2f9-b60e-4e0e-9948-e575ac76d987 tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ff17145-a80f-4929-942d-e24f89394d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1990175572',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5039165-63f2-4912-8bf4-2915f9504ac5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7443389655b74f149df0a24eb30d8dc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:01:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:01:50Z,use_quota=True,user_id='652d06f55c70440e9cb36b14ad2e5e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-6c42e2f9-b60e-4e0e-9948-e575ac76d987 tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a79f02df-d459-4be7-8358-b20cda37da6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-6c42e2f9-b60e-4e0e-9948-e575ac76d987 tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a79f02df-d459-4be7-8358-b20cda37da6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-6c42e2f9-b60e-4e0e-9948-e575ac76d987 tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b64ed441-020e-401c-85d4-784ffc745945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-6c42e2f9-b60e-4e0e-9948-e575ac76d987 tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b64ed441-020e-401c-85d4-784ffc745945) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5039165-63f2-4912-8bf4-2915f9504ac5', 'volume_name': 'volume-a5039165-63f2-4912-8bf4-2915f9504ac5', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-6c42e2f9-b60e-4e0e-9948-e575ac76d987 tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b78d78c0-19a9-4623-be43-adc0d86868e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-6c42e2f9-b60e-4e0e-9948-e575ac76d987 tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b78d78c0-19a9-4623-be43-adc0d86868e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-6c42e2f9-b60e-4e0e-9948-e575ac76d987 tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07a6c947-931f-486a-89cb-c6f237abc232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:50 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-6c42e2f9-b60e-4e0e-9948-e575ac76d987 tempest-CreateVolumesFromSnapshotTest-222009090 None] Volume a5039165-63f2-4912-8bf4-2915f9504ac5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5039165-63f2-4912-8bf4-2915f9504ac5', 'volume_size': 1}
Apr 15 16:01:50 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-6c42e2f9-b60e-4e0e-9948-e575ac76d987 tempest-CreateVolumesFromSnapshotTest-222009090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:01:50 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-3c4f60c9-c723-4af8-9482-81a10f829464 tempest-CreateVolumesFromImageTest-674786425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:01:50 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-3c4f60c9-c723-4af8-9482-81a10f829464 tempest-CreateVolumesFromImageTest-674786425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:01:50 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-3c4f60c9-c723-4af8-9482-81a10f829464 tempest-CreateVolumesFromImageTest-674786425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:01:50 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-3c4f60c9-c723-4af8-9482-81a10f829464 tempest-CreateVolumesFromImageTest-674786425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:01:50 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-3c4f60c9-c723-4af8-9482-81a10f829464 tempest-CreateVolumesFromImageTest-674786425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:01:50 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3c4f60c9-c723-4af8-9482-81a10f829464 tempest-CreateVolumesFromImageTest-674786425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:50 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-28717761-eeaa-48c1-b7ea-e575c36cb6f8 tempest-SnapshotDependencyTests-1453928896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:01:50 devstack sudo[90657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 16:01:50 devstack sudo[90657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-28717761-eeaa-48c1-b7ea-e575c36cb6f8 tempest-SnapshotDependencyTests-1453928896 None] Flow 'volume_create_manager' (cd31164e-606f-4d0e-86b2-efbcd05cb388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:01:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-28717761-eeaa-48c1-b7ea-e575c36cb6f8 tempest-SnapshotDependencyTests-1453928896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (195da1f3-f755-493f-b1fb-9fed5fb30f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-28717761-eeaa-48c1-b7ea-e575c36cb6f8 tempest-SnapshotDependencyTests-1453928896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (195da1f3-f755-493f-b1fb-9fed5fb30f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1152814227',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5a8607c-3448-4293-adc7-adaa566ffcce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bd3271b80bf4b4f9219cc20fe9d7b4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:01:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:01:50Z,use_quota=True,user_id='ee9dffb1b3e84afc9410ccacd756ce68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-28717761-eeaa-48c1-b7ea-e575c36cb6f8 tempest-SnapshotDependencyTests-1453928896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6fbee62-ec4b-4349-9d6a-165722eb0b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-28717761-eeaa-48c1-b7ea-e575c36cb6f8 tempest-SnapshotDependencyTests-1453928896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6fbee62-ec4b-4349-9d6a-165722eb0b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-28717761-eeaa-48c1-b7ea-e575c36cb6f8 tempest-SnapshotDependencyTests-1453928896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f96e8059-0bec-4f31-9f1b-b6bb2a8be13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-28717761-eeaa-48c1-b7ea-e575c36cb6f8 tempest-SnapshotDependencyTests-1453928896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f96e8059-0bec-4f31-9f1b-b6bb2a8be13d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5a8607c-3448-4293-adc7-adaa566ffcce', 'volume_name': 'volume-b5a8607c-3448-4293-adc7-adaa566ffcce', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-28717761-eeaa-48c1-b7ea-e575c36cb6f8 tempest-SnapshotDependencyTests-1453928896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5569f5a8-6919-4e7c-a036-fc8d2837bc15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-28717761-eeaa-48c1-b7ea-e575c36cb6f8 tempest-SnapshotDependencyTests-1453928896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5569f5a8-6919-4e7c-a036-fc8d2837bc15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-28717761-eeaa-48c1-b7ea-e575c36cb6f8 tempest-SnapshotDependencyTests-1453928896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7ecb05d-0766-4345-9c7a-2a3c57e16e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:50 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-28717761-eeaa-48c1-b7ea-e575c36cb6f8 tempest-SnapshotDependencyTests-1453928896 None] Volume b5a8607c-3448-4293-adc7-adaa566ffcce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5a8607c-3448-4293-adc7-adaa566ffcce', 'volume_size': 1}
Apr 15 16:01:50 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-28717761-eeaa-48c1-b7ea-e575c36cb6f8 tempest-SnapshotDependencyTests-1453928896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:01:50 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-80a4a229-1fb9-42f4-9d7f-1695eb83e45a tempest-CreateVolumesFromSnapshotTest-222009090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:01:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-80a4a229-1fb9-42f4-9d7f-1695eb83e45a tempest-CreateVolumesFromSnapshotTest-222009090 None] Flow 'volume_create_manager' (d02f85bb-2a30-44c0-a520-376272569eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:01:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-80a4a229-1fb9-42f4-9d7f-1695eb83e45a tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5f007db-08b3-4af4-a6c5-de9581e6612c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-80a4a229-1fb9-42f4-9d7f-1695eb83e45a tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5f007db-08b3-4af4-a6c5-de9581e6612c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-716950855',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6c608bb-43c0-45f8-ad9a-ec930e88a3b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7443389655b74f149df0a24eb30d8dc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:01:51Z,use_quota=True,user_id='652d06f55c70440e9cb36b14ad2e5e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-80a4a229-1fb9-42f4-9d7f-1695eb83e45a tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e2efffd-2406-4fa5-81ab-e081011c5403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-80a4a229-1fb9-42f4-9d7f-1695eb83e45a tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e2efffd-2406-4fa5-81ab-e081011c5403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-80a4a229-1fb9-42f4-9d7f-1695eb83e45a tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1f1600b-6cbb-4e68-9e4c-5147c5ba07d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-80a4a229-1fb9-42f4-9d7f-1695eb83e45a tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1f1600b-6cbb-4e68-9e4c-5147c5ba07d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6c608bb-43c0-45f8-ad9a-ec930e88a3b6', 'volume_name': 'volume-b6c608bb-43c0-45f8-ad9a-ec930e88a3b6', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-80a4a229-1fb9-42f4-9d7f-1695eb83e45a tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acf70d15-1e82-4706-9af8-644914b2b541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-80a4a229-1fb9-42f4-9d7f-1695eb83e45a tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acf70d15-1e82-4706-9af8-644914b2b541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:50 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-80a4a229-1fb9-42f4-9d7f-1695eb83e45a tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81ad5162-37f5-4206-b0fe-1d4ac50ae7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:50 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-80a4a229-1fb9-42f4-9d7f-1695eb83e45a tempest-CreateVolumesFromSnapshotTest-222009090 None] Volume b6c608bb-43c0-45f8-ad9a-ec930e88a3b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6c608bb-43c0-45f8-ad9a-ec930e88a3b6', 'volume_size': 1}
Apr 15 16:01:50 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-80a4a229-1fb9-42f4-9d7f-1695eb83e45a tempest-CreateVolumesFromSnapshotTest-222009090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:01:51 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dfb2081-9e8d-48ca-9653-12012060cef0 tempest-CreateVolumesFromSnapshotTest-222009090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:01:51 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7dfb2081-9e8d-48ca-9653-12012060cef0 tempest-CreateVolumesFromSnapshotTest-222009090 None] Flow 'volume_create_manager' (3c876375-6b95-4c0b-ace7-2881481bb465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:01:51 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7dfb2081-9e8d-48ca-9653-12012060cef0 tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ab9692b-abdb-417d-9100-fc7e4ca63b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:51 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7dfb2081-9e8d-48ca-9653-12012060cef0 tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ab9692b-abdb-417d-9100-fc7e4ca63b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:01:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2013587681',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61635517-1d4b-411c-b2f1-4645122e80d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7443389655b74f149df0a24eb30d8dc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:01:51Z,use_quota=True,user_id='652d06f55c70440e9cb36b14ad2e5e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:51 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7dfb2081-9e8d-48ca-9653-12012060cef0 tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c87e1e87-0d4a-4811-a1f4-18e1fc9ecce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:51 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7dfb2081-9e8d-48ca-9653-12012060cef0 tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c87e1e87-0d4a-4811-a1f4-18e1fc9ecce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:51 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7dfb2081-9e8d-48ca-9653-12012060cef0 tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6b1c1fb-4441-4ce3-a228-a4664a7ab5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:51 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7dfb2081-9e8d-48ca-9653-12012060cef0 tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6b1c1fb-4441-4ce3-a228-a4664a7ab5e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61635517-1d4b-411c-b2f1-4645122e80d3', 'volume_name': 'volume-61635517-1d4b-411c-b2f1-4645122e80d3', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:51 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7dfb2081-9e8d-48ca-9653-12012060cef0 tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc71c47b-5549-4257-9cc4-99b9c95d8059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:51 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7dfb2081-9e8d-48ca-9653-12012060cef0 tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc71c47b-5549-4257-9cc4-99b9c95d8059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:51 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7dfb2081-9e8d-48ca-9653-12012060cef0 tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e658e2c-6b7f-489d-961e-6516df52cfdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:51 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-7dfb2081-9e8d-48ca-9653-12012060cef0 tempest-CreateVolumesFromSnapshotTest-222009090 None] Volume 61635517-1d4b-411c-b2f1-4645122e80d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61635517-1d4b-411c-b2f1-4645122e80d3', 'volume_size': 1}
Apr 15 16:01:51 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7dfb2081-9e8d-48ca-9653-12012060cef0 tempest-CreateVolumesFromSnapshotTest-222009090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:01:51 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-94cac201-371b-463e-84e3-f8e315226369 tempest-CreateVolumesFromImageTest-674786425 None] Acquiring lock "cinder-2993beb2-5457-4aea-9cac-cc4b320ed87e-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:01:51 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-94cac201-371b-463e-84e3-f8e315226369 tempest-CreateVolumesFromImageTest-674786425 None] Lock "cinder-2993beb2-5457-4aea-9cac-cc4b320ed87e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:01:51 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-94cac201-371b-463e-84e3-f8e315226369 tempest-CreateVolumesFromImageTest-674786425 None] Acquiring lock "cinder-quobyte-2993beb2-5457-4aea-9cac-cc4b320ed87e" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:01:51 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-94cac201-371b-463e-84e3-f8e315226369 tempest-CreateVolumesFromImageTest-674786425 None] Lock "cinder-quobyte-2993beb2-5457-4aea-9cac-cc4b320ed87e" acquired by "delete_volume" :: waited 0.012s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:01:51 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88cd3a1-2e83-4fc4-b340-646d190da6a7]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:01:51 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-94cac201-371b-463e-84e3-f8e315226369 tempest-CreateVolumesFromImageTest-674786425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-2993beb2-5457-4aea-9cac-cc4b320ed87e {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:51 devstack sudo[90671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-2993beb2-5457-4aea-9cac-cc4b320ed87e
Apr 15 16:01:51 devstack sudo[90671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:51 devstack sudo[90657]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:51 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-3c4f60c9-c723-4af8-9482-81a10f829464 tempest-CreateVolumesFromImageTest-674786425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 1.483s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:51 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-3c4f60c9-c723-4af8-9482-81a10f829464 tempest-CreateVolumesFromImageTest-674786425 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:01:51 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-3c4f60c9-c723-4af8-9482-81a10f829464 tempest-CreateVolumesFromImageTest-674786425 None] Deleted volume successfully.
Apr 15 16:01:51 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-3c4f60c9-c723-4af8-9482-81a10f829464 tempest-CreateVolumesFromImageTest-674786425 None] Lock "cinder-61b77847-5f78-42a7-8b82-faf531b8caff-delete_volume" released by "delete_volume" :: held 3.128s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:01:52 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-e34205aa-114a-4867-96ed-cdc10496ec2e tempest-CreateVolumesFromSnapshotTest-222009090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:01:52 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-e34205aa-114a-4867-96ed-cdc10496ec2e tempest-CreateVolumesFromSnapshotTest-222009090 None] Flow 'volume_create_manager' (00d02942-bc31-4286-b2f8-3633e6ba49dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:01:52 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-e34205aa-114a-4867-96ed-cdc10496ec2e tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8078b6f-dd00-448d-9b18-12acab8e8ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:52 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-e34205aa-114a-4867-96ed-cdc10496ec2e tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8078b6f-dd00-448d-9b18-12acab8e8ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:01:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1906018701',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29de8072-d0df-4332-ae03-dff4920e71b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7443389655b74f149df0a24eb30d8dc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:01:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:01:52Z,use_quota=True,user_id='652d06f55c70440e9cb36b14ad2e5e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:52 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-e34205aa-114a-4867-96ed-cdc10496ec2e tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a58cc480-e8e6-4016-9879-745fb427831d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:52 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-e34205aa-114a-4867-96ed-cdc10496ec2e tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a58cc480-e8e6-4016-9879-745fb427831d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:52 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-e34205aa-114a-4867-96ed-cdc10496ec2e tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecf18209-9b23-4fb4-a2f8-6f7bcf73cffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:52 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-e34205aa-114a-4867-96ed-cdc10496ec2e tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecf18209-9b23-4fb4-a2f8-6f7bcf73cffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29de8072-d0df-4332-ae03-dff4920e71b4', 'volume_name': 'volume-29de8072-d0df-4332-ae03-dff4920e71b4', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:52 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-e34205aa-114a-4867-96ed-cdc10496ec2e tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (582dc400-b969-4d06-aa33-98089d3c72f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:52 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-e34205aa-114a-4867-96ed-cdc10496ec2e tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (582dc400-b969-4d06-aa33-98089d3c72f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:52 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-e34205aa-114a-4867-96ed-cdc10496ec2e tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76e7ec62-f978-4eb2-9efb-2e2d68958290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:52 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-e34205aa-114a-4867-96ed-cdc10496ec2e tempest-CreateVolumesFromSnapshotTest-222009090 None] Volume 29de8072-d0df-4332-ae03-dff4920e71b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29de8072-d0df-4332-ae03-dff4920e71b4', 'volume_size': 1}
Apr 15 16:01:52 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-e34205aa-114a-4867-96ed-cdc10496ec2e tempest-CreateVolumesFromSnapshotTest-222009090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:01:52 devstack sudo[90655]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:52 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-35135252-6891-479a-907c-d3ef8bffd735 tempest-VolumeDependencyTests-972921078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f55628c3-c48d-4c04-9eda-3b29eb054b09" returned: 0 in 2.512s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:52 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bdffe7e-d6eb-4e1c-a1af-3a7478355718]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:01:52 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-35135252-6891-479a-907c-d3ef8bffd735 tempest-VolumeDependencyTests-972921078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:52 devstack sudo[90671]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:52 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-94cac201-371b-463e-84e3-f8e315226369 tempest-CreateVolumesFromImageTest-674786425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-2993beb2-5457-4aea-9cac-cc4b320ed87e" returned: 0 in 0.956s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:52 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-94cac201-371b-463e-84e3-f8e315226369 tempest-CreateVolumesFromImageTest-674786425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-2993beb2-5457-4aea-9cac-cc4b320ed87e {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:52 devstack sudo[90677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e
Apr 15 16:01:52 devstack sudo[90677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:52 devstack sudo[90678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-2993beb2-5457-4aea-9cac-cc4b320ed87e
Apr 15 16:01:52 devstack sudo[90678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:53 devstack sudo[90678]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:53 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-94cac201-371b-463e-84e3-f8e315226369 tempest-CreateVolumesFromImageTest-674786425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-2993beb2-5457-4aea-9cac-cc4b320ed87e" returned: 0 in 0.458s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:53 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-94cac201-371b-463e-84e3-f8e315226369 tempest-CreateVolumesFromImageTest-674786425 None] Lock "cinder-quobyte-2993beb2-5457-4aea-9cac-cc4b320ed87e" released by "delete_volume" :: held 1.456s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:01:53 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-94cac201-371b-463e-84e3-f8e315226369 tempest-CreateVolumesFromImageTest-674786425 None] Created reservations ['a9b33893-d4a6-4750-b86e-712f63f4e7af', '86eacf3a-8bbc-47aa-8d81-e588817ff6a4', '6c8172f0-15b3-4bc6-98d7-ee65ca406210', 'df971aa4-d5e7-499c-9812-ab86977e48ff'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:01:53 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-94cac201-371b-463e-84e3-f8e315226369 tempest-CreateVolumesFromImageTest-674786425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:01:53 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-94cac201-371b-463e-84e3-f8e315226369 tempest-CreateVolumesFromImageTest-674786425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:01:53 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-94cac201-371b-463e-84e3-f8e315226369 tempest-CreateVolumesFromImageTest-674786425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:01:53 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-94cac201-371b-463e-84e3-f8e315226369 tempest-CreateVolumesFromImageTest-674786425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:01:53 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-94cac201-371b-463e-84e3-f8e315226369 tempest-CreateVolumesFromImageTest-674786425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:01:53 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-94cac201-371b-463e-84e3-f8e315226369 tempest-CreateVolumesFromImageTest-674786425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:53 devstack sudo[90685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 16:01:53 devstack sudo[90685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:53 devstack sudo[90677]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:53 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-35135252-6891-479a-907c-d3ef8bffd735 tempest-VolumeDependencyTests-972921078 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e" returned: 0 in 0.638s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:53 devstack cinder-volume[82485]: DEBUG cinder.image.image_utils [None req-35135252-6891-479a-907c-d3ef8bffd735 tempest-VolumeDependencyTests-972921078 None] Image conversion details: src /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e, size 1024.00 MB, duration 2.51 sec, destination /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f55628c3-c48d-4c04-9eda-3b29eb054b09 {{(pid=82485) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 16:01:53 devstack cinder-volume[82485]: INFO cinder.image.image_utils [None req-35135252-6891-479a-907c-d3ef8bffd735 tempest-VolumeDependencyTests-972921078 None] Converted 1024.00 MB image at 407.56 MB/s
Apr 15 16:01:53 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-35135252-6891-479a-907c-d3ef8bffd735 tempest-VolumeDependencyTests-972921078 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f55628c3-c48d-4c04-9eda-3b29eb054b09 is being set with open permissions: ugo+rw
Apr 15 16:01:53 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-35135252-6891-479a-907c-d3ef8bffd735 tempest-VolumeDependencyTests-972921078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f55628c3-c48d-4c04-9eda-3b29eb054b09 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:53 devstack sudo[90687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f55628c3-c48d-4c04-9eda-3b29eb054b09
Apr 15 16:01:53 devstack sudo[90687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:53 devstack sudo[90685]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:53 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-94cac201-371b-463e-84e3-f8e315226369 tempest-CreateVolumesFromImageTest-674786425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.423s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:53 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-94cac201-371b-463e-84e3-f8e315226369 tempest-CreateVolumesFromImageTest-674786425 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:01:53 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-94cac201-371b-463e-84e3-f8e315226369 tempest-CreateVolumesFromImageTest-674786425 None] Deleted volume successfully.
Apr 15 16:01:53 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-94cac201-371b-463e-84e3-f8e315226369 tempest-CreateVolumesFromImageTest-674786425 None] Lock "cinder-2993beb2-5457-4aea-9cac-cc4b320ed87e-delete_volume" released by "delete_volume" :: held 2.029s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:01:53 devstack sudo[90687]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:53 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-35135252-6891-479a-907c-d3ef8bffd735 tempest-VolumeDependencyTests-972921078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f55628c3-c48d-4c04-9eda-3b29eb054b09" returned: 0 in 0.442s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:53 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-35135252-6891-479a-907c-d3ef8bffd735 tempest-VolumeDependencyTests-972921078 None] Lock "cinder-quobyte-f55628c3-c48d-4c04-9eda-3b29eb054b09" released by "_copy_volume_from_snapshot" :: held 4.862s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:01:53 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-35135252-6891-479a-907c-d3ef8bffd735 tempest-VolumeDependencyTests-972921078 None] Lock "cinder-quobyte-3f2607ca-5f77-4633-9f70-a20dfb08e793-f55628c3-c48d-4c04-9eda-3b29eb054b09" released by "_create_volume_from_snapshot" :: held 4.883s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:01:53 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-35135252-6891-479a-907c-d3ef8bffd735 tempest-VolumeDependencyTests-972921078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.902s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:01:53 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-26d25adc-b335-46f6-9925-33a188415ac7 tempest-CreateVolumesFromSnapshotTest-222009090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.393s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:01:53 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-26d25adc-b335-46f6-9925-33a188415ac7 tempest-CreateVolumesFromSnapshotTest-222009090 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1744613216',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67ba2cee-04e1-4a3c-aa22-9d49cb4ccb38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7443389655b74f149df0a24eb30d8dc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:01:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:01:50Z,use_quota=True,user_id='652d06f55c70440e9cb36b14ad2e5e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:01:53 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-26d25adc-b335-46f6-9925-33a188415ac7 tempest-CreateVolumesFromSnapshotTest-222009090 None] Creating volume 67ba2cee-04e1-4a3c-aa22-9d49cb4ccb38 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:01:53 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-26d25adc-b335-46f6-9925-33a188415ac7 tempest-CreateVolumesFromSnapshotTest-222009090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:01:53 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-26d25adc-b335-46f6-9925-33a188415ac7 tempest-CreateVolumesFromSnapshotTest-222009090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:01:53 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-26d25adc-b335-46f6-9925-33a188415ac7 tempest-CreateVolumesFromSnapshotTest-222009090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:01:53 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-26d25adc-b335-46f6-9925-33a188415ac7 tempest-CreateVolumesFromSnapshotTest-222009090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:01:53 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-26d25adc-b335-46f6-9925-33a188415ac7 tempest-CreateVolumesFromSnapshotTest-222009090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:01:53 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-26d25adc-b335-46f6-9925-33a188415ac7 tempest-CreateVolumesFromSnapshotTest-222009090 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:01:53 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-26d25adc-b335-46f6-9925-33a188415ac7 tempest-CreateVolumesFromSnapshotTest-222009090 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 16:01:53 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-26d25adc-b335-46f6-9925-33a188415ac7 tempest-CreateVolumesFromSnapshotTest-222009090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-67ba2cee-04e1-4a3c-aa22-9d49cb4ccb38 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:53 devstack sudo[90691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-67ba2cee-04e1-4a3c-aa22-9d49cb4ccb38 1073741824
Apr 15 16:01:53 devstack sudo[90691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:53 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-35135252-6891-479a-907c-d3ef8bffd735 tempest-VolumeDependencyTests-972921078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0a02bfb-b2cc-460f-a8f8-100c3acdea8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f55628c3-c48d-4c04-9eda-3b29eb054b09', 'volume_size': 1, 'snapshot_id': '3f2607ca-5f77-4633-9f70-a20dfb08e793'}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:53 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-35135252-6891-479a-907c-d3ef8bffd735 tempest-VolumeDependencyTests-972921078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57f9f56b-8390-4e3f-b48b-7cf994d93907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:53 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-35135252-6891-479a-907c-d3ef8bffd735 tempest-VolumeDependencyTests-972921078 None] Volume volume-f55628c3-c48d-4c04-9eda-3b29eb054b09 (f55628c3-c48d-4c04-9eda-3b29eb054b09): created successfully
Apr 15 16:01:53 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-35135252-6891-479a-907c-d3ef8bffd735 tempest-VolumeDependencyTests-972921078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57f9f56b-8390-4e3f-b48b-7cf994d93907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:53 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-35135252-6891-479a-907c-d3ef8bffd735 tempest-VolumeDependencyTests-972921078 None] Flow 'volume_create_manager' (4fae1d89-da1c-481a-bd04-a7fafac156c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:01:53 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-35135252-6891-479a-907c-d3ef8bffd735 tempest-VolumeDependencyTests-972921078 None] Created volume successfully.
Apr 15 16:01:54 devstack sudo[90691]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-26d25adc-b335-46f6-9925-33a188415ac7 tempest-CreateVolumesFromSnapshotTest-222009090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-67ba2cee-04e1-4a3c-aa22-9d49cb4ccb38 1073741824" returned: 0 in 0.561s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-26d25adc-b335-46f6-9925-33a188415ac7 tempest-CreateVolumesFromSnapshotTest-222009090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-67ba2cee-04e1-4a3c-aa22-9d49cb4ccb38 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:54 devstack sudo[90696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-67ba2cee-04e1-4a3c-aa22-9d49cb4ccb38
Apr 15 16:01:54 devstack sudo[90696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:54 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-135c709a-fa31-4b0f-8608-4414c77f42b3 tempest-VolumeDependencyTests-972921078 None] Acquiring lock "cinder-3f2607ca-5f77-4633-9f70-a20dfb08e793-delete_snapshot" by "delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:01:54 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-135c709a-fa31-4b0f-8608-4414c77f42b3 tempest-VolumeDependencyTests-972921078 None] Lock "cinder-3f2607ca-5f77-4633-9f70-a20dfb08e793-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:01:54 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-135c709a-fa31-4b0f-8608-4414c77f42b3 tempest-VolumeDependencyTests-972921078 None] Acquiring lock "cinder-quobyte-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e" by "delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:01:54 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-135c709a-fa31-4b0f-8608-4414c77f42b3 tempest-VolumeDependencyTests-972921078 None] Lock "cinder-quobyte-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:01:54 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-135c709a-fa31-4b0f-8608-4414c77f42b3 tempest-VolumeDependencyTests-972921078 None] Acquiring lock "cinder-quobyte-3f2607ca-5f77-4633-9f70-a20dfb08e793" by "_delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:01:54 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-135c709a-fa31-4b0f-8608-4414c77f42b3 tempest-VolumeDependencyTests-972921078 None] Lock "cinder-quobyte-3f2607ca-5f77-4633-9f70-a20dfb08e793" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:01:54 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-135c709a-fa31-4b0f-8608-4414c77f42b3 tempest-VolumeDependencyTests-972921078 None] Deleting offline snapshot 3f2607ca-5f77-4633-9f70-a20dfb08e793 of volume 6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 16:01:54 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-135c709a-fa31-4b0f-8608-4414c77f42b3 tempest-VolumeDependencyTests-972921078 None] snapshot_file for this snap is: volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e.3f2607ca-5f77-4633-9f70-a20dfb08e793 {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 16:01:54 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[660fe5b9-f1ae-45f7-b2fd-9cf1bb04ef0c]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:01:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-135c709a-fa31-4b0f-8608-4414c77f42b3 tempest-VolumeDependencyTests-972921078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e.3f2607ca-5f77-4633-9f70-a20dfb08e793 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:54 devstack sudo[90696]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-26d25adc-b335-46f6-9925-33a188415ac7 tempest-CreateVolumesFromSnapshotTest-222009090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-67ba2cee-04e1-4a3c-aa22-9d49cb4ccb38" returned: 0 in 0.537s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:54 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-26d25adc-b335-46f6-9925-33a188415ac7 tempest-CreateVolumesFromSnapshotTest-222009090 None] <== create_volume: return (1130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:01:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-26d25adc-b335-46f6-9925-33a188415ac7 tempest-CreateVolumesFromSnapshotTest-222009090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:01:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-6c42e2f9-b60e-4e0e-9948-e575ac76d987 tempest-CreateVolumesFromSnapshotTest-222009090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.337s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:01:54 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-6c42e2f9-b60e-4e0e-9948-e575ac76d987 tempest-CreateVolumesFromSnapshotTest-222009090 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1990175572',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5039165-63f2-4912-8bf4-2915f9504ac5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7443389655b74f149df0a24eb30d8dc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:01:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:01:50Z,use_quota=True,user_id='652d06f55c70440e9cb36b14ad2e5e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:01:54 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-6c42e2f9-b60e-4e0e-9948-e575ac76d987 tempest-CreateVolumesFromSnapshotTest-222009090 None] Creating volume a5039165-63f2-4912-8bf4-2915f9504ac5 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:01:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-6c42e2f9-b60e-4e0e-9948-e575ac76d987 tempest-CreateVolumesFromSnapshotTest-222009090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:01:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-6c42e2f9-b60e-4e0e-9948-e575ac76d987 tempest-CreateVolumesFromSnapshotTest-222009090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:01:54 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-6c42e2f9-b60e-4e0e-9948-e575ac76d987 tempest-CreateVolumesFromSnapshotTest-222009090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:01:54 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-6c42e2f9-b60e-4e0e-9948-e575ac76d987 tempest-CreateVolumesFromSnapshotTest-222009090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:01:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-6c42e2f9-b60e-4e0e-9948-e575ac76d987 tempest-CreateVolumesFromSnapshotTest-222009090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:01:54 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-6c42e2f9-b60e-4e0e-9948-e575ac76d987 tempest-CreateVolumesFromSnapshotTest-222009090 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:01:54 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-6c42e2f9-b60e-4e0e-9948-e575ac76d987 tempest-CreateVolumesFromSnapshotTest-222009090 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 16:01:54 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6c42e2f9-b60e-4e0e-9948-e575ac76d987 tempest-CreateVolumesFromSnapshotTest-222009090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a5039165-63f2-4912-8bf4-2915f9504ac5 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:54 devstack sudo[90701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e.3f2607ca-5f77-4633-9f70-a20dfb08e793
Apr 15 16:01:54 devstack sudo[90701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:54 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-26d25adc-b335-46f6-9925-33a188415ac7 tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b645d96-be50-4391-b310-18987c2d655c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67ba2cee-04e1-4a3c-aa22-9d49cb4ccb38', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:54 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-26d25adc-b335-46f6-9925-33a188415ac7 tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8479733-6870-4f15-b889-7d239ae5544f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:54 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-26d25adc-b335-46f6-9925-33a188415ac7 tempest-CreateVolumesFromSnapshotTest-222009090 None] Volume volume-67ba2cee-04e1-4a3c-aa22-9d49cb4ccb38 (67ba2cee-04e1-4a3c-aa22-9d49cb4ccb38): created successfully
Apr 15 16:01:54 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-26d25adc-b335-46f6-9925-33a188415ac7 tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8479733-6870-4f15-b889-7d239ae5544f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:54 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-26d25adc-b335-46f6-9925-33a188415ac7 tempest-CreateVolumesFromSnapshotTest-222009090 None] Flow 'volume_create_manager' (6aa16b3e-8351-4a2b-9557-ca826440c69e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:01:54 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-26d25adc-b335-46f6-9925-33a188415ac7 tempest-CreateVolumesFromSnapshotTest-222009090 None] Created volume successfully.
Apr 15 16:01:54 devstack sudo[90702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a5039165-63f2-4912-8bf4-2915f9504ac5 1073741824
Apr 15 16:01:54 devstack sudo[90702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:55 devstack sudo[90701]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:55 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-135c709a-fa31-4b0f-8608-4414c77f42b3 tempest-VolumeDependencyTests-972921078 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e.3f2607ca-5f77-4633-9f70-a20dfb08e793" returned: 0 in 0.631s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:55 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-135c709a-fa31-4b0f-8608-4414c77f42b3 tempest-VolumeDependencyTests-972921078 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82485) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:01:55 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcdd7352-2900-4e8e-951e-1e9f8af62e9b]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:01:55 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-135c709a-fa31-4b0f-8608-4414c77f42b3 tempest-VolumeDependencyTests-972921078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:55 devstack sudo[90702]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:55 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6c42e2f9-b60e-4e0e-9948-e575ac76d987 tempest-CreateVolumesFromSnapshotTest-222009090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a5039165-63f2-4912-8bf4-2915f9504ac5 1073741824" returned: 0 in 0.602s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:55 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6c42e2f9-b60e-4e0e-9948-e575ac76d987 tempest-CreateVolumesFromSnapshotTest-222009090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a5039165-63f2-4912-8bf4-2915f9504ac5 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:55 devstack sudo[90712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a5039165-63f2-4912-8bf4-2915f9504ac5
Apr 15 16:01:55 devstack sudo[90712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:55 devstack sudo[90711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e
Apr 15 16:01:55 devstack sudo[90711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:55 devstack sudo[90712]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:55 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6c42e2f9-b60e-4e0e-9948-e575ac76d987 tempest-CreateVolumesFromSnapshotTest-222009090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a5039165-63f2-4912-8bf4-2915f9504ac5" returned: 0 in 0.497s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:55 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-6c42e2f9-b60e-4e0e-9948-e575ac76d987 tempest-CreateVolumesFromSnapshotTest-222009090 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:01:55 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-6c42e2f9-b60e-4e0e-9948-e575ac76d987 tempest-CreateVolumesFromSnapshotTest-222009090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:01:55 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-28717761-eeaa-48c1-b7ea-e575c36cb6f8 tempest-SnapshotDependencyTests-1453928896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.337s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:01:55 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-28717761-eeaa-48c1-b7ea-e575c36cb6f8 tempest-SnapshotDependencyTests-1453928896 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1152814227',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5a8607c-3448-4293-adc7-adaa566ffcce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bd3271b80bf4b4f9219cc20fe9d7b4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:01:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:01:50Z,use_quota=True,user_id='ee9dffb1b3e84afc9410ccacd756ce68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:01:55 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-28717761-eeaa-48c1-b7ea-e575c36cb6f8 tempest-SnapshotDependencyTests-1453928896 None] Creating volume b5a8607c-3448-4293-adc7-adaa566ffcce {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:01:55 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-28717761-eeaa-48c1-b7ea-e575c36cb6f8 tempest-SnapshotDependencyTests-1453928896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:01:55 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-28717761-eeaa-48c1-b7ea-e575c36cb6f8 tempest-SnapshotDependencyTests-1453928896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:01:55 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-28717761-eeaa-48c1-b7ea-e575c36cb6f8 tempest-SnapshotDependencyTests-1453928896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:01:55 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-28717761-eeaa-48c1-b7ea-e575c36cb6f8 tempest-SnapshotDependencyTests-1453928896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:01:55 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-28717761-eeaa-48c1-b7ea-e575c36cb6f8 tempest-SnapshotDependencyTests-1453928896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:01:55 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-28717761-eeaa-48c1-b7ea-e575c36cb6f8 tempest-SnapshotDependencyTests-1453928896 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:01:55 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-28717761-eeaa-48c1-b7ea-e575c36cb6f8 tempest-SnapshotDependencyTests-1453928896 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 16:01:55 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-28717761-eeaa-48c1-b7ea-e575c36cb6f8 tempest-SnapshotDependencyTests-1453928896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b5a8607c-3448-4293-adc7-adaa566ffcce 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:55 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe7ee5e0-3125-4980-86d2-260cfae5b0b0 tempest-CinderUnicodeTest-847668735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:01:55 devstack sudo[90721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b5a8607c-3448-4293-adc7-adaa566ffcce 1073741824
Apr 15 16:01:55 devstack sudo[90721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:55 devstack sudo[90711]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:55 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-fe7ee5e0-3125-4980-86d2-260cfae5b0b0 tempest-CinderUnicodeTest-847668735 None] Flow 'volume_create_manager' (17f24fa9-5bc4-403e-ba92-cdd2174bb969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:01:55 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-fe7ee5e0-3125-4980-86d2-260cfae5b0b0 tempest-CinderUnicodeTest-847668735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce520e0f-6a03-45af-892b-7c6607ddad2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:55 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-135c709a-fa31-4b0f-8608-4414c77f42b3 tempest-VolumeDependencyTests-972921078 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e" returned: 0 in 0.664s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:55 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-135c709a-fa31-4b0f-8608-4414c77f42b3 tempest-VolumeDependencyTests-972921078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e.3f2607ca-5f77-4633-9f70-a20dfb08e793 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:56 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-fe7ee5e0-3125-4980-86d2-260cfae5b0b0 tempest-CinderUnicodeTest-847668735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce520e0f-6a03-45af-892b-7c6607ddad2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:01:56Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=576aa65e-0d77-4e02-aa72-296dc1d2ee51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b900ac42f89143c2ba33d175c02dffc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:01:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:01:56Z,use_quota=True,user_id='8dd2f079373e480bb4d516ea5eb1f3e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:56 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-fe7ee5e0-3125-4980-86d2-260cfae5b0b0 tempest-CinderUnicodeTest-847668735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3f9eb2a-e123-4008-a453-eb20125d0ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:56 devstack sudo[90723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e.3f2607ca-5f77-4633-9f70-a20dfb08e793
Apr 15 16:01:56 devstack sudo[90723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:56 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-fe7ee5e0-3125-4980-86d2-260cfae5b0b0 tempest-CinderUnicodeTest-847668735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3f9eb2a-e123-4008-a453-eb20125d0ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:56 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-fe7ee5e0-3125-4980-86d2-260cfae5b0b0 tempest-CinderUnicodeTest-847668735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e658ec16-4360-483d-9144-fcbac0451b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:56 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-fe7ee5e0-3125-4980-86d2-260cfae5b0b0 tempest-CinderUnicodeTest-847668735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e658ec16-4360-483d-9144-fcbac0451b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '576aa65e-0d77-4e02-aa72-296dc1d2ee51', 'volume_name': 'volume-576aa65e-0d77-4e02-aa72-296dc1d2ee51', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:56 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-fe7ee5e0-3125-4980-86d2-260cfae5b0b0 tempest-CinderUnicodeTest-847668735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87991089-8fe4-42a3-867e-947ee2e59efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:56 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-fe7ee5e0-3125-4980-86d2-260cfae5b0b0 tempest-CinderUnicodeTest-847668735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87991089-8fe4-42a3-867e-947ee2e59efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:56 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-fe7ee5e0-3125-4980-86d2-260cfae5b0b0 tempest-CinderUnicodeTest-847668735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d54d6722-dade-4bb9-95f0-d982723419d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:56 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-fe7ee5e0-3125-4980-86d2-260cfae5b0b0 tempest-CinderUnicodeTest-847668735 None] Volume 576aa65e-0d77-4e02-aa72-296dc1d2ee51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-576aa65e-0d77-4e02-aa72-296dc1d2ee51', 'volume_size': 1}
Apr 15 16:01:56 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-fe7ee5e0-3125-4980-86d2-260cfae5b0b0 tempest-CinderUnicodeTest-847668735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:01:56 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-6c42e2f9-b60e-4e0e-9948-e575ac76d987 tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07a6c947-931f-486a-89cb-c6f237abc232) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5039165-63f2-4912-8bf4-2915f9504ac5', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:56 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-6c42e2f9-b60e-4e0e-9948-e575ac76d987 tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7291719-d2ed-4150-bb35-cd92972fdb97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:56 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-6c42e2f9-b60e-4e0e-9948-e575ac76d987 tempest-CreateVolumesFromSnapshotTest-222009090 None] Volume volume-a5039165-63f2-4912-8bf4-2915f9504ac5 (a5039165-63f2-4912-8bf4-2915f9504ac5): created successfully
Apr 15 16:01:56 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-6c42e2f9-b60e-4e0e-9948-e575ac76d987 tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7291719-d2ed-4150-bb35-cd92972fdb97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:56 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-6c42e2f9-b60e-4e0e-9948-e575ac76d987 tempest-CreateVolumesFromSnapshotTest-222009090 None] Flow 'volume_create_manager' (5aabe5b2-579f-4bbf-b396-a41df99d9932) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:01:56 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-6c42e2f9-b60e-4e0e-9948-e575ac76d987 tempest-CreateVolumesFromSnapshotTest-222009090 None] Created volume successfully.
Apr 15 16:01:56 devstack sudo[90721]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:56 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-28717761-eeaa-48c1-b7ea-e575c36cb6f8 tempest-SnapshotDependencyTests-1453928896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b5a8607c-3448-4293-adc7-adaa566ffcce 1073741824" returned: 0 in 0.558s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:56 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-28717761-eeaa-48c1-b7ea-e575c36cb6f8 tempest-SnapshotDependencyTests-1453928896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b5a8607c-3448-4293-adc7-adaa566ffcce {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:56 devstack sudo[90731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b5a8607c-3448-4293-adc7-adaa566ffcce
Apr 15 16:01:56 devstack sudo[90731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:56 devstack sudo[90723]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:56 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-135c709a-fa31-4b0f-8608-4414c77f42b3 tempest-VolumeDependencyTests-972921078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e.3f2607ca-5f77-4633-9f70-a20dfb08e793" returned: 0 in 0.514s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:56 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-135c709a-fa31-4b0f-8608-4414c77f42b3 tempest-VolumeDependencyTests-972921078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e.3f2607ca-5f77-4633-9f70-a20dfb08e793 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:56 devstack sudo[90733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e.3f2607ca-5f77-4633-9f70-a20dfb08e793
Apr 15 16:01:56 devstack sudo[90733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:56 devstack sudo[90731]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:56 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-28717761-eeaa-48c1-b7ea-e575c36cb6f8 tempest-SnapshotDependencyTests-1453928896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b5a8607c-3448-4293-adc7-adaa566ffcce" returned: 0 in 0.460s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:56 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-28717761-eeaa-48c1-b7ea-e575c36cb6f8 tempest-SnapshotDependencyTests-1453928896 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:01:56 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-28717761-eeaa-48c1-b7ea-e575c36cb6f8 tempest-SnapshotDependencyTests-1453928896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:01:56 devstack sudo[90733]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:56 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-80a4a229-1fb9-42f4-9d7f-1695eb83e45a tempest-CreateVolumesFromSnapshotTest-222009090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.224s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:01:56 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-80a4a229-1fb9-42f4-9d7f-1695eb83e45a tempest-CreateVolumesFromSnapshotTest-222009090 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-716950855',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6c608bb-43c0-45f8-ad9a-ec930e88a3b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7443389655b74f149df0a24eb30d8dc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:01:51Z,use_quota=True,user_id='652d06f55c70440e9cb36b14ad2e5e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:01:56 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-80a4a229-1fb9-42f4-9d7f-1695eb83e45a tempest-CreateVolumesFromSnapshotTest-222009090 None] Creating volume b6c608bb-43c0-45f8-ad9a-ec930e88a3b6 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:01:56 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-80a4a229-1fb9-42f4-9d7f-1695eb83e45a tempest-CreateVolumesFromSnapshotTest-222009090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:01:56 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-80a4a229-1fb9-42f4-9d7f-1695eb83e45a tempest-CreateVolumesFromSnapshotTest-222009090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:01:56 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-80a4a229-1fb9-42f4-9d7f-1695eb83e45a tempest-CreateVolumesFromSnapshotTest-222009090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:01:56 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-80a4a229-1fb9-42f4-9d7f-1695eb83e45a tempest-CreateVolumesFromSnapshotTest-222009090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:01:56 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-80a4a229-1fb9-42f4-9d7f-1695eb83e45a tempest-CreateVolumesFromSnapshotTest-222009090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:01:56 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-80a4a229-1fb9-42f4-9d7f-1695eb83e45a tempest-CreateVolumesFromSnapshotTest-222009090 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:01:56 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-80a4a229-1fb9-42f4-9d7f-1695eb83e45a tempest-CreateVolumesFromSnapshotTest-222009090 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 16:01:56 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-80a4a229-1fb9-42f4-9d7f-1695eb83e45a tempest-CreateVolumesFromSnapshotTest-222009090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b6c608bb-43c0-45f8-ad9a-ec930e88a3b6 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:56 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-135c709a-fa31-4b0f-8608-4414c77f42b3 tempest-VolumeDependencyTests-972921078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e.3f2607ca-5f77-4633-9f70-a20dfb08e793" returned: 0 in 0.459s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:56 devstack sudo[90737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b6c608bb-43c0-45f8-ad9a-ec930e88a3b6 1073741824
Apr 15 16:01:56 devstack sudo[90737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:57 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-28717761-eeaa-48c1-b7ea-e575c36cb6f8 tempest-SnapshotDependencyTests-1453928896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7ecb05d-0766-4345-9c7a-2a3c57e16e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5a8607c-3448-4293-adc7-adaa566ffcce', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:57 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-28717761-eeaa-48c1-b7ea-e575c36cb6f8 tempest-SnapshotDependencyTests-1453928896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e43929bd-d259-4d4b-b2aa-9a37c9a2c0bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:57 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-135c709a-fa31-4b0f-8608-4414c77f42b3 tempest-VolumeDependencyTests-972921078 None] Lock "cinder-quobyte-3f2607ca-5f77-4633-9f70-a20dfb08e793" released by "_delete_snapshot" :: held 2.351s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:01:57 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-28717761-eeaa-48c1-b7ea-e575c36cb6f8 tempest-SnapshotDependencyTests-1453928896 None] Volume volume-b5a8607c-3448-4293-adc7-adaa566ffcce (b5a8607c-3448-4293-adc7-adaa566ffcce): created successfully
Apr 15 16:01:57 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-28717761-eeaa-48c1-b7ea-e575c36cb6f8 tempest-SnapshotDependencyTests-1453928896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e43929bd-d259-4d4b-b2aa-9a37c9a2c0bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:57 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-28717761-eeaa-48c1-b7ea-e575c36cb6f8 tempest-SnapshotDependencyTests-1453928896 None] Flow 'volume_create_manager' (cd31164e-606f-4d0e-86b2-efbcd05cb388) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:01:57 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-135c709a-fa31-4b0f-8608-4414c77f42b3 tempest-VolumeDependencyTests-972921078 None] Lock "cinder-quobyte-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e" released by "delete_snapshot" :: held 2.381s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:01:57 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-28717761-eeaa-48c1-b7ea-e575c36cb6f8 tempest-SnapshotDependencyTests-1453928896 None] Created volume successfully.
Apr 15 16:01:57 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-135c709a-fa31-4b0f-8608-4414c77f42b3 tempest-VolumeDependencyTests-972921078 None] Created reservations ['90dcde46-5eb9-4c62-8fd4-2edbc53e6633', 'cee5753e-7829-4d60-8dfe-ac1309f5da30', '5fc9642b-f2e7-4ce1-9bab-810de8a5d5f0', 'c220002e-80f2-42a4-8621-1cfd9dd23a66'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:01:57 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-135c709a-fa31-4b0f-8608-4414c77f42b3 tempest-VolumeDependencyTests-972921078 None] Delete snapshot completed successfully.
Apr 15 16:01:57 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-135c709a-fa31-4b0f-8608-4414c77f42b3 tempest-VolumeDependencyTests-972921078 None] Lock "cinder-3f2607ca-5f77-4633-9f70-a20dfb08e793-delete_snapshot" released by "delete_snapshot" :: held 2.483s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:01:57 devstack sudo[90737]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-80a4a229-1fb9-42f4-9d7f-1695eb83e45a tempest-CreateVolumesFromSnapshotTest-222009090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b6c608bb-43c0-45f8-ad9a-ec930e88a3b6 1073741824" returned: 0 in 0.532s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-80a4a229-1fb9-42f4-9d7f-1695eb83e45a tempest-CreateVolumesFromSnapshotTest-222009090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b6c608bb-43c0-45f8-ad9a-ec930e88a3b6 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:57 devstack sudo[90742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b6c608bb-43c0-45f8-ad9a-ec930e88a3b6
Apr 15 16:01:57 devstack sudo[90742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:57 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-0bd618cc-7b73-488c-be72-f011da99daed tempest-VolumeDependencyTests-972921078 None] Acquiring lock "cinder-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:01:57 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-0bd618cc-7b73-488c-be72-f011da99daed tempest-VolumeDependencyTests-972921078 None] Lock "cinder-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:01:57 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-0bd618cc-7b73-488c-be72-f011da99daed tempest-VolumeDependencyTests-972921078 None] Acquiring lock "cinder-quobyte-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:01:57 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-0bd618cc-7b73-488c-be72-f011da99daed tempest-VolumeDependencyTests-972921078 None] Lock "cinder-quobyte-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e" acquired by "delete_volume" :: waited 0.008s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:01:57 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe511f5-ad50-408b-8425-dfa11e1d557c]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:01:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-0bd618cc-7b73-488c-be72-f011da99daed tempest-VolumeDependencyTests-972921078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:57 devstack sudo[90745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e
Apr 15 16:01:57 devstack sudo[90745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:57 devstack sudo[90742]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-80a4a229-1fb9-42f4-9d7f-1695eb83e45a tempest-CreateVolumesFromSnapshotTest-222009090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b6c608bb-43c0-45f8-ad9a-ec930e88a3b6" returned: 0 in 0.418s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:57 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-80a4a229-1fb9-42f4-9d7f-1695eb83e45a tempest-CreateVolumesFromSnapshotTest-222009090 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:01:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-80a4a229-1fb9-42f4-9d7f-1695eb83e45a tempest-CreateVolumesFromSnapshotTest-222009090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:01:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7dfb2081-9e8d-48ca-9653-12012060cef0 tempest-CreateVolumesFromSnapshotTest-222009090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.423s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:01:57 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-7dfb2081-9e8d-48ca-9653-12012060cef0 tempest-CreateVolumesFromSnapshotTest-222009090 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:01:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2013587681',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61635517-1d4b-411c-b2f1-4645122e80d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7443389655b74f149df0a24eb30d8dc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:01:51Z,use_quota=True,user_id='652d06f55c70440e9cb36b14ad2e5e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:01:57 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-7dfb2081-9e8d-48ca-9653-12012060cef0 tempest-CreateVolumesFromSnapshotTest-222009090 None] Creating volume 61635517-1d4b-411c-b2f1-4645122e80d3 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:01:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7dfb2081-9e8d-48ca-9653-12012060cef0 tempest-CreateVolumesFromSnapshotTest-222009090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:01:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7dfb2081-9e8d-48ca-9653-12012060cef0 tempest-CreateVolumesFromSnapshotTest-222009090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:01:57 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-7dfb2081-9e8d-48ca-9653-12012060cef0 tempest-CreateVolumesFromSnapshotTest-222009090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:01:57 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-7dfb2081-9e8d-48ca-9653-12012060cef0 tempest-CreateVolumesFromSnapshotTest-222009090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:01:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7dfb2081-9e8d-48ca-9653-12012060cef0 tempest-CreateVolumesFromSnapshotTest-222009090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:01:57 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-7dfb2081-9e8d-48ca-9653-12012060cef0 tempest-CreateVolumesFromSnapshotTest-222009090 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:01:57 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-7dfb2081-9e8d-48ca-9653-12012060cef0 tempest-CreateVolumesFromSnapshotTest-222009090 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 16:01:57 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7dfb2081-9e8d-48ca-9653-12012060cef0 tempest-CreateVolumesFromSnapshotTest-222009090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-61635517-1d4b-411c-b2f1-4645122e80d3 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:57 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-80a4a229-1fb9-42f4-9d7f-1695eb83e45a tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81ad5162-37f5-4206-b0fe-1d4ac50ae7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6c608bb-43c0-45f8-ad9a-ec930e88a3b6', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:57 devstack sudo[90747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-61635517-1d4b-411c-b2f1-4645122e80d3 1073741824
Apr 15 16:01:57 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-80a4a229-1fb9-42f4-9d7f-1695eb83e45a tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9e7956c-a652-4fb4-8087-76190618317a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:57 devstack sudo[90747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:57 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-80a4a229-1fb9-42f4-9d7f-1695eb83e45a tempest-CreateVolumesFromSnapshotTest-222009090 None] Volume volume-b6c608bb-43c0-45f8-ad9a-ec930e88a3b6 (b6c608bb-43c0-45f8-ad9a-ec930e88a3b6): created successfully
Apr 15 16:01:57 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-80a4a229-1fb9-42f4-9d7f-1695eb83e45a tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9e7956c-a652-4fb4-8087-76190618317a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:57 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-80a4a229-1fb9-42f4-9d7f-1695eb83e45a tempest-CreateVolumesFromSnapshotTest-222009090 None] Flow 'volume_create_manager' (d02f85bb-2a30-44c0-a520-376272569eb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:01:57 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-80a4a229-1fb9-42f4-9d7f-1695eb83e45a tempest-CreateVolumesFromSnapshotTest-222009090 None] Created volume successfully.
Apr 15 16:01:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-ef7dbe7d-cda8-499f-82e8-bb6ac9349076 tempest-SnapshotDependencyTests-1453928896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:01:58 devstack sudo[90745]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-0bd618cc-7b73-488c-be72-f011da99daed tempest-VolumeDependencyTests-972921078 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e" returned: 0 in 0.556s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-0bd618cc-7b73-488c-be72-f011da99daed tempest-VolumeDependencyTests-972921078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:58 devstack sudo[90755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e
Apr 15 16:01:58 devstack sudo[90755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:58 devstack sudo[90747]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7dfb2081-9e8d-48ca-9653-12012060cef0 tempest-CreateVolumesFromSnapshotTest-222009090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-61635517-1d4b-411c-b2f1-4645122e80d3 1073741824" returned: 0 in 0.543s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7dfb2081-9e8d-48ca-9653-12012060cef0 tempest-CreateVolumesFromSnapshotTest-222009090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-61635517-1d4b-411c-b2f1-4645122e80d3 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:58 devstack sudo[90757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-61635517-1d4b-411c-b2f1-4645122e80d3
Apr 15 16:01:58 devstack sudo[90757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:58 devstack sudo[90755]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-0bd618cc-7b73-488c-be72-f011da99daed tempest-VolumeDependencyTests-972921078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e" returned: 0 in 0.418s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:58 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-0bd618cc-7b73-488c-be72-f011da99daed tempest-VolumeDependencyTests-972921078 None] Lock "cinder-quobyte-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e" released by "delete_volume" :: held 1.005s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:01:58 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-0bd618cc-7b73-488c-be72-f011da99daed tempest-VolumeDependencyTests-972921078 None] Created reservations ['73db52c4-21ed-46d6-9e52-2b5012dbc152', '10661e19-b716-4cd5-af42-7fff39dd0b62', '0297cb51-98b8-424d-8157-404189d7b5ce', '88be5c78-eeda-4518-bf68-21792e0fa597'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:01:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-0bd618cc-7b73-488c-be72-f011da99daed tempest-VolumeDependencyTests-972921078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:01:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-0bd618cc-7b73-488c-be72-f011da99daed tempest-VolumeDependencyTests-972921078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:01:58 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-0bd618cc-7b73-488c-be72-f011da99daed tempest-VolumeDependencyTests-972921078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:01:58 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-0bd618cc-7b73-488c-be72-f011da99daed tempest-VolumeDependencyTests-972921078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:01:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-0bd618cc-7b73-488c-be72-f011da99daed tempest-VolumeDependencyTests-972921078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:01:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-0bd618cc-7b73-488c-be72-f011da99daed tempest-VolumeDependencyTests-972921078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:58 devstack sudo[90761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 16:01:58 devstack sudo[90761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:58 devstack sudo[90757]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-7dfb2081-9e8d-48ca-9653-12012060cef0 tempest-CreateVolumesFromSnapshotTest-222009090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-61635517-1d4b-411c-b2f1-4645122e80d3" returned: 0 in 0.429s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:58 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-7dfb2081-9e8d-48ca-9653-12012060cef0 tempest-CreateVolumesFromSnapshotTest-222009090 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:01:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-7dfb2081-9e8d-48ca-9653-12012060cef0 tempest-CreateVolumesFromSnapshotTest-222009090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:01:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-e34205aa-114a-4867-96ed-cdc10496ec2e tempest-CreateVolumesFromSnapshotTest-222009090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.472s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:01:58 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-e34205aa-114a-4867-96ed-cdc10496ec2e tempest-CreateVolumesFromSnapshotTest-222009090 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:01:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1906018701',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29de8072-d0df-4332-ae03-dff4920e71b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7443389655b74f149df0a24eb30d8dc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:01:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:01:52Z,use_quota=True,user_id='652d06f55c70440e9cb36b14ad2e5e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:01:58 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-e34205aa-114a-4867-96ed-cdc10496ec2e tempest-CreateVolumesFromSnapshotTest-222009090 None] Creating volume 29de8072-d0df-4332-ae03-dff4920e71b4 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:01:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-e34205aa-114a-4867-96ed-cdc10496ec2e tempest-CreateVolumesFromSnapshotTest-222009090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:01:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-e34205aa-114a-4867-96ed-cdc10496ec2e tempest-CreateVolumesFromSnapshotTest-222009090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:01:58 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-e34205aa-114a-4867-96ed-cdc10496ec2e tempest-CreateVolumesFromSnapshotTest-222009090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:01:58 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-e34205aa-114a-4867-96ed-cdc10496ec2e tempest-CreateVolumesFromSnapshotTest-222009090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:01:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-e34205aa-114a-4867-96ed-cdc10496ec2e tempest-CreateVolumesFromSnapshotTest-222009090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:01:58 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-e34205aa-114a-4867-96ed-cdc10496ec2e tempest-CreateVolumesFromSnapshotTest-222009090 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:01:58 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-e34205aa-114a-4867-96ed-cdc10496ec2e tempest-CreateVolumesFromSnapshotTest-222009090 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 16:01:58 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-e34205aa-114a-4867-96ed-cdc10496ec2e tempest-CreateVolumesFromSnapshotTest-222009090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-29de8072-d0df-4332-ae03-dff4920e71b4 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:58 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7dfb2081-9e8d-48ca-9653-12012060cef0 tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e658e2c-6b7f-489d-961e-6516df52cfdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61635517-1d4b-411c-b2f1-4645122e80d3', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:58 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7dfb2081-9e8d-48ca-9653-12012060cef0 tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0350b8a-9343-4e54-94ef-3633a51d1d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:58 devstack sudo[90763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-29de8072-d0df-4332-ae03-dff4920e71b4 1073741824
Apr 15 16:01:58 devstack sudo[90763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:58 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-7dfb2081-9e8d-48ca-9653-12012060cef0 tempest-CreateVolumesFromSnapshotTest-222009090 None] Volume volume-61635517-1d4b-411c-b2f1-4645122e80d3 (61635517-1d4b-411c-b2f1-4645122e80d3): created successfully
Apr 15 16:01:58 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7dfb2081-9e8d-48ca-9653-12012060cef0 tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0350b8a-9343-4e54-94ef-3633a51d1d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:58 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-7dfb2081-9e8d-48ca-9653-12012060cef0 tempest-CreateVolumesFromSnapshotTest-222009090 None] Flow 'volume_create_manager' (3c876375-6b95-4c0b-ace7-2881481bb465) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:01:58 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-7dfb2081-9e8d-48ca-9653-12012060cef0 tempest-CreateVolumesFromSnapshotTest-222009090 None] Created volume successfully.
Apr 15 16:01:59 devstack sudo[90761]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:59 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-0bd618cc-7b73-488c-be72-f011da99daed tempest-VolumeDependencyTests-972921078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.436s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:59 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-0bd618cc-7b73-488c-be72-f011da99daed tempest-VolumeDependencyTests-972921078 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:01:59 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-0bd618cc-7b73-488c-be72-f011da99daed tempest-VolumeDependencyTests-972921078 None] Deleted volume successfully.
Apr 15 16:01:59 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-0bd618cc-7b73-488c-be72-f011da99daed tempest-VolumeDependencyTests-972921078 None] Lock "cinder-6e3322b6-7b1d-41dd-8a34-4c6cd5887a9e-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:01:59 devstack sudo[90763]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:59 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-e34205aa-114a-4867-96ed-cdc10496ec2e tempest-CreateVolumesFromSnapshotTest-222009090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-29de8072-d0df-4332-ae03-dff4920e71b4 1073741824" returned: 0 in 0.530s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:59 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-e34205aa-114a-4867-96ed-cdc10496ec2e tempest-CreateVolumesFromSnapshotTest-222009090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-29de8072-d0df-4332-ae03-dff4920e71b4 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:59 devstack sudo[90769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-29de8072-d0df-4332-ae03-dff4920e71b4
Apr 15 16:01:59 devstack sudo[90769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:59 devstack sudo[90769]: pam_unix(sudo:session): session closed for user root
Apr 15 16:01:59 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-e34205aa-114a-4867-96ed-cdc10496ec2e tempest-CreateVolumesFromSnapshotTest-222009090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-29de8072-d0df-4332-ae03-dff4920e71b4" returned: 0 in 0.416s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:01:59 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-e34205aa-114a-4867-96ed-cdc10496ec2e tempest-CreateVolumesFromSnapshotTest-222009090 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:01:59 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-e34205aa-114a-4867-96ed-cdc10496ec2e tempest-CreateVolumesFromSnapshotTest-222009090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:01:59 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-fe7ee5e0-3125-4980-86d2-260cfae5b0b0 tempest-CinderUnicodeTest-847668735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.869s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:01:59 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-fe7ee5e0-3125-4980-86d2-260cfae5b0b0 tempest-CinderUnicodeTest-847668735 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:01:56Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=576aa65e-0d77-4e02-aa72-296dc1d2ee51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b900ac42f89143c2ba33d175c02dffc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:01:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:01:56Z,use_quota=True,user_id='8dd2f079373e480bb4d516ea5eb1f3e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:01:59 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-fe7ee5e0-3125-4980-86d2-260cfae5b0b0 tempest-CinderUnicodeTest-847668735 None] Creating volume 576aa65e-0d77-4e02-aa72-296dc1d2ee51 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:01:59 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-fe7ee5e0-3125-4980-86d2-260cfae5b0b0 tempest-CinderUnicodeTest-847668735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:01:59 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-fe7ee5e0-3125-4980-86d2-260cfae5b0b0 tempest-CinderUnicodeTest-847668735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:01:59 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-fe7ee5e0-3125-4980-86d2-260cfae5b0b0 tempest-CinderUnicodeTest-847668735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:01:59 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-fe7ee5e0-3125-4980-86d2-260cfae5b0b0 tempest-CinderUnicodeTest-847668735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:01:59 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-fe7ee5e0-3125-4980-86d2-260cfae5b0b0 tempest-CinderUnicodeTest-847668735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:01:59 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-fe7ee5e0-3125-4980-86d2-260cfae5b0b0 tempest-CinderUnicodeTest-847668735 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:01:59 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-fe7ee5e0-3125-4980-86d2-260cfae5b0b0 tempest-CinderUnicodeTest-847668735 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 16:01:59 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-fe7ee5e0-3125-4980-86d2-260cfae5b0b0 tempest-CinderUnicodeTest-847668735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-576aa65e-0d77-4e02-aa72-296dc1d2ee51 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:01:59 devstack sudo[90772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-576aa65e-0d77-4e02-aa72-296dc1d2ee51 1073741824
Apr 15 16:01:59 devstack sudo[90772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:01:59 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-e34205aa-114a-4867-96ed-cdc10496ec2e tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76e7ec62-f978-4eb2-9efb-2e2d68958290) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29de8072-d0df-4332-ae03-dff4920e71b4', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:59 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-e34205aa-114a-4867-96ed-cdc10496ec2e tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a78d8cb8-e2b7-4727-98bb-76acd7f3f2a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:01:59 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-e34205aa-114a-4867-96ed-cdc10496ec2e tempest-CreateVolumesFromSnapshotTest-222009090 None] Volume volume-29de8072-d0df-4332-ae03-dff4920e71b4 (29de8072-d0df-4332-ae03-dff4920e71b4): created successfully
Apr 15 16:01:59 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-e34205aa-114a-4867-96ed-cdc10496ec2e tempest-CreateVolumesFromSnapshotTest-222009090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a78d8cb8-e2b7-4727-98bb-76acd7f3f2a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:01:59 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-e34205aa-114a-4867-96ed-cdc10496ec2e tempest-CreateVolumesFromSnapshotTest-222009090 None] Flow 'volume_create_manager' (00d02942-bc31-4286-b2f8-3633e6ba49dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:01:59 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-e34205aa-114a-4867-96ed-cdc10496ec2e tempest-CreateVolumesFromSnapshotTest-222009090 None] Created volume successfully.
Apr 15 16:02:00 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef74bdf9-8767-4ded-9468-045cc07d02c2 tempest-VolumeDependencyTests-972921078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:02:00 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-ef74bdf9-8767-4ded-9468-045cc07d02c2 tempest-VolumeDependencyTests-972921078 None] Flow 'volume_create_manager' (43c0e6ec-8fb0-4434-9ac5-49a7684a8fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:02:00 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-ef74bdf9-8767-4ded-9468-045cc07d02c2 tempest-VolumeDependencyTests-972921078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (341566f5-c607-4561-950f-473aae8817fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:02:00 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-ef74bdf9-8767-4ded-9468-045cc07d02c2 tempest-VolumeDependencyTests-972921078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (341566f5-c607-4561-950f-473aae8817fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:02:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-45407630',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fd72c08-55c0-4f3e-98c6-35050d1f56f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d363d48ee3e40b5a9f7d410914be77e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:02:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:02:00Z,use_quota=True,user_id='da5723df3b9d48f09a9929ddb60988ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:02:00 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-ef74bdf9-8767-4ded-9468-045cc07d02c2 tempest-VolumeDependencyTests-972921078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9bf6bda-877a-46ec-82b3-92a4f1211bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:02:00 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-ef74bdf9-8767-4ded-9468-045cc07d02c2 tempest-VolumeDependencyTests-972921078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9bf6bda-877a-46ec-82b3-92a4f1211bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:02:00 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-ef74bdf9-8767-4ded-9468-045cc07d02c2 tempest-VolumeDependencyTests-972921078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbce449c-b1f4-4d88-98a9-76a52ec34699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:02:00 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-ef74bdf9-8767-4ded-9468-045cc07d02c2 tempest-VolumeDependencyTests-972921078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbce449c-b1f4-4d88-98a9-76a52ec34699) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fd72c08-55c0-4f3e-98c6-35050d1f56f2', 'volume_name': 'volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:02:00 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-ef74bdf9-8767-4ded-9468-045cc07d02c2 tempest-VolumeDependencyTests-972921078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af2b880e-c41e-4558-8cb2-8a09bfd57233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:02:00 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-ef74bdf9-8767-4ded-9468-045cc07d02c2 tempest-VolumeDependencyTests-972921078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af2b880e-c41e-4558-8cb2-8a09bfd57233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:02:00 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-ef74bdf9-8767-4ded-9468-045cc07d02c2 tempest-VolumeDependencyTests-972921078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0228455-78db-4fb7-b63c-98837d42b039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:02:00 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-ef74bdf9-8767-4ded-9468-045cc07d02c2 tempest-VolumeDependencyTests-972921078 None] Volume 1fd72c08-55c0-4f3e-98c6-35050d1f56f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2', 'volume_size': 1}
Apr 15 16:02:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-ef74bdf9-8767-4ded-9468-045cc07d02c2 tempest-VolumeDependencyTests-972921078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:02:00 devstack sudo[90772]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-fe7ee5e0-3125-4980-86d2-260cfae5b0b0 tempest-CinderUnicodeTest-847668735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-576aa65e-0d77-4e02-aa72-296dc1d2ee51 1073741824" returned: 0 in 0.520s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:00 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-66bcb389-d6a6-456e-a8db-5669ef317aec tempest-CreateVolumesFromSnapshotTest-222009090 None] Acquiring lock "cinder-29de8072-d0df-4332-ae03-dff4920e71b4-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:02:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-fe7ee5e0-3125-4980-86d2-260cfae5b0b0 tempest-CinderUnicodeTest-847668735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-576aa65e-0d77-4e02-aa72-296dc1d2ee51 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:00 devstack sudo[90777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-576aa65e-0d77-4e02-aa72-296dc1d2ee51
Apr 15 16:02:00 devstack sudo[90777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:00 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-66bcb389-d6a6-456e-a8db-5669ef317aec tempest-CreateVolumesFromSnapshotTest-222009090 None] Lock "cinder-29de8072-d0df-4332-ae03-dff4920e71b4-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:02:00 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-66bcb389-d6a6-456e-a8db-5669ef317aec tempest-CreateVolumesFromSnapshotTest-222009090 None] Acquiring lock "cinder-quobyte-29de8072-d0df-4332-ae03-dff4920e71b4" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:02:00 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-66bcb389-d6a6-456e-a8db-5669ef317aec tempest-CreateVolumesFromSnapshotTest-222009090 None] Lock "cinder-quobyte-29de8072-d0df-4332-ae03-dff4920e71b4" acquired by "delete_volume" :: waited 0.008s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:02:00 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[07297c6a-105e-4207-8b4d-6125d99e0976]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:02:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-66bcb389-d6a6-456e-a8db-5669ef317aec tempest-CreateVolumesFromSnapshotTest-222009090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-29de8072-d0df-4332-ae03-dff4920e71b4 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:00 devstack sudo[90779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-29de8072-d0df-4332-ae03-dff4920e71b4
Apr 15 16:02:00 devstack sudo[90779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:00 devstack sudo[90777]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-fe7ee5e0-3125-4980-86d2-260cfae5b0b0 tempest-CinderUnicodeTest-847668735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-576aa65e-0d77-4e02-aa72-296dc1d2ee51" returned: 0 in 0.431s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:00 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-fe7ee5e0-3125-4980-86d2-260cfae5b0b0 tempest-CinderUnicodeTest-847668735 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:02:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-fe7ee5e0-3125-4980-86d2-260cfae5b0b0 tempest-CinderUnicodeTest-847668735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:02:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-ef7dbe7d-cda8-499f-82e8-bb6ac9349076 tempest-SnapshotDependencyTests-1453928896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.694s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:02:00 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-fe7ee5e0-3125-4980-86d2-260cfae5b0b0 tempest-CinderUnicodeTest-847668735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d54d6722-dade-4bb9-95f0-d982723419d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-576aa65e-0d77-4e02-aa72-296dc1d2ee51', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:02:00 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-fe7ee5e0-3125-4980-86d2-260cfae5b0b0 tempest-CinderUnicodeTest-847668735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3135ae85-fbf3-42c9-b136-0b9409c9d7be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:02:00 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-ef7dbe7d-cda8-499f-82e8-bb6ac9349076 tempest-SnapshotDependencyTests-1453928896 None] Creating offline snapshot 2dfd2666-ca62-4b45-a47d-8839553dfcb9 of volume b5a8607c-3448-4293-adc7-adaa566ffcce {{(pid=82485) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 16:02:00 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-fe7ee5e0-3125-4980-86d2-260cfae5b0b0 tempest-CinderUnicodeTest-847668735 None] Volume volume-576aa65e-0d77-4e02-aa72-296dc1d2ee51 (576aa65e-0d77-4e02-aa72-296dc1d2ee51): created successfully
Apr 15 16:02:00 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-fe7ee5e0-3125-4980-86d2-260cfae5b0b0 tempest-CinderUnicodeTest-847668735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3135ae85-fbf3-42c9-b136-0b9409c9d7be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:02:00 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-fe7ee5e0-3125-4980-86d2-260cfae5b0b0 tempest-CinderUnicodeTest-847668735 None] Flow 'volume_create_manager' (17f24fa9-5bc4-403e-ba92-cdd2174bb969) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:02:00 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6005d60-efa5-44a5-be93-95fca406ec2b]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:02:00 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ef7dbe7d-cda8-499f-82e8-bb6ac9349076 tempest-SnapshotDependencyTests-1453928896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b5a8607c-3448-4293-adc7-adaa566ffcce {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:00 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-fe7ee5e0-3125-4980-86d2-260cfae5b0b0 tempest-CinderUnicodeTest-847668735 None] Created volume successfully.
Apr 15 16:02:01 devstack sudo[90784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b5a8607c-3448-4293-adc7-adaa566ffcce
Apr 15 16:02:01 devstack sudo[90784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:01 devstack sudo[90779]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:01 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-66bcb389-d6a6-456e-a8db-5669ef317aec tempest-CreateVolumesFromSnapshotTest-222009090 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-29de8072-d0df-4332-ae03-dff4920e71b4" returned: 0 in 0.519s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:01 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-66bcb389-d6a6-456e-a8db-5669ef317aec tempest-CreateVolumesFromSnapshotTest-222009090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-29de8072-d0df-4332-ae03-dff4920e71b4 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:01 devstack sudo[90787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-29de8072-d0df-4332-ae03-dff4920e71b4
Apr 15 16:02:01 devstack sudo[90787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:01 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-75674803-f3d1-4127-b615-e249b7a97457 tempest-CinderUnicodeTest-847668735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:02:01 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-75674803-f3d1-4127-b615-e249b7a97457 tempest-CinderUnicodeTest-847668735 None] Flow 'volume_create_manager' (4602440f-b0b9-4b64-914f-3c1edcaf57da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:02:01 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-75674803-f3d1-4127-b615-e249b7a97457 tempest-CinderUnicodeTest-847668735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bc9f591-7e0a-4037-ac75-c1c41c0717f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:02:01 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-75674803-f3d1-4127-b615-e249b7a97457 tempest-CinderUnicodeTest-847668735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bc9f591-7e0a-4037-ac75-c1c41c0717f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:02:01Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-189330619',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18620bde-da65-4deb-823c-625134fcc6e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b900ac42f89143c2ba33d175c02dffc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:02:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:02:01Z,use_quota=True,user_id='8dd2f079373e480bb4d516ea5eb1f3e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:02:01 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-75674803-f3d1-4127-b615-e249b7a97457 tempest-CinderUnicodeTest-847668735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b46994d8-a5c1-4ba5-9611-c24e431273e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:02:01 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-75674803-f3d1-4127-b615-e249b7a97457 tempest-CinderUnicodeTest-847668735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b46994d8-a5c1-4ba5-9611-c24e431273e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:02:01 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-75674803-f3d1-4127-b615-e249b7a97457 tempest-CinderUnicodeTest-847668735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5dd3165-dafe-4fbb-a2db-87141c5797de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:02:01 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-75674803-f3d1-4127-b615-e249b7a97457 tempest-CinderUnicodeTest-847668735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5dd3165-dafe-4fbb-a2db-87141c5797de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18620bde-da65-4deb-823c-625134fcc6e4', 'volume_name': 'volume-18620bde-da65-4deb-823c-625134fcc6e4', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:02:01 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-75674803-f3d1-4127-b615-e249b7a97457 tempest-CinderUnicodeTest-847668735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19cb3c1a-edef-4752-9a45-8d5173cd1940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:02:01 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-75674803-f3d1-4127-b615-e249b7a97457 tempest-CinderUnicodeTest-847668735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19cb3c1a-edef-4752-9a45-8d5173cd1940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:02:01 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-75674803-f3d1-4127-b615-e249b7a97457 tempest-CinderUnicodeTest-847668735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4580651c-2d9b-4085-bec6-d109bc21241a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:02:01 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-75674803-f3d1-4127-b615-e249b7a97457 tempest-CinderUnicodeTest-847668735 None] Volume 18620bde-da65-4deb-823c-625134fcc6e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18620bde-da65-4deb-823c-625134fcc6e4', 'volume_size': 1}
Apr 15 16:02:01 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-75674803-f3d1-4127-b615-e249b7a97457 tempest-CinderUnicodeTest-847668735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:02:01 devstack sudo[90784]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:01 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ef7dbe7d-cda8-499f-82e8-bb6ac9349076 tempest-SnapshotDependencyTests-1453928896 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b5a8607c-3448-4293-adc7-adaa566ffcce" returned: 0 in 0.552s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:01 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ef7dbe7d-cda8-499f-82e8-bb6ac9349076 tempest-SnapshotDependencyTests-1453928896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b5a8607c-3448-4293-adc7-adaa566ffcce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b5a8607c-3448-4293-adc7-adaa566ffcce.2dfd2666-ca62-4b45-a47d-8839553dfcb9 1G {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:01 devstack sudo[90793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b5a8607c-3448-4293-adc7-adaa566ffcce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b5a8607c-3448-4293-adc7-adaa566ffcce.2dfd2666-ca62-4b45-a47d-8839553dfcb9 1G
Apr 15 16:02:01 devstack sudo[90793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:01 devstack sudo[90787]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:01 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-66bcb389-d6a6-456e-a8db-5669ef317aec tempest-CreateVolumesFromSnapshotTest-222009090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-29de8072-d0df-4332-ae03-dff4920e71b4" returned: 0 in 0.499s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:01 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-66bcb389-d6a6-456e-a8db-5669ef317aec tempest-CreateVolumesFromSnapshotTest-222009090 None] Lock "cinder-quobyte-29de8072-d0df-4332-ae03-dff4920e71b4" released by "delete_volume" :: held 1.041s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:02:01 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-66bcb389-d6a6-456e-a8db-5669ef317aec tempest-CreateVolumesFromSnapshotTest-222009090 None] Created reservations ['608fc4fa-f17a-49e7-a13c-9c51dc2317e6', '0b9546ba-4bf6-472d-8fbe-0fb9ae467c2f', '4c99c7e1-7d5b-453a-aec4-b7bf08b98e46', '6e634920-589f-4feb-8e1e-b4cca283554b'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:02:01 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-66bcb389-d6a6-456e-a8db-5669ef317aec tempest-CreateVolumesFromSnapshotTest-222009090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:02:01 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-66bcb389-d6a6-456e-a8db-5669ef317aec tempest-CreateVolumesFromSnapshotTest-222009090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:02:01 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-66bcb389-d6a6-456e-a8db-5669ef317aec tempest-CreateVolumesFromSnapshotTest-222009090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:02:01 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-66bcb389-d6a6-456e-a8db-5669ef317aec tempest-CreateVolumesFromSnapshotTest-222009090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:02:01 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-66bcb389-d6a6-456e-a8db-5669ef317aec tempest-CreateVolumesFromSnapshotTest-222009090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:02:01 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-66bcb389-d6a6-456e-a8db-5669ef317aec tempest-CreateVolumesFromSnapshotTest-222009090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:01 devstack sudo[90795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 16:02:01 devstack sudo[90795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:02 devstack sudo[90793]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:02 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ef7dbe7d-cda8-499f-82e8-bb6ac9349076 tempest-SnapshotDependencyTests-1453928896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b5a8607c-3448-4293-adc7-adaa566ffcce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b5a8607c-3448-4293-adc7-adaa566ffcce.2dfd2666-ca62-4b45-a47d-8839553dfcb9 1G" returned: 0 in 0.513s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:02 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ef7dbe7d-cda8-499f-82e8-bb6ac9349076 tempest-SnapshotDependencyTests-1453928896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5a8607c-3448-4293-adc7-adaa566ffcce -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b5a8607c-3448-4293-adc7-adaa566ffcce.2dfd2666-ca62-4b45-a47d-8839553dfcb9 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:02 devstack sudo[90801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5a8607c-3448-4293-adc7-adaa566ffcce -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b5a8607c-3448-4293-adc7-adaa566ffcce.2dfd2666-ca62-4b45-a47d-8839553dfcb9
Apr 15 16:02:02 devstack sudo[90801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:02 devstack sudo[90795]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:02 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-66bcb389-d6a6-456e-a8db-5669ef317aec tempest-CreateVolumesFromSnapshotTest-222009090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.453s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:02 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-66bcb389-d6a6-456e-a8db-5669ef317aec tempest-CreateVolumesFromSnapshotTest-222009090 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:02:02 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-66bcb389-d6a6-456e-a8db-5669ef317aec tempest-CreateVolumesFromSnapshotTest-222009090 None] Deleted volume successfully.
Apr 15 16:02:02 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-66bcb389-d6a6-456e-a8db-5669ef317aec tempest-CreateVolumesFromSnapshotTest-222009090 None] Lock "cinder-29de8072-d0df-4332-ae03-dff4920e71b4-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:02:02 devstack sudo[90801]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:02 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ef7dbe7d-cda8-499f-82e8-bb6ac9349076 tempest-SnapshotDependencyTests-1453928896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5a8607c-3448-4293-adc7-adaa566ffcce -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b5a8607c-3448-4293-adc7-adaa566ffcce.2dfd2666-ca62-4b45-a47d-8839553dfcb9" returned: 0 in 0.496s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:02 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-ef7dbe7d-cda8-499f-82e8-bb6ac9349076 tempest-SnapshotDependencyTests-1453928896 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b5a8607c-3448-4293-adc7-adaa566ffcce.2dfd2666-ca62-4b45-a47d-8839553dfcb9 is being set with open permissions: ugo+rw
Apr 15 16:02:02 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ef7dbe7d-cda8-499f-82e8-bb6ac9349076 tempest-SnapshotDependencyTests-1453928896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b5a8607c-3448-4293-adc7-adaa566ffcce.2dfd2666-ca62-4b45-a47d-8839553dfcb9 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:02 devstack sudo[90806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b5a8607c-3448-4293-adc7-adaa566ffcce.2dfd2666-ca62-4b45-a47d-8839553dfcb9
Apr 15 16:02:02 devstack sudo[90806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:02 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-32bb5cb1-659e-48f7-a6da-07ed3016ae30 tempest-CreateVolumesFromSnapshotTest-222009090 None] Acquiring lock "cinder-61635517-1d4b-411c-b2f1-4645122e80d3-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:02:02 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-32bb5cb1-659e-48f7-a6da-07ed3016ae30 tempest-CreateVolumesFromSnapshotTest-222009090 None] Lock "cinder-61635517-1d4b-411c-b2f1-4645122e80d3-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:02:02 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-32bb5cb1-659e-48f7-a6da-07ed3016ae30 tempest-CreateVolumesFromSnapshotTest-222009090 None] Acquiring lock "cinder-quobyte-61635517-1d4b-411c-b2f1-4645122e80d3" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:02:02 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-32bb5cb1-659e-48f7-a6da-07ed3016ae30 tempest-CreateVolumesFromSnapshotTest-222009090 None] Lock "cinder-quobyte-61635517-1d4b-411c-b2f1-4645122e80d3" acquired by "delete_volume" :: waited 0.009s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:02:02 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[f578228f-8557-4297-9892-28b034d29b18]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:02:02 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-32bb5cb1-659e-48f7-a6da-07ed3016ae30 tempest-CreateVolumesFromSnapshotTest-222009090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-61635517-1d4b-411c-b2f1-4645122e80d3 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:02 devstack sudo[90808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-61635517-1d4b-411c-b2f1-4645122e80d3
Apr 15 16:02:02 devstack sudo[90808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:02 devstack sudo[90806]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:02 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ef7dbe7d-cda8-499f-82e8-bb6ac9349076 tempest-SnapshotDependencyTests-1453928896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b5a8607c-3448-4293-adc7-adaa566ffcce.2dfd2666-ca62-4b45-a47d-8839553dfcb9" returned: 0 in 0.450s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:03 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ef7dbe7d-cda8-499f-82e8-bb6ac9349076 tempest-SnapshotDependencyTests-1453928896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b5a8607c-3448-4293-adc7-adaa566ffcce.info {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:03 devstack sudo[90811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b5a8607c-3448-4293-adc7-adaa566ffcce.info
Apr 15 16:02:03 devstack sudo[90811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:03 devstack sudo[90808]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:03 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-32bb5cb1-659e-48f7-a6da-07ed3016ae30 tempest-CreateVolumesFromSnapshotTest-222009090 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-61635517-1d4b-411c-b2f1-4645122e80d3" returned: 0 in 0.495s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:03 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-32bb5cb1-659e-48f7-a6da-07ed3016ae30 tempest-CreateVolumesFromSnapshotTest-222009090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-61635517-1d4b-411c-b2f1-4645122e80d3 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:03 devstack sudo[90816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-61635517-1d4b-411c-b2f1-4645122e80d3
Apr 15 16:02:03 devstack sudo[90816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:03 devstack sudo[90811]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:03 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ef7dbe7d-cda8-499f-82e8-bb6ac9349076 tempest-SnapshotDependencyTests-1453928896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b5a8607c-3448-4293-adc7-adaa566ffcce.info" returned: 0 in 0.448s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:03 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-ef7dbe7d-cda8-499f-82e8-bb6ac9349076 tempest-SnapshotDependencyTests-1453928896 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b5a8607c-3448-4293-adc7-adaa566ffcce.info is being set with open permissions: ugo+rw
Apr 15 16:02:03 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ef7dbe7d-cda8-499f-82e8-bb6ac9349076 tempest-SnapshotDependencyTests-1453928896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b5a8607c-3448-4293-adc7-adaa566ffcce.info {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:03 devstack sudo[90819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b5a8607c-3448-4293-adc7-adaa566ffcce.info
Apr 15 16:02:03 devstack sudo[90819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:03 devstack sudo[90816]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:03 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-32bb5cb1-659e-48f7-a6da-07ed3016ae30 tempest-CreateVolumesFromSnapshotTest-222009090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-61635517-1d4b-411c-b2f1-4645122e80d3" returned: 0 in 0.467s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:03 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-32bb5cb1-659e-48f7-a6da-07ed3016ae30 tempest-CreateVolumesFromSnapshotTest-222009090 None] Lock "cinder-quobyte-61635517-1d4b-411c-b2f1-4645122e80d3" released by "delete_volume" :: held 1.000s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:02:03 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-32bb5cb1-659e-48f7-a6da-07ed3016ae30 tempest-CreateVolumesFromSnapshotTest-222009090 None] Created reservations ['32ab8634-9e8e-41a5-9d5e-1af2d1956908', 'c3930d92-86d9-424d-8d54-fe08f0be949c', 'c9247eeb-5521-4f92-93a8-dbaf1811567b', '4f4b38b1-ee44-4dc9-8f1b-2066b14b376d'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:02:03 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-32bb5cb1-659e-48f7-a6da-07ed3016ae30 tempest-CreateVolumesFromSnapshotTest-222009090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:02:03 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-32bb5cb1-659e-48f7-a6da-07ed3016ae30 tempest-CreateVolumesFromSnapshotTest-222009090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:02:03 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-32bb5cb1-659e-48f7-a6da-07ed3016ae30 tempest-CreateVolumesFromSnapshotTest-222009090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:02:03 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-32bb5cb1-659e-48f7-a6da-07ed3016ae30 tempest-CreateVolumesFromSnapshotTest-222009090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:02:03 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-32bb5cb1-659e-48f7-a6da-07ed3016ae30 tempest-CreateVolumesFromSnapshotTest-222009090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:02:03 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-32bb5cb1-659e-48f7-a6da-07ed3016ae30 tempest-CreateVolumesFromSnapshotTest-222009090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:03 devstack sudo[90823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 16:02:03 devstack sudo[90823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:03 devstack sudo[90819]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:03 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ef7dbe7d-cda8-499f-82e8-bb6ac9349076 tempest-SnapshotDependencyTests-1453928896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b5a8607c-3448-4293-adc7-adaa566ffcce.info" returned: 0 in 0.432s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:03 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-ef7dbe7d-cda8-499f-82e8-bb6ac9349076 tempest-SnapshotDependencyTests-1453928896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.979s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:02:03 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-ef74bdf9-8767-4ded-9468-045cc07d02c2 tempest-VolumeDependencyTests-972921078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.661s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:02:03 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-ef74bdf9-8767-4ded-9468-045cc07d02c2 tempest-VolumeDependencyTests-972921078 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:02:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-45407630',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fd72c08-55c0-4f3e-98c6-35050d1f56f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d363d48ee3e40b5a9f7d410914be77e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:02:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:02:00Z,use_quota=True,user_id='da5723df3b9d48f09a9929ddb60988ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:02:03 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-ef74bdf9-8767-4ded-9468-045cc07d02c2 tempest-VolumeDependencyTests-972921078 None] Creating volume 1fd72c08-55c0-4f3e-98c6-35050d1f56f2 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:02:03 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-ef74bdf9-8767-4ded-9468-045cc07d02c2 tempest-VolumeDependencyTests-972921078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:02:03 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-ef74bdf9-8767-4ded-9468-045cc07d02c2 tempest-VolumeDependencyTests-972921078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:02:03 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-ef74bdf9-8767-4ded-9468-045cc07d02c2 tempest-VolumeDependencyTests-972921078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:02:03 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-ef74bdf9-8767-4ded-9468-045cc07d02c2 tempest-VolumeDependencyTests-972921078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:02:03 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-ef74bdf9-8767-4ded-9468-045cc07d02c2 tempest-VolumeDependencyTests-972921078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:02:03 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-ef74bdf9-8767-4ded-9468-045cc07d02c2 tempest-VolumeDependencyTests-972921078 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:02:03 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-ef74bdf9-8767-4ded-9468-045cc07d02c2 tempest-VolumeDependencyTests-972921078 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 16:02:03 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ef74bdf9-8767-4ded-9468-045cc07d02c2 tempest-VolumeDependencyTests-972921078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:03 devstack sudo[90825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2 1073741824
Apr 15 16:02:03 devstack sudo[90825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:03 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-ef7dbe7d-cda8-499f-82e8-bb6ac9349076 tempest-SnapshotDependencyTests-1453928896 None] Create snapshot completed successfully
Apr 15 16:02:04 devstack sudo[90823]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:04 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-32bb5cb1-659e-48f7-a6da-07ed3016ae30 tempest-CreateVolumesFromSnapshotTest-222009090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.441s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:04 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-32bb5cb1-659e-48f7-a6da-07ed3016ae30 tempest-CreateVolumesFromSnapshotTest-222009090 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:02:04 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-32bb5cb1-659e-48f7-a6da-07ed3016ae30 tempest-CreateVolumesFromSnapshotTest-222009090 None] Deleted volume successfully.
Apr 15 16:02:04 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-32bb5cb1-659e-48f7-a6da-07ed3016ae30 tempest-CreateVolumesFromSnapshotTest-222009090 None] Lock "cinder-61635517-1d4b-411c-b2f1-4645122e80d3-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:02:04 devstack sudo[90825]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:04 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ef74bdf9-8767-4ded-9468-045cc07d02c2 tempest-VolumeDependencyTests-972921078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2 1073741824" returned: 0 in 0.559s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:04 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ef74bdf9-8767-4ded-9468-045cc07d02c2 tempest-VolumeDependencyTests-972921078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:04 devstack sudo[90833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2
Apr 15 16:02:04 devstack sudo[90833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:04 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbdfbbf4-6b12-4bac-a308-9672bea04801 tempest-SnapshotDependencyTests-1453928896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:02:04 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-bbdfbbf4-6b12-4bac-a308-9672bea04801 tempest-SnapshotDependencyTests-1453928896 None] Flow 'volume_create_manager' (6d885326-cd73-4c9e-b79a-90823863884a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:02:04 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-bbdfbbf4-6b12-4bac-a308-9672bea04801 tempest-SnapshotDependencyTests-1453928896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9f7b3b6-414e-4a30-b2c6-f5c7dfc892a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:02:04 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-bbdfbbf4-6b12-4bac-a308-9672bea04801 tempest-SnapshotDependencyTests-1453928896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9f7b3b6-414e-4a30-b2c6-f5c7dfc892a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:02:05Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95158fed-708d-4e9f-bae2-c7e28c13e16f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bd3271b80bf4b4f9219cc20fe9d7b4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:02:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2dfd2666-ca62-4b45-a47d-8839553dfcb9,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:02:05Z,use_quota=True,user_id='ee9dffb1b3e84afc9410ccacd756ce68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:02:04 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-bbdfbbf4-6b12-4bac-a308-9672bea04801 tempest-SnapshotDependencyTests-1453928896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce8fca49-6a0b-496a-8721-247bc733af93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:02:04 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-bbdfbbf4-6b12-4bac-a308-9672bea04801 tempest-SnapshotDependencyTests-1453928896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce8fca49-6a0b-496a-8721-247bc733af93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:02:04 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-bbdfbbf4-6b12-4bac-a308-9672bea04801 tempest-SnapshotDependencyTests-1453928896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a40c35e5-36ed-4d20-9414-6225de067186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:02:04 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-bbdfbbf4-6b12-4bac-a308-9672bea04801 tempest-SnapshotDependencyTests-1453928896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a40c35e5-36ed-4d20-9414-6225de067186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '95158fed-708d-4e9f-bae2-c7e28c13e16f', 'volume_name': 'volume-95158fed-708d-4e9f-bae2-c7e28c13e16f', 'volume_size': 1, 'snapshot_id': '2dfd2666-ca62-4b45-a47d-8839553dfcb9'}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:02:04 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-bbdfbbf4-6b12-4bac-a308-9672bea04801 tempest-SnapshotDependencyTests-1453928896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (736c7a25-ff20-4e00-b5fc-78150e0240c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:02:04 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-bbdfbbf4-6b12-4bac-a308-9672bea04801 tempest-SnapshotDependencyTests-1453928896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (736c7a25-ff20-4e00-b5fc-78150e0240c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:02:04 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-bbdfbbf4-6b12-4bac-a308-9672bea04801 tempest-SnapshotDependencyTests-1453928896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a33b7ee-61cd-4f0c-906b-ad2def23b192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:02:04 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-bbdfbbf4-6b12-4bac-a308-9672bea04801 tempest-SnapshotDependencyTests-1453928896 None] Volume 95158fed-708d-4e9f-bae2-c7e28c13e16f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-95158fed-708d-4e9f-bae2-c7e28c13e16f', 'volume_size': 1, 'snapshot_id': '2dfd2666-ca62-4b45-a47d-8839553dfcb9'}
Apr 15 16:02:04 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-d3add8d6-4eba-47d7-9cb9-116aca3eed5b tempest-CreateVolumesFromSnapshotTest-222009090 None] Acquiring lock "cinder-b6c608bb-43c0-45f8-ad9a-ec930e88a3b6-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:02:04 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-bbdfbbf4-6b12-4bac-a308-9672bea04801 tempest-SnapshotDependencyTests-1453928896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:02:04 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-d3add8d6-4eba-47d7-9cb9-116aca3eed5b tempest-CreateVolumesFromSnapshotTest-222009090 None] Lock "cinder-b6c608bb-43c0-45f8-ad9a-ec930e88a3b6-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:02:04 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-d3add8d6-4eba-47d7-9cb9-116aca3eed5b tempest-CreateVolumesFromSnapshotTest-222009090 None] Acquiring lock "cinder-quobyte-b6c608bb-43c0-45f8-ad9a-ec930e88a3b6" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:02:04 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-d3add8d6-4eba-47d7-9cb9-116aca3eed5b tempest-CreateVolumesFromSnapshotTest-222009090 None] Lock "cinder-quobyte-b6c608bb-43c0-45f8-ad9a-ec930e88a3b6" acquired by "delete_volume" :: waited 0.010s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:02:04 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a3ab7a-6d2d-4f67-952e-33031337670e]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:02:04 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-d3add8d6-4eba-47d7-9cb9-116aca3eed5b tempest-CreateVolumesFromSnapshotTest-222009090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b6c608bb-43c0-45f8-ad9a-ec930e88a3b6 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:04 devstack sudo[90833]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:04 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ef74bdf9-8767-4ded-9468-045cc07d02c2 tempest-VolumeDependencyTests-972921078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2" returned: 0 in 0.473s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:04 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-ef74bdf9-8767-4ded-9468-045cc07d02c2 tempest-VolumeDependencyTests-972921078 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:02:04 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-ef74bdf9-8767-4ded-9468-045cc07d02c2 tempest-VolumeDependencyTests-972921078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:02:04 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-75674803-f3d1-4127-b615-e249b7a97457 tempest-CinderUnicodeTest-847668735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.460s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:02:04 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-75674803-f3d1-4127-b615-e249b7a97457 tempest-CinderUnicodeTest-847668735 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:02:01Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-189330619',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18620bde-da65-4deb-823c-625134fcc6e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b900ac42f89143c2ba33d175c02dffc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:02:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:02:01Z,use_quota=True,user_id='8dd2f079373e480bb4d516ea5eb1f3e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:02:04 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-75674803-f3d1-4127-b615-e249b7a97457 tempest-CinderUnicodeTest-847668735 None] Creating volume 18620bde-da65-4deb-823c-625134fcc6e4 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:02:04 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-75674803-f3d1-4127-b615-e249b7a97457 tempest-CinderUnicodeTest-847668735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:02:04 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-75674803-f3d1-4127-b615-e249b7a97457 tempest-CinderUnicodeTest-847668735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:02:04 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-75674803-f3d1-4127-b615-e249b7a97457 tempest-CinderUnicodeTest-847668735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:02:04 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-75674803-f3d1-4127-b615-e249b7a97457 tempest-CinderUnicodeTest-847668735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:02:04 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-75674803-f3d1-4127-b615-e249b7a97457 tempest-CinderUnicodeTest-847668735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:02:04 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-75674803-f3d1-4127-b615-e249b7a97457 tempest-CinderUnicodeTest-847668735 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:02:04 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-75674803-f3d1-4127-b615-e249b7a97457 tempest-CinderUnicodeTest-847668735 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 16:02:04 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-75674803-f3d1-4127-b615-e249b7a97457 tempest-CinderUnicodeTest-847668735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-18620bde-da65-4deb-823c-625134fcc6e4 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:05 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-ef74bdf9-8767-4ded-9468-045cc07d02c2 tempest-VolumeDependencyTests-972921078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0228455-78db-4fb7-b63c-98837d42b039) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:02:05 devstack sudo[90838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-18620bde-da65-4deb-823c-625134fcc6e4 1073741824
Apr 15 16:02:05 devstack sudo[90838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:05 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-ef74bdf9-8767-4ded-9468-045cc07d02c2 tempest-VolumeDependencyTests-972921078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e2737a3-6efa-4d31-b5ca-c3a8102f47b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:02:05 devstack sudo[90837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b6c608bb-43c0-45f8-ad9a-ec930e88a3b6
Apr 15 16:02:05 devstack sudo[90837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:05 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-ef74bdf9-8767-4ded-9468-045cc07d02c2 tempest-VolumeDependencyTests-972921078 None] Volume volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2 (1fd72c08-55c0-4f3e-98c6-35050d1f56f2): created successfully
Apr 15 16:02:05 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-ef74bdf9-8767-4ded-9468-045cc07d02c2 tempest-VolumeDependencyTests-972921078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e2737a3-6efa-4d31-b5ca-c3a8102f47b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:02:05 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-ef74bdf9-8767-4ded-9468-045cc07d02c2 tempest-VolumeDependencyTests-972921078 None] Flow 'volume_create_manager' (43c0e6ec-8fb0-4434-9ac5-49a7684a8fac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:02:05 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-ef74bdf9-8767-4ded-9468-045cc07d02c2 tempest-VolumeDependencyTests-972921078 None] Created volume successfully.
Apr 15 16:02:05 devstack sudo[90837]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:05 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-d3add8d6-4eba-47d7-9cb9-116aca3eed5b tempest-CreateVolumesFromSnapshotTest-222009090 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b6c608bb-43c0-45f8-ad9a-ec930e88a3b6" returned: 0 in 0.522s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:05 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-d3add8d6-4eba-47d7-9cb9-116aca3eed5b tempest-CreateVolumesFromSnapshotTest-222009090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b6c608bb-43c0-45f8-ad9a-ec930e88a3b6 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:05 devstack sudo[90847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b6c608bb-43c0-45f8-ad9a-ec930e88a3b6
Apr 15 16:02:05 devstack sudo[90847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:05 devstack sudo[90838]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:05 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-75674803-f3d1-4127-b615-e249b7a97457 tempest-CinderUnicodeTest-847668735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-18620bde-da65-4deb-823c-625134fcc6e4 1073741824" returned: 0 in 0.508s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:05 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-75674803-f3d1-4127-b615-e249b7a97457 tempest-CinderUnicodeTest-847668735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-18620bde-da65-4deb-823c-625134fcc6e4 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:05 devstack sudo[90849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-18620bde-da65-4deb-823c-625134fcc6e4
Apr 15 16:02:05 devstack sudo[90849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:05 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:02:05 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] Flow 'volume_create_manager' (0eb872af-8fa5-4626-9a5a-610fa92d09e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:02:05 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e632af1-5c0b-422a-9088-56f91e202811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:02:05 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e632af1-5c0b-422a-9088-56f91e202811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:02:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1229158791',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69bd1781-9d2c-467c-8f00-73ac52f4f77e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d363d48ee3e40b5a9f7d410914be77e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:02:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=1fd72c08-55c0-4f3e-98c6-35050d1f56f2,status='creating',terminated_at=None,updated_at=2026-04-15T14:02:06Z,use_quota=True,user_id='da5723df3b9d48f09a9929ddb60988ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:02:05 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e279142a-8408-4310-8047-d02ed9bc7d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:02:05 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e279142a-8408-4310-8047-d02ed9bc7d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:02:05 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a694939-ee35-464c-9f8f-3a441fd8b2d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:02:05 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a694939-ee35-464c-9f8f-3a441fd8b2d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '69bd1781-9d2c-467c-8f00-73ac52f4f77e', 'volume_name': 'volume-69bd1781-9d2c-467c-8f00-73ac52f4f77e', 'volume_size': 1, 'source_volid': '1fd72c08-55c0-4f3e-98c6-35050d1f56f2', 'source_volstatus': 'available'}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:02:05 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (369ca8ce-6477-47c1-82a5-67a295ec3d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:02:05 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (369ca8ce-6477-47c1-82a5-67a295ec3d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:02:05 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b72675e7-7337-4eab-89a4-9efe58e0d5b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:02:05 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] Volume 69bd1781-9d2c-467c-8f00-73ac52f4f77e: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-69bd1781-9d2c-467c-8f00-73ac52f4f77e', 'volume_size': 1, 'source_volid': '1fd72c08-55c0-4f3e-98c6-35050d1f56f2', 'source_volstatus': 'available'}
Apr 15 16:02:05 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:02:05 devstack sudo[90847]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:05 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-d3add8d6-4eba-47d7-9cb9-116aca3eed5b tempest-CreateVolumesFromSnapshotTest-222009090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b6c608bb-43c0-45f8-ad9a-ec930e88a3b6" returned: 0 in 0.439s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:05 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-d3add8d6-4eba-47d7-9cb9-116aca3eed5b tempest-CreateVolumesFromSnapshotTest-222009090 None] Lock "cinder-quobyte-b6c608bb-43c0-45f8-ad9a-ec930e88a3b6" released by "delete_volume" :: held 0.983s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:02:05 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-d3add8d6-4eba-47d7-9cb9-116aca3eed5b tempest-CreateVolumesFromSnapshotTest-222009090 None] Created reservations ['1d299efe-f54e-4d4b-9625-bbf5909bfaef', '50701423-6e33-4758-afda-9e654d79f481', '7cdc6091-83d1-4561-9b80-7dd5b43d0cb7', 'bb4d45e7-5f8d-42ca-8e81-ecacb55aaf48'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:02:05 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-d3add8d6-4eba-47d7-9cb9-116aca3eed5b tempest-CreateVolumesFromSnapshotTest-222009090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:02:05 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-d3add8d6-4eba-47d7-9cb9-116aca3eed5b tempest-CreateVolumesFromSnapshotTest-222009090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:02:05 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-d3add8d6-4eba-47d7-9cb9-116aca3eed5b tempest-CreateVolumesFromSnapshotTest-222009090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:02:05 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-d3add8d6-4eba-47d7-9cb9-116aca3eed5b tempest-CreateVolumesFromSnapshotTest-222009090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:02:05 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-d3add8d6-4eba-47d7-9cb9-116aca3eed5b tempest-CreateVolumesFromSnapshotTest-222009090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:02:05 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-d3add8d6-4eba-47d7-9cb9-116aca3eed5b tempest-CreateVolumesFromSnapshotTest-222009090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:06 devstack sudo[90853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 16:02:06 devstack sudo[90853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:06 devstack sudo[90849]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:06 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-75674803-f3d1-4127-b615-e249b7a97457 tempest-CinderUnicodeTest-847668735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-18620bde-da65-4deb-823c-625134fcc6e4" returned: 0 in 0.503s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:06 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-75674803-f3d1-4127-b615-e249b7a97457 tempest-CinderUnicodeTest-847668735 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:02:06 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-75674803-f3d1-4127-b615-e249b7a97457 tempest-CinderUnicodeTest-847668735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:02:06 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-bbdfbbf4-6b12-4bac-a308-9672bea04801 tempest-SnapshotDependencyTests-1453928896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.137s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:02:06 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-bbdfbbf4-6b12-4bac-a308-9672bea04801 tempest-SnapshotDependencyTests-1453928896 None] Acquiring lock "cinder-quobyte-2dfd2666-ca62-4b45-a47d-8839553dfcb9-95158fed-708d-4e9f-bae2-c7e28c13e16f" by "_create_volume_from_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:02:06 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-75674803-f3d1-4127-b615-e249b7a97457 tempest-CinderUnicodeTest-847668735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4580651c-2d9b-4085-bec6-d109bc21241a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18620bde-da65-4deb-823c-625134fcc6e4', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:02:06 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-75674803-f3d1-4127-b615-e249b7a97457 tempest-CinderUnicodeTest-847668735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35941174-157e-4980-a5bc-ab4dfcb71b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:02:06 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-bbdfbbf4-6b12-4bac-a308-9672bea04801 tempest-SnapshotDependencyTests-1453928896 None] Lock "cinder-quobyte-2dfd2666-ca62-4b45-a47d-8839553dfcb9-95158fed-708d-4e9f-bae2-c7e28c13e16f" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:02:06 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-bbdfbbf4-6b12-4bac-a308-9672bea04801 tempest-SnapshotDependencyTests-1453928896 None] Creating volume 95158fed-708d-4e9f-bae2-c7e28c13e16f from snapshot 2dfd2666-ca62-4b45-a47d-8839553dfcb9 {{(pid=82485) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 15 16:02:06 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-bbdfbbf4-6b12-4bac-a308-9672bea04801 tempest-SnapshotDependencyTests-1453928896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:02:06 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-bbdfbbf4-6b12-4bac-a308-9672bea04801 tempest-SnapshotDependencyTests-1453928896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:02:06 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-bbdfbbf4-6b12-4bac-a308-9672bea04801 tempest-SnapshotDependencyTests-1453928896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:02:06 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-bbdfbbf4-6b12-4bac-a308-9672bea04801 tempest-SnapshotDependencyTests-1453928896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:02:06 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-bbdfbbf4-6b12-4bac-a308-9672bea04801 tempest-SnapshotDependencyTests-1453928896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:02:06 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-bbdfbbf4-6b12-4bac-a308-9672bea04801 tempest-SnapshotDependencyTests-1453928896 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:02:06 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-bbdfbbf4-6b12-4bac-a308-9672bea04801 tempest-SnapshotDependencyTests-1453928896 None] Acquiring lock "cinder-quobyte-95158fed-708d-4e9f-bae2-c7e28c13e16f" by "_copy_volume_from_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:02:06 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-75674803-f3d1-4127-b615-e249b7a97457 tempest-CinderUnicodeTest-847668735 None] Volume volume-18620bde-da65-4deb-823c-625134fcc6e4 (18620bde-da65-4deb-823c-625134fcc6e4): created successfully
Apr 15 16:02:06 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-75674803-f3d1-4127-b615-e249b7a97457 tempest-CinderUnicodeTest-847668735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35941174-157e-4980-a5bc-ab4dfcb71b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:02:06 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-75674803-f3d1-4127-b615-e249b7a97457 tempest-CinderUnicodeTest-847668735 None] Flow 'volume_create_manager' (4602440f-b0b9-4b64-914f-3c1edcaf57da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:02:06 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-75674803-f3d1-4127-b615-e249b7a97457 tempest-CinderUnicodeTest-847668735 None] Created volume successfully.
Apr 15 16:02:06 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-bbdfbbf4-6b12-4bac-a308-9672bea04801 tempest-SnapshotDependencyTests-1453928896 None] Lock "cinder-quobyte-95158fed-708d-4e9f-bae2-c7e28c13e16f" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:02:06 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-bbdfbbf4-6b12-4bac-a308-9672bea04801 tempest-SnapshotDependencyTests-1453928896 None] snapshot: 2dfd2666-ca62-4b45-a47d-8839553dfcb9, volume: 95158fed-708d-4e9f-bae2-c7e28c13e16f,  {{(pid=82485) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 15 16:02:06 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-bbdfbbf4-6b12-4bac-a308-9672bea04801 tempest-SnapshotDependencyTests-1453928896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:02:06 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-bbdfbbf4-6b12-4bac-a308-9672bea04801 tempest-SnapshotDependencyTests-1453928896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:02:06 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-bbdfbbf4-6b12-4bac-a308-9672bea04801 tempest-SnapshotDependencyTests-1453928896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:02:06 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-bbdfbbf4-6b12-4bac-a308-9672bea04801 tempest-SnapshotDependencyTests-1453928896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:02:06 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-bbdfbbf4-6b12-4bac-a308-9672bea04801 tempest-SnapshotDependencyTests-1453928896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:02:06 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48d71aa-c013-419b-a4d2-869333cd7aac]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:02:06 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-bbdfbbf4-6b12-4bac-a308-9672bea04801 tempest-SnapshotDependencyTests-1453928896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b5a8607c-3448-4293-adc7-adaa566ffcce.2dfd2666-ca62-4b45-a47d-8839553dfcb9 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:06 devstack sudo[90855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b5a8607c-3448-4293-adc7-adaa566ffcce.2dfd2666-ca62-4b45-a47d-8839553dfcb9
Apr 15 16:02:06 devstack sudo[90855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:06 devstack sudo[90853]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:06 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-d3add8d6-4eba-47d7-9cb9-116aca3eed5b tempest-CreateVolumesFromSnapshotTest-222009090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.464s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:06 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-d3add8d6-4eba-47d7-9cb9-116aca3eed5b tempest-CreateVolumesFromSnapshotTest-222009090 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:02:06 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-d3add8d6-4eba-47d7-9cb9-116aca3eed5b tempest-CreateVolumesFromSnapshotTest-222009090 None] Deleted volume successfully.
Apr 15 16:02:06 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-d3add8d6-4eba-47d7-9cb9-116aca3eed5b tempest-CreateVolumesFromSnapshotTest-222009090 None] Lock "cinder-b6c608bb-43c0-45f8-ad9a-ec930e88a3b6-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:02:06 devstack sudo[90855]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:06 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-bbdfbbf4-6b12-4bac-a308-9672bea04801 tempest-SnapshotDependencyTests-1453928896 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b5a8607c-3448-4293-adc7-adaa566ffcce.2dfd2666-ca62-4b45-a47d-8839553dfcb9" returned: 0 in 0.506s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:06 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-bbdfbbf4-6b12-4bac-a308-9672bea04801 tempest-SnapshotDependencyTests-1453928896 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5a8607c-3448-4293-adc7-adaa566ffcce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82485) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:02:06 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-bbdfbbf4-6b12-4bac-a308-9672bea04801 tempest-SnapshotDependencyTests-1453928896 None] will copy from snapshot at /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b5a8607c-3448-4293-adc7-adaa566ffcce {{(pid=82485) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 15 16:02:06 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-bbdfbbf4-6b12-4bac-a308-9672bea04801 tempest-SnapshotDependencyTests-1453928896 None] Creating direct copy from snapshot {{(pid=82485) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 15 16:02:06 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42af104-0cd1-47b3-9829-12847f749728]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:02:06 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-bbdfbbf4-6b12-4bac-a308-9672bea04801 tempest-SnapshotDependencyTests-1453928896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b5a8607c-3448-4293-adc7-adaa566ffcce {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:06 devstack sudo[90861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b5a8607c-3448-4293-adc7-adaa566ffcce
Apr 15 16:02:06 devstack sudo[90861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:06 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-a7340d7c-f469-43f0-acbf-bf53a5ac834b tempest-CinderUnicodeTest-847668735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:02:07 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-eb2d0f07-ca3e-401a-862c-ed1c9abc2fa4 tempest-CreateVolumesFromSnapshotTest-222009090 None] Acquiring lock "cinder-a5039165-63f2-4912-8bf4-2915f9504ac5-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:02:07 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-eb2d0f07-ca3e-401a-862c-ed1c9abc2fa4 tempest-CreateVolumesFromSnapshotTest-222009090 None] Lock "cinder-a5039165-63f2-4912-8bf4-2915f9504ac5-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:02:07 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-eb2d0f07-ca3e-401a-862c-ed1c9abc2fa4 tempest-CreateVolumesFromSnapshotTest-222009090 None] Acquiring lock "cinder-quobyte-a5039165-63f2-4912-8bf4-2915f9504ac5" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:02:07 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-eb2d0f07-ca3e-401a-862c-ed1c9abc2fa4 tempest-CreateVolumesFromSnapshotTest-222009090 None] Lock "cinder-quobyte-a5039165-63f2-4912-8bf4-2915f9504ac5" acquired by "delete_volume" :: waited 0.008s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:02:07 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[1780c514-bd32-4281-af22-3683f73d9308]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:02:07 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-eb2d0f07-ca3e-401a-862c-ed1c9abc2fa4 tempest-CreateVolumesFromSnapshotTest-222009090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a5039165-63f2-4912-8bf4-2915f9504ac5 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:07 devstack sudo[90861]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:07 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-bbdfbbf4-6b12-4bac-a308-9672bea04801 tempest-SnapshotDependencyTests-1453928896 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b5a8607c-3448-4293-adc7-adaa566ffcce" returned: 0 in 0.544s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:07 devstack cinder-volume[82485]: DEBUG cinder.utils [None req-bbdfbbf4-6b12-4bac-a308-9672bea04801 tempest-SnapshotDependencyTests-1453928896 None] Path /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-95158fed-708d-4e9f-bae2-c7e28c13e16f not found in is_blk_device check {{(pid=82485) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 15 16:02:07 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-bbdfbbf4-6b12-4bac-a308-9672bea04801 tempest-SnapshotDependencyTests-1453928896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b5a8607c-3448-4293-adc7-adaa566ffcce /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-95158fed-708d-4e9f-bae2-c7e28c13e16f {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:07 devstack sudo[90866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a5039165-63f2-4912-8bf4-2915f9504ac5
Apr 15 16:02:07 devstack sudo[90866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:07 devstack sudo[90867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b5a8607c-3448-4293-adc7-adaa566ffcce /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-95158fed-708d-4e9f-bae2-c7e28c13e16f
Apr 15 16:02:07 devstack sudo[90867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:07 devstack sudo[90866]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:07 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-eb2d0f07-ca3e-401a-862c-ed1c9abc2fa4 tempest-CreateVolumesFromSnapshotTest-222009090 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a5039165-63f2-4912-8bf4-2915f9504ac5" returned: 0 in 0.545s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:07 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-eb2d0f07-ca3e-401a-862c-ed1c9abc2fa4 tempest-CreateVolumesFromSnapshotTest-222009090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a5039165-63f2-4912-8bf4-2915f9504ac5 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:07 devstack sudo[90883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a5039165-63f2-4912-8bf4-2915f9504ac5
Apr 15 16:02:07 devstack sudo[90883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:09 devstack sudo[90883]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:09 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-eb2d0f07-ca3e-401a-862c-ed1c9abc2fa4 tempest-CreateVolumesFromSnapshotTest-222009090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a5039165-63f2-4912-8bf4-2915f9504ac5" returned: 0 in 1.364s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:09 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-eb2d0f07-ca3e-401a-862c-ed1c9abc2fa4 tempest-CreateVolumesFromSnapshotTest-222009090 None] Lock "cinder-quobyte-a5039165-63f2-4912-8bf4-2915f9504ac5" released by "delete_volume" :: held 1.943s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:02:09 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-eb2d0f07-ca3e-401a-862c-ed1c9abc2fa4 tempest-CreateVolumesFromSnapshotTest-222009090 None] Created reservations ['50552ed2-b8cd-4978-bd39-863ddec569fb', 'e4298b20-71c8-4de3-bdc8-c5582d3eda5c', '212d9bf1-e521-44a2-9585-2f3313af803e', '620c45e0-e7db-4f33-b8e1-5fb5bccd4dc3'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:02:09 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-eb2d0f07-ca3e-401a-862c-ed1c9abc2fa4 tempest-CreateVolumesFromSnapshotTest-222009090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:02:09 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-eb2d0f07-ca3e-401a-862c-ed1c9abc2fa4 tempest-CreateVolumesFromSnapshotTest-222009090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:02:09 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-eb2d0f07-ca3e-401a-862c-ed1c9abc2fa4 tempest-CreateVolumesFromSnapshotTest-222009090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:02:09 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-eb2d0f07-ca3e-401a-862c-ed1c9abc2fa4 tempest-CreateVolumesFromSnapshotTest-222009090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:02:09 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-eb2d0f07-ca3e-401a-862c-ed1c9abc2fa4 tempest-CreateVolumesFromSnapshotTest-222009090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:02:09 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-eb2d0f07-ca3e-401a-862c-ed1c9abc2fa4 tempest-CreateVolumesFromSnapshotTest-222009090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:09 devstack sudo[90886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 16:02:09 devstack sudo[90886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:09 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-03b1121d-e397-4044-8a18-0f596a15b367 tempest-CreateVolumesFromSnapshotTest-222009090 None] Acquiring lock "cinder-67ba2cee-04e1-4a3c-aa22-9d49cb4ccb38-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:02:09 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-03b1121d-e397-4044-8a18-0f596a15b367 tempest-CreateVolumesFromSnapshotTest-222009090 None] Lock "cinder-67ba2cee-04e1-4a3c-aa22-9d49cb4ccb38-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:02:09 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-03b1121d-e397-4044-8a18-0f596a15b367 tempest-CreateVolumesFromSnapshotTest-222009090 None] Acquiring lock "cinder-quobyte-67ba2cee-04e1-4a3c-aa22-9d49cb4ccb38" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:02:09 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-03b1121d-e397-4044-8a18-0f596a15b367 tempest-CreateVolumesFromSnapshotTest-222009090 None] Lock "cinder-quobyte-67ba2cee-04e1-4a3c-aa22-9d49cb4ccb38" acquired by "delete_volume" :: waited 0.010s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:02:09 devstack sudo[90867]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:09 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-bbdfbbf4-6b12-4bac-a308-9672bea04801 tempest-SnapshotDependencyTests-1453928896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b5a8607c-3448-4293-adc7-adaa566ffcce /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-95158fed-708d-4e9f-bae2-c7e28c13e16f" returned: 0 in 2.232s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:09 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab6dc6a-1b48-42a5-bb4a-5901945e3ab7]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:02:09 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-03b1121d-e397-4044-8a18-0f596a15b367 tempest-CreateVolumesFromSnapshotTest-222009090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-67ba2cee-04e1-4a3c-aa22-9d49cb4ccb38 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:09 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[97080844-6f17-4cbd-98c1-f97b7e2bc9ae]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:02:09 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-bbdfbbf4-6b12-4bac-a308-9672bea04801 tempest-SnapshotDependencyTests-1453928896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b5a8607c-3448-4293-adc7-adaa566ffcce {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:09 devstack sudo[90889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-67ba2cee-04e1-4a3c-aa22-9d49cb4ccb38
Apr 15 16:02:09 devstack sudo[90889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:09 devstack sudo[90890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b5a8607c-3448-4293-adc7-adaa566ffcce
Apr 15 16:02:09 devstack sudo[90890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:09 devstack sudo[90886]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:09 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-eb2d0f07-ca3e-401a-862c-ed1c9abc2fa4 tempest-CreateVolumesFromSnapshotTest-222009090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.482s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:09 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-eb2d0f07-ca3e-401a-862c-ed1c9abc2fa4 tempest-CreateVolumesFromSnapshotTest-222009090 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:02:09 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-eb2d0f07-ca3e-401a-862c-ed1c9abc2fa4 tempest-CreateVolumesFromSnapshotTest-222009090 None] Deleted volume successfully.
Apr 15 16:02:09 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-eb2d0f07-ca3e-401a-862c-ed1c9abc2fa4 tempest-CreateVolumesFromSnapshotTest-222009090 None] Lock "cinder-a5039165-63f2-4912-8bf4-2915f9504ac5-delete_volume" released by "delete_volume" :: held 2.645s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:02:09 devstack sudo[90889]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:09 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-03b1121d-e397-4044-8a18-0f596a15b367 tempest-CreateVolumesFromSnapshotTest-222009090 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-67ba2cee-04e1-4a3c-aa22-9d49cb4ccb38" returned: 0 in 0.479s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:09 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-03b1121d-e397-4044-8a18-0f596a15b367 tempest-CreateVolumesFromSnapshotTest-222009090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-67ba2cee-04e1-4a3c-aa22-9d49cb4ccb38 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:09 devstack sudo[90899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-67ba2cee-04e1-4a3c-aa22-9d49cb4ccb38
Apr 15 16:02:09 devstack sudo[90899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:10 devstack sudo[90890]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-bbdfbbf4-6b12-4bac-a308-9672bea04801 tempest-SnapshotDependencyTests-1453928896 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b5a8607c-3448-4293-adc7-adaa566ffcce" returned: 0 in 0.661s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:10 devstack cinder-volume[82485]: DEBUG cinder.image.image_utils [None req-bbdfbbf4-6b12-4bac-a308-9672bea04801 tempest-SnapshotDependencyTests-1453928896 None] Image conversion details: src /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b5a8607c-3448-4293-adc7-adaa566ffcce, size 1024.00 MB, duration 2.23 sec, destination /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-95158fed-708d-4e9f-bae2-c7e28c13e16f {{(pid=82485) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 16:02:10 devstack cinder-volume[82485]: INFO cinder.image.image_utils [None req-bbdfbbf4-6b12-4bac-a308-9672bea04801 tempest-SnapshotDependencyTests-1453928896 None] Converted 1024.00 MB image at 458.66 MB/s
Apr 15 16:02:10 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-bbdfbbf4-6b12-4bac-a308-9672bea04801 tempest-SnapshotDependencyTests-1453928896 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-95158fed-708d-4e9f-bae2-c7e28c13e16f is being set with open permissions: ugo+rw
Apr 15 16:02:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-bbdfbbf4-6b12-4bac-a308-9672bea04801 tempest-SnapshotDependencyTests-1453928896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-95158fed-708d-4e9f-bae2-c7e28c13e16f {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:10 devstack sudo[90902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-95158fed-708d-4e9f-bae2-c7e28c13e16f
Apr 15 16:02:10 devstack sudo[90902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:10 devstack sudo[90899]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-03b1121d-e397-4044-8a18-0f596a15b367 tempest-CreateVolumesFromSnapshotTest-222009090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-67ba2cee-04e1-4a3c-aa22-9d49cb4ccb38" returned: 0 in 0.450s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:10 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-03b1121d-e397-4044-8a18-0f596a15b367 tempest-CreateVolumesFromSnapshotTest-222009090 None] Lock "cinder-quobyte-67ba2cee-04e1-4a3c-aa22-9d49cb4ccb38" released by "delete_volume" :: held 0.959s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:02:10 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-03b1121d-e397-4044-8a18-0f596a15b367 tempest-CreateVolumesFromSnapshotTest-222009090 None] Created reservations ['b67c6991-d135-48d1-a34d-acbd66d8234e', '26ee0347-b2a7-46de-8224-bdd67147e005', 'd5be848f-aa7a-408e-bf9c-d7f60c62e269', '80f783f8-5c26-4a02-8977-f0fde1de95fc'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:02:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-03b1121d-e397-4044-8a18-0f596a15b367 tempest-CreateVolumesFromSnapshotTest-222009090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:02:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-03b1121d-e397-4044-8a18-0f596a15b367 tempest-CreateVolumesFromSnapshotTest-222009090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:02:10 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-03b1121d-e397-4044-8a18-0f596a15b367 tempest-CreateVolumesFromSnapshotTest-222009090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:02:10 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-03b1121d-e397-4044-8a18-0f596a15b367 tempest-CreateVolumesFromSnapshotTest-222009090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:02:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-03b1121d-e397-4044-8a18-0f596a15b367 tempest-CreateVolumesFromSnapshotTest-222009090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:02:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-03b1121d-e397-4044-8a18-0f596a15b367 tempest-CreateVolumesFromSnapshotTest-222009090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:10 devstack sudo[90905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 16:02:10 devstack sudo[90905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:10 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-b2744682-495a-4338-86b0-768e068b08c4 tempest-CreateVolumesFromSnapshotTest-222009090 None] Acquiring lock "cinder-6eb6b0a0-2e0f-46d4-a1b5-f0bdbb745443-delete_snapshot" by "delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:02:10 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-b2744682-495a-4338-86b0-768e068b08c4 tempest-CreateVolumesFromSnapshotTest-222009090 None] Lock "cinder-6eb6b0a0-2e0f-46d4-a1b5-f0bdbb745443-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:02:10 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-b2744682-495a-4338-86b0-768e068b08c4 tempest-CreateVolumesFromSnapshotTest-222009090 None] Acquiring lock "cinder-quobyte-a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304" by "delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:02:10 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-b2744682-495a-4338-86b0-768e068b08c4 tempest-CreateVolumesFromSnapshotTest-222009090 None] Lock "cinder-quobyte-a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:02:10 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-b2744682-495a-4338-86b0-768e068b08c4 tempest-CreateVolumesFromSnapshotTest-222009090 None] Acquiring lock "cinder-quobyte-6eb6b0a0-2e0f-46d4-a1b5-f0bdbb745443" by "_delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:02:10 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-b2744682-495a-4338-86b0-768e068b08c4 tempest-CreateVolumesFromSnapshotTest-222009090 None] Lock "cinder-quobyte-6eb6b0a0-2e0f-46d4-a1b5-f0bdbb745443" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:02:10 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-b2744682-495a-4338-86b0-768e068b08c4 tempest-CreateVolumesFromSnapshotTest-222009090 None] Deleting offline snapshot 6eb6b0a0-2e0f-46d4-a1b5-f0bdbb745443 of volume a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304 {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 16:02:10 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-b2744682-495a-4338-86b0-768e068b08c4 tempest-CreateVolumesFromSnapshotTest-222009090 None] snapshot_file for this snap is: volume-a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304.6eb6b0a0-2e0f-46d4-a1b5-f0bdbb745443 {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 16:02:10 devstack sudo[90902]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-bbdfbbf4-6b12-4bac-a308-9672bea04801 tempest-SnapshotDependencyTests-1453928896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-95158fed-708d-4e9f-bae2-c7e28c13e16f" returned: 0 in 0.437s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:10 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[0800f757-702d-469a-b8ad-46e485a7d8f0]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:02:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b2744682-495a-4338-86b0-768e068b08c4 tempest-CreateVolumesFromSnapshotTest-222009090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304.6eb6b0a0-2e0f-46d4-a1b5-f0bdbb745443 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:10 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-bbdfbbf4-6b12-4bac-a308-9672bea04801 tempest-SnapshotDependencyTests-1453928896 None] Lock "cinder-quobyte-95158fed-708d-4e9f-bae2-c7e28c13e16f" released by "_copy_volume_from_snapshot" :: held 4.452s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:02:10 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-bbdfbbf4-6b12-4bac-a308-9672bea04801 tempest-SnapshotDependencyTests-1453928896 None] Lock "cinder-quobyte-2dfd2666-ca62-4b45-a47d-8839553dfcb9-95158fed-708d-4e9f-bae2-c7e28c13e16f" released by "_create_volume_from_snapshot" :: held 4.490s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:02:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-bbdfbbf4-6b12-4bac-a308-9672bea04801 tempest-SnapshotDependencyTests-1453928896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.513s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:02:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 4.713s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:02:10 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] Cloning volume 1fd72c08-55c0-4f3e-98c6-35050d1f56f2 to volume 69bd1781-9d2c-467c-8f00-73ac52f4f77e
Apr 15 16:02:10 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] Creating offline snapshot 83bb3218-3812-4c5e-bb21-8ccb10ebf640 of volume 1fd72c08-55c0-4f3e-98c6-35050d1f56f2 {{(pid=82485) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 16:02:10 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-bbdfbbf4-6b12-4bac-a308-9672bea04801 tempest-SnapshotDependencyTests-1453928896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a33b7ee-61cd-4f0c-906b-ad2def23b192) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95158fed-708d-4e9f-bae2-c7e28c13e16f', 'volume_size': 1, 'snapshot_id': '2dfd2666-ca62-4b45-a47d-8839553dfcb9'}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:02:10 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-bbdfbbf4-6b12-4bac-a308-9672bea04801 tempest-SnapshotDependencyTests-1453928896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78ebb8b4-9003-437a-8985-81f34077c838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:02:10 devstack sudo[90908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304.6eb6b0a0-2e0f-46d4-a1b5-f0bdbb745443
Apr 15 16:02:10 devstack sudo[90908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:10 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[432e9062-e76d-45d8-9bab-7e251e7f9a76]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:02:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:10 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-bbdfbbf4-6b12-4bac-a308-9672bea04801 tempest-SnapshotDependencyTests-1453928896 None] Volume volume-95158fed-708d-4e9f-bae2-c7e28c13e16f (95158fed-708d-4e9f-bae2-c7e28c13e16f): created successfully
Apr 15 16:02:10 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-bbdfbbf4-6b12-4bac-a308-9672bea04801 tempest-SnapshotDependencyTests-1453928896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78ebb8b4-9003-437a-8985-81f34077c838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:02:10 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-bbdfbbf4-6b12-4bac-a308-9672bea04801 tempest-SnapshotDependencyTests-1453928896 None] Flow 'volume_create_manager' (6d885326-cd73-4c9e-b79a-90823863884a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:02:10 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-bbdfbbf4-6b12-4bac-a308-9672bea04801 tempest-SnapshotDependencyTests-1453928896 None] Created volume successfully.
Apr 15 16:02:10 devstack sudo[90910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2
Apr 15 16:02:10 devstack sudo[90910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:10 devstack sudo[90905]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:10 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-03b1121d-e397-4044-8a18-0f596a15b367 tempest-CreateVolumesFromSnapshotTest-222009090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.484s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:10 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-03b1121d-e397-4044-8a18-0f596a15b367 tempest-CreateVolumesFromSnapshotTest-222009090 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:02:10 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-03b1121d-e397-4044-8a18-0f596a15b367 tempest-CreateVolumesFromSnapshotTest-222009090 None] Deleted volume successfully.
Apr 15 16:02:10 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-03b1121d-e397-4044-8a18-0f596a15b367 tempest-CreateVolumesFromSnapshotTest-222009090 None] Lock "cinder-67ba2cee-04e1-4a3c-aa22-9d49cb4ccb38-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:02:11 devstack sudo[90908]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:11 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b2744682-495a-4338-86b0-768e068b08c4 tempest-CreateVolumesFromSnapshotTest-222009090 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304.6eb6b0a0-2e0f-46d4-a1b5-f0bdbb745443" returned: 0 in 0.515s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:11 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-b2744682-495a-4338-86b0-768e068b08c4 tempest-CreateVolumesFromSnapshotTest-222009090 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82485) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:02:11 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c563d6-8a93-4bb0-a819-2cae3256e2ca]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:02:11 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b2744682-495a-4338-86b0-768e068b08c4 tempest-CreateVolumesFromSnapshotTest-222009090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:11 devstack sudo[90910]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:11 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2" returned: 0 in 0.525s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:11 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2.83bb3218-3812-4c5e-bb21-8ccb10ebf640 1G {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:11 devstack sudo[90920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2.83bb3218-3812-4c5e-bb21-8ccb10ebf640 1G
Apr 15 16:02:11 devstack sudo[90920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:11 devstack sudo[90919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304
Apr 15 16:02:11 devstack sudo[90919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:11 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-27552bc4-a1b9-4005-a47f-d6a1807778aa tempest-SnapshotDependencyTests-1453928896 None] Acquiring lock "cinder-2dfd2666-ca62-4b45-a47d-8839553dfcb9-delete_snapshot" by "delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:02:11 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-27552bc4-a1b9-4005-a47f-d6a1807778aa tempest-SnapshotDependencyTests-1453928896 None] Lock "cinder-2dfd2666-ca62-4b45-a47d-8839553dfcb9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:02:11 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-27552bc4-a1b9-4005-a47f-d6a1807778aa tempest-SnapshotDependencyTests-1453928896 None] Acquiring lock "cinder-quobyte-b5a8607c-3448-4293-adc7-adaa566ffcce" by "delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:02:11 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-27552bc4-a1b9-4005-a47f-d6a1807778aa tempest-SnapshotDependencyTests-1453928896 None] Lock "cinder-quobyte-b5a8607c-3448-4293-adc7-adaa566ffcce" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:02:11 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-27552bc4-a1b9-4005-a47f-d6a1807778aa tempest-SnapshotDependencyTests-1453928896 None] Acquiring lock "cinder-quobyte-2dfd2666-ca62-4b45-a47d-8839553dfcb9" by "_delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:02:11 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-27552bc4-a1b9-4005-a47f-d6a1807778aa tempest-SnapshotDependencyTests-1453928896 None] Lock "cinder-quobyte-2dfd2666-ca62-4b45-a47d-8839553dfcb9" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:02:11 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-27552bc4-a1b9-4005-a47f-d6a1807778aa tempest-SnapshotDependencyTests-1453928896 None] Deleting offline snapshot 2dfd2666-ca62-4b45-a47d-8839553dfcb9 of volume b5a8607c-3448-4293-adc7-adaa566ffcce {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 16:02:11 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-27552bc4-a1b9-4005-a47f-d6a1807778aa tempest-SnapshotDependencyTests-1453928896 None] snapshot_file for this snap is: volume-b5a8607c-3448-4293-adc7-adaa566ffcce.2dfd2666-ca62-4b45-a47d-8839553dfcb9 {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 16:02:11 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb02b4d-39de-46d1-a326-11fed02eff22]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:02:11 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-27552bc4-a1b9-4005-a47f-d6a1807778aa tempest-SnapshotDependencyTests-1453928896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b5a8607c-3448-4293-adc7-adaa566ffcce.2dfd2666-ca62-4b45-a47d-8839553dfcb9 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:11 devstack sudo[90923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b5a8607c-3448-4293-adc7-adaa566ffcce.2dfd2666-ca62-4b45-a47d-8839553dfcb9
Apr 15 16:02:11 devstack sudo[90923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:11 devstack sudo[90919]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:11 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b2744682-495a-4338-86b0-768e068b08c4 tempest-CreateVolumesFromSnapshotTest-222009090 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304" returned: 0 in 0.564s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:11 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b2744682-495a-4338-86b0-768e068b08c4 tempest-CreateVolumesFromSnapshotTest-222009090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304.6eb6b0a0-2e0f-46d4-a1b5-f0bdbb745443 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:11 devstack sudo[90931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304.6eb6b0a0-2e0f-46d4-a1b5-f0bdbb745443
Apr 15 16:02:11 devstack sudo[90931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:11 devstack sudo[90920]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:11 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2.83bb3218-3812-4c5e-bb21-8ccb10ebf640 1G" returned: 0 in 0.560s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:11 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2.83bb3218-3812-4c5e-bb21-8ccb10ebf640 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:11 devstack sudo[90933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2.83bb3218-3812-4c5e-bb21-8ccb10ebf640
Apr 15 16:02:11 devstack sudo[90933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:11 devstack sudo[90923]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:11 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-27552bc4-a1b9-4005-a47f-d6a1807778aa tempest-SnapshotDependencyTests-1453928896 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b5a8607c-3448-4293-adc7-adaa566ffcce.2dfd2666-ca62-4b45-a47d-8839553dfcb9" returned: 0 in 0.504s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:11 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-27552bc4-a1b9-4005-a47f-d6a1807778aa tempest-SnapshotDependencyTests-1453928896 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5a8607c-3448-4293-adc7-adaa566ffcce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82485) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:02:11 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac1fae9-4524-4fdd-9ec6-4f2e6cafb363]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:02:11 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-27552bc4-a1b9-4005-a47f-d6a1807778aa tempest-SnapshotDependencyTests-1453928896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b5a8607c-3448-4293-adc7-adaa566ffcce {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:12 devstack sudo[90938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b5a8607c-3448-4293-adc7-adaa566ffcce
Apr 15 16:02:12 devstack sudo[90938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:12 devstack sudo[90933]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2.83bb3218-3812-4c5e-bb21-8ccb10ebf640" returned: 0 in 0.469s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:12 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2.83bb3218-3812-4c5e-bb21-8ccb10ebf640 is being set with open permissions: ugo+rw
Apr 15 16:02:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2.83bb3218-3812-4c5e-bb21-8ccb10ebf640 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:12 devstack sudo[90931]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b2744682-495a-4338-86b0-768e068b08c4 tempest-CreateVolumesFromSnapshotTest-222009090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304.6eb6b0a0-2e0f-46d4-a1b5-f0bdbb745443" returned: 0 in 0.542s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b2744682-495a-4338-86b0-768e068b08c4 tempest-CreateVolumesFromSnapshotTest-222009090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304.6eb6b0a0-2e0f-46d4-a1b5-f0bdbb745443 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:12 devstack sudo[90946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2.83bb3218-3812-4c5e-bb21-8ccb10ebf640
Apr 15 16:02:12 devstack sudo[90946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:12 devstack sudo[90947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304.6eb6b0a0-2e0f-46d4-a1b5-f0bdbb745443
Apr 15 16:02:12 devstack sudo[90947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:12 devstack sudo[90938]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-27552bc4-a1b9-4005-a47f-d6a1807778aa tempest-SnapshotDependencyTests-1453928896 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b5a8607c-3448-4293-adc7-adaa566ffcce" returned: 0 in 0.557s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-27552bc4-a1b9-4005-a47f-d6a1807778aa tempest-SnapshotDependencyTests-1453928896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b5a8607c-3448-4293-adc7-adaa566ffcce.2dfd2666-ca62-4b45-a47d-8839553dfcb9 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:12 devstack sudo[90955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b5a8607c-3448-4293-adc7-adaa566ffcce.2dfd2666-ca62-4b45-a47d-8839553dfcb9
Apr 15 16:02:12 devstack sudo[90955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:12 devstack sudo[90946]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2.83bb3218-3812-4c5e-bb21-8ccb10ebf640" returned: 0 in 0.430s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2.info {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:12 devstack sudo[90957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2.info
Apr 15 16:02:12 devstack sudo[90947]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:12 devstack sudo[90957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:12 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b2744682-495a-4338-86b0-768e068b08c4 tempest-CreateVolumesFromSnapshotTest-222009090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304.6eb6b0a0-2e0f-46d4-a1b5-f0bdbb745443" returned: 0 in 0.463s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:12 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-b2744682-495a-4338-86b0-768e068b08c4 tempest-CreateVolumesFromSnapshotTest-222009090 None] Lock "cinder-quobyte-6eb6b0a0-2e0f-46d4-a1b5-f0bdbb745443" released by "_delete_snapshot" :: held 2.156s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:02:12 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-b2744682-495a-4338-86b0-768e068b08c4 tempest-CreateVolumesFromSnapshotTest-222009090 None] Lock "cinder-quobyte-a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304" released by "delete_snapshot" :: held 2.168s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:02:12 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-b2744682-495a-4338-86b0-768e068b08c4 tempest-CreateVolumesFromSnapshotTest-222009090 None] Created reservations ['a68d4fe9-04bc-4495-ae32-9065c3335781', 'bfb91164-468f-4b1a-98b9-d0b23b960441', '3edc6cf0-6171-4368-a423-b8e59f3455a0', '29cd0543-c8b0-42c9-996c-5386e923d002'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:02:12 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-b2744682-495a-4338-86b0-768e068b08c4 tempest-CreateVolumesFromSnapshotTest-222009090 None] Delete snapshot completed successfully.
Apr 15 16:02:12 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-b2744682-495a-4338-86b0-768e068b08c4 tempest-CreateVolumesFromSnapshotTest-222009090 None] Lock "cinder-6eb6b0a0-2e0f-46d4-a1b5-f0bdbb745443-delete_snapshot" released by "delete_snapshot" :: held 2.245s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:02:13 devstack sudo[90955]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:13 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-27552bc4-a1b9-4005-a47f-d6a1807778aa tempest-SnapshotDependencyTests-1453928896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b5a8607c-3448-4293-adc7-adaa566ffcce.2dfd2666-ca62-4b45-a47d-8839553dfcb9" returned: 0 in 0.482s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:13 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-27552bc4-a1b9-4005-a47f-d6a1807778aa tempest-SnapshotDependencyTests-1453928896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b5a8607c-3448-4293-adc7-adaa566ffcce.2dfd2666-ca62-4b45-a47d-8839553dfcb9 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:13 devstack sudo[90963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b5a8607c-3448-4293-adc7-adaa566ffcce.2dfd2666-ca62-4b45-a47d-8839553dfcb9
Apr 15 16:02:13 devstack sudo[90963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:13 devstack sudo[90957]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:13 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2.info" returned: 0 in 0.452s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:13 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2.info is being set with open permissions: ugo+rw
Apr 15 16:02:13 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2.info {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:13 devstack sudo[90965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2.info
Apr 15 16:02:13 devstack sudo[90965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:13 devstack sudo[90963]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:13 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-27552bc4-a1b9-4005-a47f-d6a1807778aa tempest-SnapshotDependencyTests-1453928896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b5a8607c-3448-4293-adc7-adaa566ffcce.2dfd2666-ca62-4b45-a47d-8839553dfcb9" returned: 0 in 0.448s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:13 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-27552bc4-a1b9-4005-a47f-d6a1807778aa tempest-SnapshotDependencyTests-1453928896 None] Lock "cinder-quobyte-2dfd2666-ca62-4b45-a47d-8839553dfcb9" released by "_delete_snapshot" :: held 2.054s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:02:13 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-27552bc4-a1b9-4005-a47f-d6a1807778aa tempest-SnapshotDependencyTests-1453928896 None] Lock "cinder-quobyte-b5a8607c-3448-4293-adc7-adaa566ffcce" released by "delete_snapshot" :: held 2.066s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:02:13 devstack sudo[90965]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:13 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2.info" returned: 0 in 0.453s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:13 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] Acquiring lock "cinder-quobyte-69bd1781-9d2c-467c-8f00-73ac52f4f77e" by "_copy_volume_from_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:02:13 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] Lock "cinder-quobyte-69bd1781-9d2c-467c-8f00-73ac52f4f77e" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:02:13 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] snapshot: 83bb3218-3812-4c5e-bb21-8ccb10ebf640, volume: 69bd1781-9d2c-467c-8f00-73ac52f4f77e,  {{(pid=82485) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 15 16:02:13 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:02:13 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:02:13 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:02:13 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:02:13 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:02:13 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-27552bc4-a1b9-4005-a47f-d6a1807778aa tempest-SnapshotDependencyTests-1453928896 None] Created reservations ['eab9d435-7d5a-4eb2-b8dd-0a64d37f9121', '857ee18a-e83d-4afe-a63d-91d1dc79d8ac', '58ec8db9-7b5b-490f-a712-645bfcfafd0f', '09c5f313-2753-4fce-a918-c9ddcbf1db5d'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:02:13 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a21d80-c60a-4f19-aae6-0d6250efb475]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:02:13 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2.83bb3218-3812-4c5e-bb21-8ccb10ebf640 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:13 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-27552bc4-a1b9-4005-a47f-d6a1807778aa tempest-SnapshotDependencyTests-1453928896 None] Delete snapshot completed successfully.
Apr 15 16:02:13 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-27552bc4-a1b9-4005-a47f-d6a1807778aa tempest-SnapshotDependencyTests-1453928896 None] Lock "cinder-2dfd2666-ca62-4b45-a47d-8839553dfcb9-delete_snapshot" released by "delete_snapshot" :: held 2.187s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:02:13 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-f1d3444a-f02c-425a-b3c7-1918ab88ea19 tempest-CreateVolumesFromSnapshotTest-222009090 None] Acquiring lock "cinder-a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:02:13 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-f1d3444a-f02c-425a-b3c7-1918ab88ea19 tempest-CreateVolumesFromSnapshotTest-222009090 None] Lock "cinder-a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:02:13 devstack sudo[90969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2.83bb3218-3812-4c5e-bb21-8ccb10ebf640
Apr 15 16:02:13 devstack sudo[90969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:13 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-f1d3444a-f02c-425a-b3c7-1918ab88ea19 tempest-CreateVolumesFromSnapshotTest-222009090 None] Acquiring lock "cinder-quobyte-a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:02:13 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-f1d3444a-f02c-425a-b3c7-1918ab88ea19 tempest-CreateVolumesFromSnapshotTest-222009090 None] Lock "cinder-quobyte-a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304" acquired by "delete_volume" :: waited 0.011s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:02:13 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38f27d7-e1a6-41b4-a7cd-089531d84398]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:02:13 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-f1d3444a-f02c-425a-b3c7-1918ab88ea19 tempest-CreateVolumesFromSnapshotTest-222009090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:13 devstack sudo[90971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304
Apr 15 16:02:13 devstack sudo[90971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:14 devstack sudo[90969]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:14 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2.83bb3218-3812-4c5e-bb21-8ccb10ebf640" returned: 0 in 0.480s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:14 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82485) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:02:14 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] will copy from snapshot at /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2 {{(pid=82485) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 15 16:02:14 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] Creating direct copy from snapshot {{(pid=82485) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 15 16:02:14 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee185eba-7ba6-4b2a-b0a0-5dbc256ed26d]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:02:14 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:14 devstack sudo[90976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2
Apr 15 16:02:14 devstack sudo[90976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:14 devstack sudo[90971]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:14 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-f1d3444a-f02c-425a-b3c7-1918ab88ea19 tempest-CreateVolumesFromSnapshotTest-222009090 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304" returned: 0 in 0.467s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:14 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-f1d3444a-f02c-425a-b3c7-1918ab88ea19 tempest-CreateVolumesFromSnapshotTest-222009090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:14 devstack sudo[90981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304
Apr 15 16:02:14 devstack sudo[90981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:14 devstack sudo[90976]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:14 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2" returned: 0 in 0.491s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:14 devstack cinder-volume[82485]: DEBUG cinder.utils [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] Path /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-69bd1781-9d2c-467c-8f00-73ac52f4f77e not found in is_blk_device check {{(pid=82485) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 15 16:02:14 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-69bd1781-9d2c-467c-8f00-73ac52f4f77e {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:14 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-b460fd05-4f76-4d6d-9fd8-134399fabfab tempest-SnapshotDependencyTests-1453928896 None] Acquiring lock "cinder-b5a8607c-3448-4293-adc7-adaa566ffcce-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:02:14 devstack sudo[90988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-69bd1781-9d2c-467c-8f00-73ac52f4f77e
Apr 15 16:02:14 devstack sudo[90988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:14 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-b460fd05-4f76-4d6d-9fd8-134399fabfab tempest-SnapshotDependencyTests-1453928896 None] Lock "cinder-b5a8607c-3448-4293-adc7-adaa566ffcce-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:02:14 devstack sudo[90981]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:14 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-b460fd05-4f76-4d6d-9fd8-134399fabfab tempest-SnapshotDependencyTests-1453928896 None] Acquiring lock "cinder-quobyte-b5a8607c-3448-4293-adc7-adaa566ffcce" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:02:14 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-f1d3444a-f02c-425a-b3c7-1918ab88ea19 tempest-CreateVolumesFromSnapshotTest-222009090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304" returned: 0 in 0.449s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:14 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-f1d3444a-f02c-425a-b3c7-1918ab88ea19 tempest-CreateVolumesFromSnapshotTest-222009090 None] Lock "cinder-quobyte-a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304" released by "delete_volume" :: held 0.953s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:02:14 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-b460fd05-4f76-4d6d-9fd8-134399fabfab tempest-SnapshotDependencyTests-1453928896 None] Lock "cinder-quobyte-b5a8607c-3448-4293-adc7-adaa566ffcce" acquired by "delete_volume" :: waited 0.029s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:02:14 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc595ee-a218-45e6-90d7-780818ad3608]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:02:14 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b460fd05-4f76-4d6d-9fd8-134399fabfab tempest-SnapshotDependencyTests-1453928896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b5a8607c-3448-4293-adc7-adaa566ffcce {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:14 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-f1d3444a-f02c-425a-b3c7-1918ab88ea19 tempest-CreateVolumesFromSnapshotTest-222009090 None] Created reservations ['eb69a284-3c94-4396-b015-152ab703e05f', 'd8d40821-2e06-4e8b-8627-36e243fa1fab', '746f0b67-1ab6-4175-bf1f-5ec7a55734da', 'd76877e2-1bee-490b-bf10-9d7fd4657eb8'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:02:14 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-f1d3444a-f02c-425a-b3c7-1918ab88ea19 tempest-CreateVolumesFromSnapshotTest-222009090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:02:14 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-f1d3444a-f02c-425a-b3c7-1918ab88ea19 tempest-CreateVolumesFromSnapshotTest-222009090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:02:14 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-f1d3444a-f02c-425a-b3c7-1918ab88ea19 tempest-CreateVolumesFromSnapshotTest-222009090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:02:14 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-f1d3444a-f02c-425a-b3c7-1918ab88ea19 tempest-CreateVolumesFromSnapshotTest-222009090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:02:14 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-f1d3444a-f02c-425a-b3c7-1918ab88ea19 tempest-CreateVolumesFromSnapshotTest-222009090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:02:14 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-f1d3444a-f02c-425a-b3c7-1918ab88ea19 tempest-CreateVolumesFromSnapshotTest-222009090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:14 devstack sudo[90990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b5a8607c-3448-4293-adc7-adaa566ffcce
Apr 15 16:02:14 devstack sudo[90990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:14 devstack sudo[90991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 16:02:14 devstack sudo[90991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:15 devstack sudo[90991]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:15 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-f1d3444a-f02c-425a-b3c7-1918ab88ea19 tempest-CreateVolumesFromSnapshotTest-222009090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.716s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:15 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-f1d3444a-f02c-425a-b3c7-1918ab88ea19 tempest-CreateVolumesFromSnapshotTest-222009090 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:02:15 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-f1d3444a-f02c-425a-b3c7-1918ab88ea19 tempest-CreateVolumesFromSnapshotTest-222009090 None] Deleted volume successfully.
Apr 15 16:02:15 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-f1d3444a-f02c-425a-b3c7-1918ab88ea19 tempest-CreateVolumesFromSnapshotTest-222009090 None] Lock "cinder-a4ae9dc4-987c-4aa1-9d5f-58d3fea5d304-delete_volume" released by "delete_volume" :: held 1.842s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:02:15 devstack sudo[90990]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:15 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b460fd05-4f76-4d6d-9fd8-134399fabfab tempest-SnapshotDependencyTests-1453928896 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b5a8607c-3448-4293-adc7-adaa566ffcce" returned: 0 in 0.826s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:15 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b460fd05-4f76-4d6d-9fd8-134399fabfab tempest-SnapshotDependencyTests-1453928896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b5a8607c-3448-4293-adc7-adaa566ffcce {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:15 devstack sudo[91008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b5a8607c-3448-4293-adc7-adaa566ffcce
Apr 15 16:02:15 devstack sudo[91008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:16 devstack sudo[91008]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:16 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b460fd05-4f76-4d6d-9fd8-134399fabfab tempest-SnapshotDependencyTests-1453928896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b5a8607c-3448-4293-adc7-adaa566ffcce" returned: 0 in 1.490s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:16 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-b460fd05-4f76-4d6d-9fd8-134399fabfab tempest-SnapshotDependencyTests-1453928896 None] Lock "cinder-quobyte-b5a8607c-3448-4293-adc7-adaa566ffcce" released by "delete_volume" :: held 2.355s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:02:17 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-b460fd05-4f76-4d6d-9fd8-134399fabfab tempest-SnapshotDependencyTests-1453928896 None] Created reservations ['8e80ff06-651c-4129-83dd-82b312440c92', 'b81e444a-0f89-43d4-9f66-1aa23c8b0620', '5cb99c98-0ab0-4c47-b508-8509aabcc030', '87d28e6c-44d5-4d81-ae9e-f82717e7a8c9'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:02:17 devstack sudo[90988]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:17 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-69bd1781-9d2c-467c-8f00-73ac52f4f77e" returned: 0 in 2.502s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:17 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[cded5804-d746-4537-91a1-817c3fe99c97]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:02:17 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:17 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-b460fd05-4f76-4d6d-9fd8-134399fabfab tempest-SnapshotDependencyTests-1453928896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:02:17 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-b460fd05-4f76-4d6d-9fd8-134399fabfab tempest-SnapshotDependencyTests-1453928896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:02:17 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-b460fd05-4f76-4d6d-9fd8-134399fabfab tempest-SnapshotDependencyTests-1453928896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:02:17 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-b460fd05-4f76-4d6d-9fd8-134399fabfab tempest-SnapshotDependencyTests-1453928896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:02:17 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-b460fd05-4f76-4d6d-9fd8-134399fabfab tempest-SnapshotDependencyTests-1453928896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:02:17 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b460fd05-4f76-4d6d-9fd8-134399fabfab tempest-SnapshotDependencyTests-1453928896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:17 devstack sudo[91013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 16:02:17 devstack sudo[91013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:17 devstack sudo[91012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2
Apr 15 16:02:17 devstack sudo[91012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:17 devstack sudo[91013]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:17 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-b460fd05-4f76-4d6d-9fd8-134399fabfab tempest-SnapshotDependencyTests-1453928896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.493s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:17 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-b460fd05-4f76-4d6d-9fd8-134399fabfab tempest-SnapshotDependencyTests-1453928896 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:02:17 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-b460fd05-4f76-4d6d-9fd8-134399fabfab tempest-SnapshotDependencyTests-1453928896 None] Deleted volume successfully.
Apr 15 16:02:17 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-b460fd05-4f76-4d6d-9fd8-134399fabfab tempest-SnapshotDependencyTests-1453928896 None] Lock "cinder-b5a8607c-3448-4293-adc7-adaa566ffcce-delete_volume" released by "delete_volume" :: held 3.054s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:02:17 devstack sudo[91012]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:17 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2" returned: 0 in 0.728s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:17 devstack cinder-volume[82485]: DEBUG cinder.image.image_utils [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] Image conversion details: src /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2, size 1024.00 MB, duration 2.50 sec, destination /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-69bd1781-9d2c-467c-8f00-73ac52f4f77e {{(pid=82485) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 16:02:17 devstack cinder-volume[82485]: INFO cinder.image.image_utils [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] Converted 1024.00 MB image at 409.09 MB/s
Apr 15 16:02:17 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-69bd1781-9d2c-467c-8f00-73ac52f4f77e is being set with open permissions: ugo+rw
Apr 15 16:02:17 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-69bd1781-9d2c-467c-8f00-73ac52f4f77e {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:17 devstack sudo[91020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-69bd1781-9d2c-467c-8f00-73ac52f4f77e
Apr 15 16:02:17 devstack sudo[91020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:18 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-8d0e7a3e-81d7-4ab5-ad93-cb9c4d893b1b tempest-SnapshotDependencyTests-1453928896 None] Acquiring lock "cinder-95158fed-708d-4e9f-bae2-c7e28c13e16f-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:02:18 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-8d0e7a3e-81d7-4ab5-ad93-cb9c4d893b1b tempest-SnapshotDependencyTests-1453928896 None] Lock "cinder-95158fed-708d-4e9f-bae2-c7e28c13e16f-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:02:18 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-8d0e7a3e-81d7-4ab5-ad93-cb9c4d893b1b tempest-SnapshotDependencyTests-1453928896 None] Acquiring lock "cinder-quobyte-95158fed-708d-4e9f-bae2-c7e28c13e16f" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:02:18 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-8d0e7a3e-81d7-4ab5-ad93-cb9c4d893b1b tempest-SnapshotDependencyTests-1453928896 None] Lock "cinder-quobyte-95158fed-708d-4e9f-bae2-c7e28c13e16f" acquired by "delete_volume" :: waited 0.014s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:02:18 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c8fa3e-b296-43e9-8c71-641f4d930924]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:02:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-8d0e7a3e-81d7-4ab5-ad93-cb9c4d893b1b tempest-SnapshotDependencyTests-1453928896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-95158fed-708d-4e9f-bae2-c7e28c13e16f {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:18 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-886a21c0-0643-491c-90ae-955bf83d8212 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:02:18 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-886a21c0-0643-491c-90ae-955bf83d8212 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Flow 'volume_create_manager' (0053b91c-886e-4bc0-9476-5baec686abfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:02:18 devstack sudo[91022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-95158fed-708d-4e9f-bae2-c7e28c13e16f
Apr 15 16:02:18 devstack sudo[91022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:18 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-886a21c0-0643-491c-90ae-955bf83d8212 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6ed80e0-7ff0-4c2c-8c34-aa96794b8c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:02:18 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-886a21c0-0643-491c-90ae-955bf83d8212 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6ed80e0-7ff0-4c2c-8c34-aa96794b8c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:02:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-698046662',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe65e87d-511b-445c-bd18-a09ddaa6e1bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72c166a37cdf40dbaf86294cd75cbe31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:02:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:02:18Z,use_quota=True,user_id='69ea27617db748609db32495a9885578',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:02:18 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-886a21c0-0643-491c-90ae-955bf83d8212 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed52f87e-5ebe-4fce-be3e-ee9e011df8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:02:18 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-886a21c0-0643-491c-90ae-955bf83d8212 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed52f87e-5ebe-4fce-be3e-ee9e011df8d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:02:18 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-886a21c0-0643-491c-90ae-955bf83d8212 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa47f19c-1979-47d2-8bd3-7b93346e84cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:02:18 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-886a21c0-0643-491c-90ae-955bf83d8212 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa47f19c-1979-47d2-8bd3-7b93346e84cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe65e87d-511b-445c-bd18-a09ddaa6e1bf', 'volume_name': 'volume-fe65e87d-511b-445c-bd18-a09ddaa6e1bf', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:02:18 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-886a21c0-0643-491c-90ae-955bf83d8212 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd96c7b9-51ca-4eb7-8f0b-82b85b925022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:02:18 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-886a21c0-0643-491c-90ae-955bf83d8212 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd96c7b9-51ca-4eb7-8f0b-82b85b925022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:02:18 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-886a21c0-0643-491c-90ae-955bf83d8212 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b13ac0e-f1be-458d-a320-ffc1debb1cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:02:18 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-886a21c0-0643-491c-90ae-955bf83d8212 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Volume fe65e87d-511b-445c-bd18-a09ddaa6e1bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe65e87d-511b-445c-bd18-a09ddaa6e1bf', 'volume_size': 1}
Apr 15 16:02:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-886a21c0-0643-491c-90ae-955bf83d8212 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:02:18 devstack sudo[91020]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-69bd1781-9d2c-467c-8f00-73ac52f4f77e" returned: 0 in 0.467s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:18 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] Lock "cinder-quobyte-69bd1781-9d2c-467c-8f00-73ac52f4f77e" released by "_copy_volume_from_snapshot" :: held 4.735s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:02:18 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] Acquiring lock "cinder-quobyte-83bb3218-3812-4c5e-bb21-8ccb10ebf640" by "_delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:02:18 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] Lock "cinder-quobyte-83bb3218-3812-4c5e-bb21-8ccb10ebf640" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:02:18 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] Deleting offline snapshot 83bb3218-3812-4c5e-bb21-8ccb10ebf640 of volume 1fd72c08-55c0-4f3e-98c6-35050d1f56f2 {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 16:02:18 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] snapshot_file for this snap is: volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2.83bb3218-3812-4c5e-bb21-8ccb10ebf640 {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 16:02:18 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[418e2671-b09e-42b7-a05d-eb5995cc608a]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:02:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2.83bb3218-3812-4c5e-bb21-8ccb10ebf640 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:18 devstack sudo[91025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2.83bb3218-3812-4c5e-bb21-8ccb10ebf640
Apr 15 16:02:18 devstack sudo[91025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:18 devstack sudo[91022]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-8d0e7a3e-81d7-4ab5-ad93-cb9c4d893b1b tempest-SnapshotDependencyTests-1453928896 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-95158fed-708d-4e9f-bae2-c7e28c13e16f" returned: 0 in 0.516s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-8d0e7a3e-81d7-4ab5-ad93-cb9c4d893b1b tempest-SnapshotDependencyTests-1453928896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-95158fed-708d-4e9f-bae2-c7e28c13e16f {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:18 devstack sudo[91030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-95158fed-708d-4e9f-bae2-c7e28c13e16f
Apr 15 16:02:18 devstack sudo[91030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:18 devstack sudo[91025]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2.83bb3218-3812-4c5e-bb21-8ccb10ebf640" returned: 0 in 0.487s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:18 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82485) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:02:18 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc13dee8-29a8-4d3c-9b80-d0d826d51df0]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:02:18 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:18 devstack sudo[91035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2
Apr 15 16:02:18 devstack sudo[91035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:19 devstack sudo[91030]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-8d0e7a3e-81d7-4ab5-ad93-cb9c4d893b1b tempest-SnapshotDependencyTests-1453928896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-95158fed-708d-4e9f-bae2-c7e28c13e16f" returned: 0 in 0.411s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:19 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-8d0e7a3e-81d7-4ab5-ad93-cb9c4d893b1b tempest-SnapshotDependencyTests-1453928896 None] Lock "cinder-quobyte-95158fed-708d-4e9f-bae2-c7e28c13e16f" released by "delete_volume" :: held 0.950s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:02:19 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-8d0e7a3e-81d7-4ab5-ad93-cb9c4d893b1b tempest-SnapshotDependencyTests-1453928896 None] Created reservations ['cdc0c6a8-feed-4a84-9f0a-7efbbeaae43f', '85041ac1-ddcb-4574-91ff-8510024e6df4', 'cec4ea4d-64ba-416d-81b2-7f109a66a1d4', '45bcded9-0cc7-45b5-a805-2a8f828b035e'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:02:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-8d0e7a3e-81d7-4ab5-ad93-cb9c4d893b1b tempest-SnapshotDependencyTests-1453928896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:02:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-8d0e7a3e-81d7-4ab5-ad93-cb9c4d893b1b tempest-SnapshotDependencyTests-1453928896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:02:19 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-8d0e7a3e-81d7-4ab5-ad93-cb9c4d893b1b tempest-SnapshotDependencyTests-1453928896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:02:19 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-8d0e7a3e-81d7-4ab5-ad93-cb9c4d893b1b tempest-SnapshotDependencyTests-1453928896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:02:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-8d0e7a3e-81d7-4ab5-ad93-cb9c4d893b1b tempest-SnapshotDependencyTests-1453928896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:02:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-8d0e7a3e-81d7-4ab5-ad93-cb9c4d893b1b tempest-SnapshotDependencyTests-1453928896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:19 devstack sudo[91038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 16:02:19 devstack sudo[91038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:19 devstack sudo[91035]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2" returned: 0 in 0.537s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2.83bb3218-3812-4c5e-bb21-8ccb10ebf640 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:19 devstack sudo[91043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2.83bb3218-3812-4c5e-bb21-8ccb10ebf640
Apr 15 16:02:19 devstack sudo[91043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:19 devstack sudo[91038]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-8d0e7a3e-81d7-4ab5-ad93-cb9c4d893b1b tempest-SnapshotDependencyTests-1453928896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.510s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:19 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-8d0e7a3e-81d7-4ab5-ad93-cb9c4d893b1b tempest-SnapshotDependencyTests-1453928896 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:02:19 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-8d0e7a3e-81d7-4ab5-ad93-cb9c4d893b1b tempest-SnapshotDependencyTests-1453928896 None] Deleted volume successfully.
Apr 15 16:02:19 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-8d0e7a3e-81d7-4ab5-ad93-cb9c4d893b1b tempest-SnapshotDependencyTests-1453928896 None] Lock "cinder-95158fed-708d-4e9f-bae2-c7e28c13e16f-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:02:19 devstack sudo[91043]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2.83bb3218-3812-4c5e-bb21-8ccb10ebf640" returned: 0 in 0.568s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:19 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2.83bb3218-3812-4c5e-bb21-8ccb10ebf640 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:19 devstack sudo[91049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2.83bb3218-3812-4c5e-bb21-8ccb10ebf640
Apr 15 16:02:19 devstack sudo[91049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:20 devstack sudo[91049]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:20 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2.83bb3218-3812-4c5e-bb21-8ccb10ebf640" returned: 0 in 0.442s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:20 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] Lock "cinder-quobyte-83bb3218-3812-4c5e-bb21-8ccb10ebf640" released by "_delete_snapshot" :: held 2.100s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:02:20 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.857s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:02:20 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-a7340d7c-f469-43f0-acbf-bf53a5ac834b tempest-CinderUnicodeTest-847668735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 13.501s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:02:20 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b72675e7-7337-4eab-89a4-9efe58e0d5b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69bd1781-9d2c-467c-8f00-73ac52f4f77e', 'volume_size': 1, 'source_volid': '1fd72c08-55c0-4f3e-98c6-35050d1f56f2', 'source_volstatus': 'available'}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:02:20 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c728d0d-8662-4a43-ad01-fb6d5fb6a8fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:02:20 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-a7340d7c-f469-43f0-acbf-bf53a5ac834b tempest-CinderUnicodeTest-847668735 None] Creating offline snapshot daec03be-3178-4b21-8fa5-6906fdc1f10d of volume 18620bde-da65-4deb-823c-625134fcc6e4 {{(pid=82485) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 16:02:20 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] Volume volume-69bd1781-9d2c-467c-8f00-73ac52f4f77e (69bd1781-9d2c-467c-8f00-73ac52f4f77e): created successfully
Apr 15 16:02:20 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c728d0d-8662-4a43-ad01-fb6d5fb6a8fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:02:20 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] Flow 'volume_create_manager' (0eb872af-8fa5-4626-9a5a-610fa92d09e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:02:20 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[81321fa1-b829-4514-bc55-ca83672be6f0]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:02:20 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-a7340d7c-f469-43f0-acbf-bf53a5ac834b tempest-CinderUnicodeTest-847668735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-18620bde-da65-4deb-823c-625134fcc6e4 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:20 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-4b8e3545-5292-4ccb-86cd-2fb0517b4d31 tempest-VolumeDependencyTests-972921078 None] Created volume successfully.
Apr 15 16:02:20 devstack sudo[91053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-18620bde-da65-4deb-823c-625134fcc6e4
Apr 15 16:02:20 devstack sudo[91053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:20 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-294c00fd-f54a-4208-9e90-a23221aeff17 tempest-VolumeDependencyTests-972921078 None] Acquiring lock "cinder-1fd72c08-55c0-4f3e-98c6-35050d1f56f2-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:02:20 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-294c00fd-f54a-4208-9e90-a23221aeff17 tempest-VolumeDependencyTests-972921078 None] Lock "cinder-1fd72c08-55c0-4f3e-98c6-35050d1f56f2-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:02:20 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-294c00fd-f54a-4208-9e90-a23221aeff17 tempest-VolumeDependencyTests-972921078 None] Acquiring lock "cinder-quobyte-1fd72c08-55c0-4f3e-98c6-35050d1f56f2" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:02:20 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-294c00fd-f54a-4208-9e90-a23221aeff17 tempest-VolumeDependencyTests-972921078 None] Lock "cinder-quobyte-1fd72c08-55c0-4f3e-98c6-35050d1f56f2" acquired by "delete_volume" :: waited 0.008s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:02:20 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6589d15-0924-4406-a6e6-fd6f9beb8b8a]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:02:20 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-294c00fd-f54a-4208-9e90-a23221aeff17 tempest-VolumeDependencyTests-972921078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:20 devstack sudo[91055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2
Apr 15 16:02:20 devstack sudo[91055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:21 devstack sudo[91053]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-a7340d7c-f469-43f0-acbf-bf53a5ac834b tempest-CinderUnicodeTest-847668735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-18620bde-da65-4deb-823c-625134fcc6e4" returned: 0 in 0.566s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-a7340d7c-f469-43f0-acbf-bf53a5ac834b tempest-CinderUnicodeTest-847668735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-18620bde-da65-4deb-823c-625134fcc6e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-18620bde-da65-4deb-823c-625134fcc6e4.daec03be-3178-4b21-8fa5-6906fdc1f10d 1G {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:21 devstack sudo[91060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-18620bde-da65-4deb-823c-625134fcc6e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-18620bde-da65-4deb-823c-625134fcc6e4.daec03be-3178-4b21-8fa5-6906fdc1f10d 1G
Apr 15 16:02:21 devstack sudo[91060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:21 devstack sudo[91055]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-294c00fd-f54a-4208-9e90-a23221aeff17 tempest-VolumeDependencyTests-972921078 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2" returned: 0 in 0.639s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-294c00fd-f54a-4208-9e90-a23221aeff17 tempest-VolumeDependencyTests-972921078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:21 devstack sudo[91068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2
Apr 15 16:02:21 devstack sudo[91068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:21 devstack sudo[91060]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-a7340d7c-f469-43f0-acbf-bf53a5ac834b tempest-CinderUnicodeTest-847668735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-18620bde-da65-4deb-823c-625134fcc6e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-18620bde-da65-4deb-823c-625134fcc6e4.daec03be-3178-4b21-8fa5-6906fdc1f10d 1G" returned: 0 in 0.570s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:21 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-a7340d7c-f469-43f0-acbf-bf53a5ac834b tempest-CinderUnicodeTest-847668735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18620bde-da65-4deb-823c-625134fcc6e4 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-18620bde-da65-4deb-823c-625134fcc6e4.daec03be-3178-4b21-8fa5-6906fdc1f10d {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:21 devstack sudo[91070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18620bde-da65-4deb-823c-625134fcc6e4 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-18620bde-da65-4deb-823c-625134fcc6e4.daec03be-3178-4b21-8fa5-6906fdc1f10d
Apr 15 16:02:21 devstack sudo[91070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:22 devstack sudo[91068]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:22 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-294c00fd-f54a-4208-9e90-a23221aeff17 tempest-VolumeDependencyTests-972921078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-1fd72c08-55c0-4f3e-98c6-35050d1f56f2" returned: 0 in 0.507s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:22 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-294c00fd-f54a-4208-9e90-a23221aeff17 tempest-VolumeDependencyTests-972921078 None] Lock "cinder-quobyte-1fd72c08-55c0-4f3e-98c6-35050d1f56f2" released by "delete_volume" :: held 1.190s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:02:22 devstack sudo[91070]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:22 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-a7340d7c-f469-43f0-acbf-bf53a5ac834b tempest-CinderUnicodeTest-847668735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18620bde-da65-4deb-823c-625134fcc6e4 -F qcow2 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-18620bde-da65-4deb-823c-625134fcc6e4.daec03be-3178-4b21-8fa5-6906fdc1f10d" returned: 0 in 0.472s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:22 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-a7340d7c-f469-43f0-acbf-bf53a5ac834b tempest-CinderUnicodeTest-847668735 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-18620bde-da65-4deb-823c-625134fcc6e4.daec03be-3178-4b21-8fa5-6906fdc1f10d is being set with open permissions: ugo+rw
Apr 15 16:02:22 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-a7340d7c-f469-43f0-acbf-bf53a5ac834b tempest-CinderUnicodeTest-847668735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-18620bde-da65-4deb-823c-625134fcc6e4.daec03be-3178-4b21-8fa5-6906fdc1f10d {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:22 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-294c00fd-f54a-4208-9e90-a23221aeff17 tempest-VolumeDependencyTests-972921078 None] Created reservations ['ebf5785a-9dbe-4a8e-9d91-6875c9f8ebaf', '546209ec-3c56-47d5-8c14-c03a136e524d', '2238647a-2cd0-42af-9c29-7dfbbcb82c7c', '15b6041d-6e19-40d6-a66d-0b99877e7afb'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:02:22 devstack sudo[91077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-18620bde-da65-4deb-823c-625134fcc6e4.daec03be-3178-4b21-8fa5-6906fdc1f10d
Apr 15 16:02:22 devstack sudo[91077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:22 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-294c00fd-f54a-4208-9e90-a23221aeff17 tempest-VolumeDependencyTests-972921078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:02:22 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-294c00fd-f54a-4208-9e90-a23221aeff17 tempest-VolumeDependencyTests-972921078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:02:22 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-294c00fd-f54a-4208-9e90-a23221aeff17 tempest-VolumeDependencyTests-972921078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:02:22 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-294c00fd-f54a-4208-9e90-a23221aeff17 tempest-VolumeDependencyTests-972921078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:02:22 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-294c00fd-f54a-4208-9e90-a23221aeff17 tempest-VolumeDependencyTests-972921078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:02:22 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-294c00fd-f54a-4208-9e90-a23221aeff17 tempest-VolumeDependencyTests-972921078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:22 devstack sudo[91079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 16:02:22 devstack sudo[91079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:22 devstack sudo[91077]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:22 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-a7340d7c-f469-43f0-acbf-bf53a5ac834b tempest-CinderUnicodeTest-847668735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-18620bde-da65-4deb-823c-625134fcc6e4.daec03be-3178-4b21-8fa5-6906fdc1f10d" returned: 0 in 0.520s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:22 devstack sudo[91079]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:22 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-294c00fd-f54a-4208-9e90-a23221aeff17 tempest-VolumeDependencyTests-972921078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.474s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:22 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-294c00fd-f54a-4208-9e90-a23221aeff17 tempest-VolumeDependencyTests-972921078 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:02:22 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-a7340d7c-f469-43f0-acbf-bf53a5ac834b tempest-CinderUnicodeTest-847668735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-18620bde-da65-4deb-823c-625134fcc6e4.info {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:22 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-294c00fd-f54a-4208-9e90-a23221aeff17 tempest-VolumeDependencyTests-972921078 None] Deleted volume successfully.
Apr 15 16:02:22 devstack sudo[91083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-18620bde-da65-4deb-823c-625134fcc6e4.info
Apr 15 16:02:22 devstack sudo[91083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:22 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-294c00fd-f54a-4208-9e90-a23221aeff17 tempest-VolumeDependencyTests-972921078 None] Lock "cinder-1fd72c08-55c0-4f3e-98c6-35050d1f56f2-delete_volume" released by "delete_volume" :: held 1.840s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:02:23 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-ac304679-bddf-4164-b920-97872b40d383 tempest-VolumeDependencyTests-972921078 None] Acquiring lock "cinder-69bd1781-9d2c-467c-8f00-73ac52f4f77e-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:02:23 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-ac304679-bddf-4164-b920-97872b40d383 tempest-VolumeDependencyTests-972921078 None] Lock "cinder-69bd1781-9d2c-467c-8f00-73ac52f4f77e-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:02:23 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-ac304679-bddf-4164-b920-97872b40d383 tempest-VolumeDependencyTests-972921078 None] Acquiring lock "cinder-quobyte-69bd1781-9d2c-467c-8f00-73ac52f4f77e" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:02:23 devstack sudo[91083]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:23 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-a7340d7c-f469-43f0-acbf-bf53a5ac834b tempest-CinderUnicodeTest-847668735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-18620bde-da65-4deb-823c-625134fcc6e4.info" returned: 0 in 0.440s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:23 devstack cinder-volume[82485]: WARNING cinder.volume.drivers.remotefs [None req-a7340d7c-f469-43f0-acbf-bf53a5ac834b tempest-CinderUnicodeTest-847668735 None] /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-18620bde-da65-4deb-823c-625134fcc6e4.info is being set with open permissions: ugo+rw
Apr 15 16:02:23 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-a7340d7c-f469-43f0-acbf-bf53a5ac834b tempest-CinderUnicodeTest-847668735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-18620bde-da65-4deb-823c-625134fcc6e4.info {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:23 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-ac304679-bddf-4164-b920-97872b40d383 tempest-VolumeDependencyTests-972921078 None] Lock "cinder-quobyte-69bd1781-9d2c-467c-8f00-73ac52f4f77e" acquired by "delete_volume" :: waited 0.020s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:02:23 devstack sudo[91087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-18620bde-da65-4deb-823c-625134fcc6e4.info
Apr 15 16:02:23 devstack sudo[91087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:23 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[492969f3-9cbc-4931-8be5-0e5955945d4f]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:02:23 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ac304679-bddf-4164-b920-97872b40d383 tempest-VolumeDependencyTests-972921078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-69bd1781-9d2c-467c-8f00-73ac52f4f77e {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:23 devstack sudo[91089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-69bd1781-9d2c-467c-8f00-73ac52f4f77e
Apr 15 16:02:23 devstack sudo[91089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:23 devstack sudo[91087]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:23 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-a7340d7c-f469-43f0-acbf-bf53a5ac834b tempest-CinderUnicodeTest-847668735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-18620bde-da65-4deb-823c-625134fcc6e4.info" returned: 0 in 0.429s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:23 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-a7340d7c-f469-43f0-acbf-bf53a5ac834b tempest-CinderUnicodeTest-847668735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.090s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:02:23 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-886a21c0-0643-491c-90ae-955bf83d8212 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.287s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:02:23 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-886a21c0-0643-491c-90ae-955bf83d8212 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:02:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-698046662',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe65e87d-511b-445c-bd18-a09ddaa6e1bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72c166a37cdf40dbaf86294cd75cbe31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:02:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:02:18Z,use_quota=True,user_id='69ea27617db748609db32495a9885578',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:02:23 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-886a21c0-0643-491c-90ae-955bf83d8212 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Creating volume fe65e87d-511b-445c-bd18-a09ddaa6e1bf {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:02:23 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-886a21c0-0643-491c-90ae-955bf83d8212 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:02:23 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-886a21c0-0643-491c-90ae-955bf83d8212 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:02:23 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-886a21c0-0643-491c-90ae-955bf83d8212 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:02:23 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-886a21c0-0643-491c-90ae-955bf83d8212 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:02:23 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-886a21c0-0643-491c-90ae-955bf83d8212 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:02:23 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-886a21c0-0643-491c-90ae-955bf83d8212 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:02:23 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-886a21c0-0643-491c-90ae-955bf83d8212 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 16:02:23 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-886a21c0-0643-491c-90ae-955bf83d8212 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fe65e87d-511b-445c-bd18-a09ddaa6e1bf 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:23 devstack sudo[91095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fe65e87d-511b-445c-bd18-a09ddaa6e1bf 1073741824
Apr 15 16:02:23 devstack sudo[91095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:23 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-a7340d7c-f469-43f0-acbf-bf53a5ac834b tempest-CinderUnicodeTest-847668735 None] Create snapshot completed successfully
Apr 15 16:02:23 devstack sudo[91089]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:23 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ac304679-bddf-4164-b920-97872b40d383 tempest-VolumeDependencyTests-972921078 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-69bd1781-9d2c-467c-8f00-73ac52f4f77e" returned: 0 in 0.503s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:23 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ac304679-bddf-4164-b920-97872b40d383 tempest-VolumeDependencyTests-972921078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-69bd1781-9d2c-467c-8f00-73ac52f4f77e {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:23 devstack sudo[91097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-69bd1781-9d2c-467c-8f00-73ac52f4f77e
Apr 15 16:02:23 devstack sudo[91097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:24 devstack sudo[91097]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:24 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ac304679-bddf-4164-b920-97872b40d383 tempest-VolumeDependencyTests-972921078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-69bd1781-9d2c-467c-8f00-73ac52f4f77e" returned: 0 in 0.527s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:24 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-ac304679-bddf-4164-b920-97872b40d383 tempest-VolumeDependencyTests-972921078 None] Lock "cinder-quobyte-69bd1781-9d2c-467c-8f00-73ac52f4f77e" released by "delete_volume" :: held 1.058s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:02:24 devstack sudo[91095]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:24 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-ac304679-bddf-4164-b920-97872b40d383 tempest-VolumeDependencyTests-972921078 None] Created reservations ['f0dd548f-852f-403f-bbbf-9f7efdfe3c2a', 'c8d8f8c7-8e41-4975-b658-5a14ea86263b', '2bf3f107-c44f-484c-8b3b-4f9a4923c7ba', '09867c27-c3b9-4565-9e71-bb5226ba3324'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:02:24 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-886a21c0-0643-491c-90ae-955bf83d8212 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fe65e87d-511b-445c-bd18-a09ddaa6e1bf 1073741824" returned: 0 in 0.674s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:24 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-886a21c0-0643-491c-90ae-955bf83d8212 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fe65e87d-511b-445c-bd18-a09ddaa6e1bf {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:24 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-ac304679-bddf-4164-b920-97872b40d383 tempest-VolumeDependencyTests-972921078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:02:24 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-ac304679-bddf-4164-b920-97872b40d383 tempest-VolumeDependencyTests-972921078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:02:24 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-ac304679-bddf-4164-b920-97872b40d383 tempest-VolumeDependencyTests-972921078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:02:24 devstack sudo[91103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fe65e87d-511b-445c-bd18-a09ddaa6e1bf
Apr 15 16:02:24 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-ac304679-bddf-4164-b920-97872b40d383 tempest-VolumeDependencyTests-972921078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:02:24 devstack sudo[91103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:24 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-ac304679-bddf-4164-b920-97872b40d383 tempest-VolumeDependencyTests-972921078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:02:24 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ac304679-bddf-4164-b920-97872b40d383 tempest-VolumeDependencyTests-972921078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:24 devstack sudo[91105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 16:02:24 devstack sudo[91105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:24 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-27ce70a1-2e9f-4a22-a928-241388056874 tempest-CinderUnicodeTest-847668735 None] Acquiring lock "cinder-daec03be-3178-4b21-8fa5-6906fdc1f10d-delete_snapshot" by "delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:02:24 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-27ce70a1-2e9f-4a22-a928-241388056874 tempest-CinderUnicodeTest-847668735 None] Lock "cinder-daec03be-3178-4b21-8fa5-6906fdc1f10d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:02:24 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-27ce70a1-2e9f-4a22-a928-241388056874 tempest-CinderUnicodeTest-847668735 None] Acquiring lock "cinder-quobyte-18620bde-da65-4deb-823c-625134fcc6e4" by "delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:02:24 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-27ce70a1-2e9f-4a22-a928-241388056874 tempest-CinderUnicodeTest-847668735 None] Lock "cinder-quobyte-18620bde-da65-4deb-823c-625134fcc6e4" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:02:24 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-27ce70a1-2e9f-4a22-a928-241388056874 tempest-CinderUnicodeTest-847668735 None] Acquiring lock "cinder-quobyte-daec03be-3178-4b21-8fa5-6906fdc1f10d" by "_delete_snapshot" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:02:24 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-27ce70a1-2e9f-4a22-a928-241388056874 tempest-CinderUnicodeTest-847668735 None] Lock "cinder-quobyte-daec03be-3178-4b21-8fa5-6906fdc1f10d" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:02:24 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-27ce70a1-2e9f-4a22-a928-241388056874 tempest-CinderUnicodeTest-847668735 None] Deleting offline snapshot daec03be-3178-4b21-8fa5-6906fdc1f10d of volume 18620bde-da65-4deb-823c-625134fcc6e4 {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 16:02:24 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-27ce70a1-2e9f-4a22-a928-241388056874 tempest-CinderUnicodeTest-847668735 None] snapshot_file for this snap is: volume-18620bde-da65-4deb-823c-625134fcc6e4.daec03be-3178-4b21-8fa5-6906fdc1f10d {{(pid=82485) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 16:02:24 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[83514dab-c412-41ed-889c-d42a7e3ecea8]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:02:24 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-27ce70a1-2e9f-4a22-a928-241388056874 tempest-CinderUnicodeTest-847668735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-18620bde-da65-4deb-823c-625134fcc6e4.daec03be-3178-4b21-8fa5-6906fdc1f10d {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:24 devstack sudo[91103]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:24 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-886a21c0-0643-491c-90ae-955bf83d8212 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fe65e87d-511b-445c-bd18-a09ddaa6e1bf" returned: 0 in 0.597s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:24 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-886a21c0-0643-491c-90ae-955bf83d8212 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] <== create_volume: return (1305ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:02:24 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-886a21c0-0643-491c-90ae-955bf83d8212 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.308s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:02:24 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-886a21c0-0643-491c-90ae-955bf83d8212 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b13ac0e-f1be-458d-a320-ffc1debb1cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe65e87d-511b-445c-bd18-a09ddaa6e1bf', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:02:24 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-886a21c0-0643-491c-90ae-955bf83d8212 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce8e7fce-a3cb-4e9a-91ff-dac1bf163b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:02:24 devstack sudo[91105]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:24 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ac304679-bddf-4164-b920-97872b40d383 tempest-VolumeDependencyTests-972921078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.594s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:24 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-ac304679-bddf-4164-b920-97872b40d383 tempest-VolumeDependencyTests-972921078 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:02:24 devstack sudo[91111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-18620bde-da65-4deb-823c-625134fcc6e4.daec03be-3178-4b21-8fa5-6906fdc1f10d
Apr 15 16:02:24 devstack sudo[91111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:24 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-886a21c0-0643-491c-90ae-955bf83d8212 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Volume volume-fe65e87d-511b-445c-bd18-a09ddaa6e1bf (fe65e87d-511b-445c-bd18-a09ddaa6e1bf): created successfully
Apr 15 16:02:24 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-886a21c0-0643-491c-90ae-955bf83d8212 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce8e7fce-a3cb-4e9a-91ff-dac1bf163b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:02:24 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-886a21c0-0643-491c-90ae-955bf83d8212 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Flow 'volume_create_manager' (0053b91c-886e-4bc0-9476-5baec686abfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:02:24 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-ac304679-bddf-4164-b920-97872b40d383 tempest-VolumeDependencyTests-972921078 None] Deleted volume successfully.
Apr 15 16:02:24 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-886a21c0-0643-491c-90ae-955bf83d8212 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Created volume successfully.
Apr 15 16:02:24 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-ac304679-bddf-4164-b920-97872b40d383 tempest-VolumeDependencyTests-972921078 None] Lock "cinder-69bd1781-9d2c-467c-8f00-73ac52f4f77e-delete_volume" released by "delete_volume" :: held 1.864s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:02:25 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-ecb3cc30-e8fd-4220-9459-cc367d9a23cb tempest-VolumeDependencyTests-972921078 None] Acquiring lock "cinder-f55628c3-c48d-4c04-9eda-3b29eb054b09-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:02:25 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-ecb3cc30-e8fd-4220-9459-cc367d9a23cb tempest-VolumeDependencyTests-972921078 None] Lock "cinder-f55628c3-c48d-4c04-9eda-3b29eb054b09-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:02:25 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-ecb3cc30-e8fd-4220-9459-cc367d9a23cb tempest-VolumeDependencyTests-972921078 None] Acquiring lock "cinder-quobyte-f55628c3-c48d-4c04-9eda-3b29eb054b09" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:02:25 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-ecb3cc30-e8fd-4220-9459-cc367d9a23cb tempest-VolumeDependencyTests-972921078 None] Lock "cinder-quobyte-f55628c3-c48d-4c04-9eda-3b29eb054b09" acquired by "delete_volume" :: waited 0.014s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:02:25 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a19a06-5704-4305-b7a7-f63e8cdb1307]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:02:25 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ecb3cc30-e8fd-4220-9459-cc367d9a23cb tempest-VolumeDependencyTests-972921078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f55628c3-c48d-4c04-9eda-3b29eb054b09 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:25 devstack sudo[91111]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:25 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-27ce70a1-2e9f-4a22-a928-241388056874 tempest-CinderUnicodeTest-847668735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-18620bde-da65-4deb-823c-625134fcc6e4.daec03be-3178-4b21-8fa5-6906fdc1f10d" returned: 0 in 0.614s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:25 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-27ce70a1-2e9f-4a22-a928-241388056874 tempest-CinderUnicodeTest-847668735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18620bde-da65-4deb-823c-625134fcc6e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82485) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 16:02:25 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a078431-1fd9-4ac6-8908-02563ae99b5c]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:02:25 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-27ce70a1-2e9f-4a22-a928-241388056874 tempest-CinderUnicodeTest-847668735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-18620bde-da65-4deb-823c-625134fcc6e4 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:25 devstack sudo[91116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f55628c3-c48d-4c04-9eda-3b29eb054b09
Apr 15 16:02:25 devstack sudo[91116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:25 devstack sudo[91117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-18620bde-da65-4deb-823c-625134fcc6e4
Apr 15 16:02:25 devstack sudo[91117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:25 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-05f6775a-2f64-4d56-92ef-c3ebce25901b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:02:25 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-05f6775a-2f64-4d56-92ef-c3ebce25901b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Flow 'volume_create_manager' (6ba72b8a-0bfa-4196-887e-b0cc758072c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:02:25 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-05f6775a-2f64-4d56-92ef-c3ebce25901b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72d4af07-e1ca-446c-924e-55fe6c427de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:02:25 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-05f6775a-2f64-4d56-92ef-c3ebce25901b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72d4af07-e1ca-446c-924e-55fe6c427de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:02:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1864993065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8b48386-956c-4ad6-a677-4d45844cb93a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72c166a37cdf40dbaf86294cd75cbe31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:02:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:02:26Z,use_quota=True,user_id='69ea27617db748609db32495a9885578',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:02:25 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-05f6775a-2f64-4d56-92ef-c3ebce25901b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4140c0ce-3293-4bd5-832b-67dd28554f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:02:26 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-05f6775a-2f64-4d56-92ef-c3ebce25901b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4140c0ce-3293-4bd5-832b-67dd28554f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:02:26 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-05f6775a-2f64-4d56-92ef-c3ebce25901b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68aed415-0b16-49ac-803a-ca570a312cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:02:26 devstack sudo[91117]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:26 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-05f6775a-2f64-4d56-92ef-c3ebce25901b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68aed415-0b16-49ac-803a-ca570a312cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8b48386-956c-4ad6-a677-4d45844cb93a', 'volume_name': 'volume-b8b48386-956c-4ad6-a677-4d45844cb93a', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:02:26 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-05f6775a-2f64-4d56-92ef-c3ebce25901b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (071b440a-9098-4e72-aa6c-123a05e3475c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:02:26 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-05f6775a-2f64-4d56-92ef-c3ebce25901b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (071b440a-9098-4e72-aa6c-123a05e3475c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:02:26 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-05f6775a-2f64-4d56-92ef-c3ebce25901b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b31301e-c386-4ecb-88c7-992946e7716e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:02:26 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-05f6775a-2f64-4d56-92ef-c3ebce25901b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Volume b8b48386-956c-4ad6-a677-4d45844cb93a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8b48386-956c-4ad6-a677-4d45844cb93a', 'volume_size': 1}
Apr 15 16:02:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-05f6775a-2f64-4d56-92ef-c3ebce25901b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:02:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-05f6775a-2f64-4d56-92ef-c3ebce25901b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:02:26 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-05f6775a-2f64-4d56-92ef-c3ebce25901b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:02:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1864993065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8b48386-956c-4ad6-a677-4d45844cb93a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72c166a37cdf40dbaf86294cd75cbe31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:02:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:02:26Z,use_quota=True,user_id='69ea27617db748609db32495a9885578',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:02:26 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-05f6775a-2f64-4d56-92ef-c3ebce25901b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Creating volume b8b48386-956c-4ad6-a677-4d45844cb93a {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:02:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-05f6775a-2f64-4d56-92ef-c3ebce25901b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:02:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-05f6775a-2f64-4d56-92ef-c3ebce25901b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:02:26 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-05f6775a-2f64-4d56-92ef-c3ebce25901b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:02:26 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-05f6775a-2f64-4d56-92ef-c3ebce25901b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:02:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-05f6775a-2f64-4d56-92ef-c3ebce25901b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:02:26 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-05f6775a-2f64-4d56-92ef-c3ebce25901b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:02:26 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-05f6775a-2f64-4d56-92ef-c3ebce25901b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 16:02:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-05f6775a-2f64-4d56-92ef-c3ebce25901b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8b48386-956c-4ad6-a677-4d45844cb93a 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:26 devstack sudo[91116]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ecb3cc30-e8fd-4220-9459-cc367d9a23cb tempest-VolumeDependencyTests-972921078 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f55628c3-c48d-4c04-9eda-3b29eb054b09" returned: 0 in 0.714s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-27ce70a1-2e9f-4a22-a928-241388056874 tempest-CinderUnicodeTest-847668735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-18620bde-da65-4deb-823c-625134fcc6e4" returned: 0 in 0.656s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ecb3cc30-e8fd-4220-9459-cc367d9a23cb tempest-VolumeDependencyTests-972921078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f55628c3-c48d-4c04-9eda-3b29eb054b09 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:26 devstack sudo[91127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8b48386-956c-4ad6-a677-4d45844cb93a 1073741824
Apr 15 16:02:26 devstack sudo[91127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-27ce70a1-2e9f-4a22-a928-241388056874 tempest-CinderUnicodeTest-847668735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-18620bde-da65-4deb-823c-625134fcc6e4.daec03be-3178-4b21-8fa5-6906fdc1f10d {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:26 devstack sudo[91128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f55628c3-c48d-4c04-9eda-3b29eb054b09
Apr 15 16:02:26 devstack sudo[91128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:26 devstack sudo[91130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-18620bde-da65-4deb-823c-625134fcc6e4.daec03be-3178-4b21-8fa5-6906fdc1f10d
Apr 15 16:02:26 devstack sudo[91130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:26 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb226783-0165-4651-b936-bb5e5b53fa66 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:02:26 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-bb226783-0165-4651-b936-bb5e5b53fa66 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Flow 'volume_create_manager' (d60d968f-1c2a-400e-bbb9-ddc0613a064d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:02:26 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-bb226783-0165-4651-b936-bb5e5b53fa66 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86f1a0e3-5ea9-4cee-931d-79eb1814fc04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:02:26 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-bb226783-0165-4651-b936-bb5e5b53fa66 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86f1a0e3-5ea9-4cee-931d-79eb1814fc04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:02:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-429306155',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fc416b4-dbe6-4645-921b-6ce1291e4b0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72c166a37cdf40dbaf86294cd75cbe31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:02:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:02:26Z,use_quota=True,user_id='69ea27617db748609db32495a9885578',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:02:26 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-bb226783-0165-4651-b936-bb5e5b53fa66 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b956eedf-01d7-45da-92e3-b1b5e43844c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:02:26 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-bb226783-0165-4651-b936-bb5e5b53fa66 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b956eedf-01d7-45da-92e3-b1b5e43844c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:02:26 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-bb226783-0165-4651-b936-bb5e5b53fa66 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1cf826e-0aef-4879-9234-d0d0c927f623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:02:26 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-bb226783-0165-4651-b936-bb5e5b53fa66 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1cf826e-0aef-4879-9234-d0d0c927f623) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fc416b4-dbe6-4645-921b-6ce1291e4b0c', 'volume_name': 'volume-4fc416b4-dbe6-4645-921b-6ce1291e4b0c', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:02:26 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-bb226783-0165-4651-b936-bb5e5b53fa66 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a250a7c-bccb-4c76-a050-cad82cb51360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:02:26 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-bb226783-0165-4651-b936-bb5e5b53fa66 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a250a7c-bccb-4c76-a050-cad82cb51360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:02:26 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-bb226783-0165-4651-b936-bb5e5b53fa66 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83d0d19a-e001-4324-8d95-63464c6aca1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:02:26 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-bb226783-0165-4651-b936-bb5e5b53fa66 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Volume 4fc416b4-dbe6-4645-921b-6ce1291e4b0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fc416b4-dbe6-4645-921b-6ce1291e4b0c', 'volume_size': 1}
Apr 15 16:02:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-bb226783-0165-4651-b936-bb5e5b53fa66 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:02:26 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5c81016-6568-489b-976e-3dba4421e55f tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:02:26 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-a5c81016-6568-489b-976e-3dba4421e55f tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Flow 'volume_create_manager' (27cf9e9f-bc97-433f-85d1-ae1f2947c901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:02:26 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-a5c81016-6568-489b-976e-3dba4421e55f tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62d97b35-82a4-48ac-ab89-2f729ddece75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:02:26 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-a5c81016-6568-489b-976e-3dba4421e55f tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62d97b35-82a4-48ac-ab89-2f729ddece75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:02:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-13792134',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6500eb95-eeaa-4117-8e75-a6d2f38248fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72c166a37cdf40dbaf86294cd75cbe31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:02:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:02:27Z,use_quota=True,user_id='69ea27617db748609db32495a9885578',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:02:26 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-a5c81016-6568-489b-976e-3dba4421e55f tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (135d40e9-907a-49c3-82aa-430d8136e606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:02:26 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-a5c81016-6568-489b-976e-3dba4421e55f tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (135d40e9-907a-49c3-82aa-430d8136e606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:02:26 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-a5c81016-6568-489b-976e-3dba4421e55f tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73b32fba-36e3-4417-8941-404178cf65c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:02:26 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-a5c81016-6568-489b-976e-3dba4421e55f tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73b32fba-36e3-4417-8941-404178cf65c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6500eb95-eeaa-4117-8e75-a6d2f38248fd', 'volume_name': 'volume-6500eb95-eeaa-4117-8e75-a6d2f38248fd', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:02:26 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-a5c81016-6568-489b-976e-3dba4421e55f tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fba6be8-ee41-48b5-885a-f9a696b27f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:02:26 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-a5c81016-6568-489b-976e-3dba4421e55f tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fba6be8-ee41-48b5-885a-f9a696b27f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:02:26 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-a5c81016-6568-489b-976e-3dba4421e55f tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0500c67c-7c57-4906-8869-6f1d417c9ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:02:26 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-a5c81016-6568-489b-976e-3dba4421e55f tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Volume 6500eb95-eeaa-4117-8e75-a6d2f38248fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6500eb95-eeaa-4117-8e75-a6d2f38248fd', 'volume_size': 1}
Apr 15 16:02:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-a5c81016-6568-489b-976e-3dba4421e55f tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:02:26 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6024f82-63e7-4e1e-9395-7d2097ec88a3 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:02:26 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-f6024f82-63e7-4e1e-9395-7d2097ec88a3 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Flow 'volume_create_manager' (693d6e32-9d8b-4259-8b84-2a24cedc377f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:02:26 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-f6024f82-63e7-4e1e-9395-7d2097ec88a3 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1393d500-8376-44b5-8362-5f6137db6004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:02:26 devstack sudo[91128]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:26 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-f6024f82-63e7-4e1e-9395-7d2097ec88a3 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1393d500-8376-44b5-8362-5f6137db6004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:02:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1678157585',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b6eba61-1017-4154-8c7e-1423f4fc5e41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72c166a37cdf40dbaf86294cd75cbe31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:02:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:02:27Z,use_quota=True,user_id='69ea27617db748609db32495a9885578',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:02:26 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-f6024f82-63e7-4e1e-9395-7d2097ec88a3 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69ba0a25-c0d9-413e-80be-f8dade27c684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:02:26 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-f6024f82-63e7-4e1e-9395-7d2097ec88a3 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69ba0a25-c0d9-413e-80be-f8dade27c684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:02:26 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-f6024f82-63e7-4e1e-9395-7d2097ec88a3 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64a1eb55-89a2-4ff7-b320-2a6a394b0406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:02:26 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-f6024f82-63e7-4e1e-9395-7d2097ec88a3 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64a1eb55-89a2-4ff7-b320-2a6a394b0406) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b6eba61-1017-4154-8c7e-1423f4fc5e41', 'volume_name': 'volume-0b6eba61-1017-4154-8c7e-1423f4fc5e41', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:02:26 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-f6024f82-63e7-4e1e-9395-7d2097ec88a3 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (526f26a4-a918-4ed0-b4d7-18ce714bf771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:02:26 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-f6024f82-63e7-4e1e-9395-7d2097ec88a3 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (526f26a4-a918-4ed0-b4d7-18ce714bf771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:02:26 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-f6024f82-63e7-4e1e-9395-7d2097ec88a3 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e69e6b6-2cbf-4a65-a77e-e736f6a545ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:02:26 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-f6024f82-63e7-4e1e-9395-7d2097ec88a3 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Volume 0b6eba61-1017-4154-8c7e-1423f4fc5e41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b6eba61-1017-4154-8c7e-1423f4fc5e41', 'volume_size': 1}
Apr 15 16:02:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-f6024f82-63e7-4e1e-9395-7d2097ec88a3 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:02:26 devstack sudo[91130]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ecb3cc30-e8fd-4220-9459-cc367d9a23cb tempest-VolumeDependencyTests-972921078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-f55628c3-c48d-4c04-9eda-3b29eb054b09" returned: 0 in 0.795s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-27ce70a1-2e9f-4a22-a928-241388056874 tempest-CinderUnicodeTest-847668735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-18620bde-da65-4deb-823c-625134fcc6e4.daec03be-3178-4b21-8fa5-6906fdc1f10d" returned: 0 in 0.794s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-27ce70a1-2e9f-4a22-a928-241388056874 tempest-CinderUnicodeTest-847668735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-18620bde-da65-4deb-823c-625134fcc6e4.daec03be-3178-4b21-8fa5-6906fdc1f10d {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:26 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-ecb3cc30-e8fd-4220-9459-cc367d9a23cb tempest-VolumeDependencyTests-972921078 None] Lock "cinder-quobyte-f55628c3-c48d-4c04-9eda-3b29eb054b09" released by "delete_volume" :: held 1.560s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:02:26 devstack sudo[91140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-18620bde-da65-4deb-823c-625134fcc6e4.daec03be-3178-4b21-8fa5-6906fdc1f10d
Apr 15 16:02:26 devstack sudo[91140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:26 devstack sudo[91127]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:26 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-ecb3cc30-e8fd-4220-9459-cc367d9a23cb tempest-VolumeDependencyTests-972921078 None] Created reservations ['265a2c8d-07fb-4e0e-bf68-6f39add24e1d', '585a764e-801e-4ea1-9c2e-0694b76f7345', '5db1d79f-d81a-48eb-9137-eef2ae595b67', '850a02be-efae-4018-84ea-57943a036ac0'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:02:26 devstack cinder-volume[82485]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbf186f9-b60a-4c17-bfca-b09f9e88cf7b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82485) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 16:02:26 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-dbf186f9-b60a-4c17-bfca-b09f9e88cf7b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Flow 'volume_create_manager' (60926494-e3e0-4ff0-a3a8-39c4dbacf1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:02:26 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-dbf186f9-b60a-4c17-bfca-b09f9e88cf7b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97751ea2-fe25-49dd-aac2-a3cab2ddf562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:02:26 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-05f6775a-2f64-4d56-92ef-c3ebce25901b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8b48386-956c-4ad6-a677-4d45844cb93a 1073741824" returned: 0 in 0.939s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:27 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-dbf186f9-b60a-4c17-bfca-b09f9e88cf7b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97751ea2-fe25-49dd-aac2-a3cab2ddf562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:02:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-774888572',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89de11c3-05f1-4b08-b220-0e332cb4f298,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72c166a37cdf40dbaf86294cd75cbe31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:02:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:02:27Z,use_quota=True,user_id='69ea27617db748609db32495a9885578',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:02:27 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-dbf186f9-b60a-4c17-bfca-b09f9e88cf7b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d60bf46-8dc4-427a-add4-462aef2a2571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:02:27 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-dbf186f9-b60a-4c17-bfca-b09f9e88cf7b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d60bf46-8dc4-427a-add4-462aef2a2571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:02:27 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-dbf186f9-b60a-4c17-bfca-b09f9e88cf7b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5233aee6-5111-4be4-a3e5-cbcb52efc9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:02:27 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-dbf186f9-b60a-4c17-bfca-b09f9e88cf7b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5233aee6-5111-4be4-a3e5-cbcb52efc9e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89de11c3-05f1-4b08-b220-0e332cb4f298', 'volume_name': 'volume-89de11c3-05f1-4b08-b220-0e332cb4f298', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:02:27 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-dbf186f9-b60a-4c17-bfca-b09f9e88cf7b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (113d7902-62a0-4220-bd26-80701f0cd17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:02:27 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-dbf186f9-b60a-4c17-bfca-b09f9e88cf7b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (113d7902-62a0-4220-bd26-80701f0cd17a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:02:27 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-dbf186f9-b60a-4c17-bfca-b09f9e88cf7b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d4327a4-fd34-4c92-9973-bcd9b6c8e7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:02:27 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-dbf186f9-b60a-4c17-bfca-b09f9e88cf7b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Volume 89de11c3-05f1-4b08-b220-0e332cb4f298: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89de11c3-05f1-4b08-b220-0e332cb4f298', 'volume_size': 1}
Apr 15 16:02:27 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-dbf186f9-b60a-4c17-bfca-b09f9e88cf7b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:02:27 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-05f6775a-2f64-4d56-92ef-c3ebce25901b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8b48386-956c-4ad6-a677-4d45844cb93a {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:27 devstack sudo[91142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8b48386-956c-4ad6-a677-4d45844cb93a
Apr 15 16:02:27 devstack sudo[91142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:27 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-ecb3cc30-e8fd-4220-9459-cc367d9a23cb tempest-VolumeDependencyTests-972921078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:02:27 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-ecb3cc30-e8fd-4220-9459-cc367d9a23cb tempest-VolumeDependencyTests-972921078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:02:27 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-ecb3cc30-e8fd-4220-9459-cc367d9a23cb tempest-VolumeDependencyTests-972921078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:02:27 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-ecb3cc30-e8fd-4220-9459-cc367d9a23cb tempest-VolumeDependencyTests-972921078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:02:27 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-ecb3cc30-e8fd-4220-9459-cc367d9a23cb tempest-VolumeDependencyTests-972921078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:02:27 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ecb3cc30-e8fd-4220-9459-cc367d9a23cb tempest-VolumeDependencyTests-972921078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:27 devstack sudo[91144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 16:02:27 devstack sudo[91144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:27 devstack sudo[91140]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:27 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-27ce70a1-2e9f-4a22-a928-241388056874 tempest-CinderUnicodeTest-847668735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-18620bde-da65-4deb-823c-625134fcc6e4.daec03be-3178-4b21-8fa5-6906fdc1f10d" returned: 0 in 0.486s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:27 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-27ce70a1-2e9f-4a22-a928-241388056874 tempest-CinderUnicodeTest-847668735 None] Lock "cinder-quobyte-daec03be-3178-4b21-8fa5-6906fdc1f10d" released by "_delete_snapshot" :: held 2.633s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:02:27 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-27ce70a1-2e9f-4a22-a928-241388056874 tempest-CinderUnicodeTest-847668735 None] Lock "cinder-quobyte-18620bde-da65-4deb-823c-625134fcc6e4" released by "delete_snapshot" :: held 2.648s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:02:27 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-27ce70a1-2e9f-4a22-a928-241388056874 tempest-CinderUnicodeTest-847668735 None] Created reservations ['c447287a-e53a-42e3-990f-0b4d476598e1', '49242736-0e48-4fd2-881a-698457a7f95c', '9879cdc0-5fbf-4e74-aee2-47784ce57bd8', '6563c5a8-b3f3-4979-9b29-82e813a03e4a'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:02:27 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-27ce70a1-2e9f-4a22-a928-241388056874 tempest-CinderUnicodeTest-847668735 None] Delete snapshot completed successfully.
Apr 15 16:02:27 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-27ce70a1-2e9f-4a22-a928-241388056874 tempest-CinderUnicodeTest-847668735 None] Lock "cinder-daec03be-3178-4b21-8fa5-6906fdc1f10d-delete_snapshot" released by "delete_snapshot" :: held 2.745s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:02:27 devstack sudo[91142]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:27 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-05f6775a-2f64-4d56-92ef-c3ebce25901b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8b48386-956c-4ad6-a677-4d45844cb93a" returned: 0 in 0.509s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:27 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-05f6775a-2f64-4d56-92ef-c3ebce25901b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] <== create_volume: return (1528ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:02:27 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-05f6775a-2f64-4d56-92ef-c3ebce25901b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.530s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:02:27 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-bb226783-0165-4651-b936-bb5e5b53fa66 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.221s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:02:27 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-bb226783-0165-4651-b936-bb5e5b53fa66 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:02:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-429306155',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fc416b4-dbe6-4645-921b-6ce1291e4b0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72c166a37cdf40dbaf86294cd75cbe31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:02:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:02:26Z,use_quota=True,user_id='69ea27617db748609db32495a9885578',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:02:27 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-bb226783-0165-4651-b936-bb5e5b53fa66 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Creating volume 4fc416b4-dbe6-4645-921b-6ce1291e4b0c {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:02:27 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-bb226783-0165-4651-b936-bb5e5b53fa66 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:02:27 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-bb226783-0165-4651-b936-bb5e5b53fa66 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:02:27 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-bb226783-0165-4651-b936-bb5e5b53fa66 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:02:27 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-bb226783-0165-4651-b936-bb5e5b53fa66 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:02:27 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-bb226783-0165-4651-b936-bb5e5b53fa66 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:02:27 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-bb226783-0165-4651-b936-bb5e5b53fa66 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:02:27 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-bb226783-0165-4651-b936-bb5e5b53fa66 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 16:02:27 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-bb226783-0165-4651-b936-bb5e5b53fa66 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-4fc416b4-dbe6-4645-921b-6ce1291e4b0c 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:27 devstack sudo[91144]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:27 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-05f6775a-2f64-4d56-92ef-c3ebce25901b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b31301e-c386-4ecb-88c7-992946e7716e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8b48386-956c-4ad6-a677-4d45844cb93a', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:02:27 devstack sudo[91149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-4fc416b4-dbe6-4645-921b-6ce1291e4b0c 1073741824
Apr 15 16:02:27 devstack sudo[91149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:27 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-05f6775a-2f64-4d56-92ef-c3ebce25901b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4a2fbed-a352-4576-a861-68b4383dd484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:02:27 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-ecb3cc30-e8fd-4220-9459-cc367d9a23cb tempest-VolumeDependencyTests-972921078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.500s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:27 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-ecb3cc30-e8fd-4220-9459-cc367d9a23cb tempest-VolumeDependencyTests-972921078 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:02:27 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-ecb3cc30-e8fd-4220-9459-cc367d9a23cb tempest-VolumeDependencyTests-972921078 None] Deleted volume successfully.
Apr 15 16:02:27 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-05f6775a-2f64-4d56-92ef-c3ebce25901b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Volume volume-b8b48386-956c-4ad6-a677-4d45844cb93a (b8b48386-956c-4ad6-a677-4d45844cb93a): created successfully
Apr 15 16:02:27 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-05f6775a-2f64-4d56-92ef-c3ebce25901b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4a2fbed-a352-4576-a861-68b4383dd484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:02:27 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-05f6775a-2f64-4d56-92ef-c3ebce25901b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Flow 'volume_create_manager' (6ba72b8a-0bfa-4196-887e-b0cc758072c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:02:27 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-ecb3cc30-e8fd-4220-9459-cc367d9a23cb tempest-VolumeDependencyTests-972921078 None] Lock "cinder-f55628c3-c48d-4c04-9eda-3b29eb054b09-delete_volume" released by "delete_volume" :: held 2.366s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:02:27 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-05f6775a-2f64-4d56-92ef-c3ebce25901b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Created volume successfully.
Apr 15 16:02:27 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-6cc8c5c8-b350-4cfd-8e60-62f91691293c tempest-CinderUnicodeTest-847668735 None] Acquiring lock "cinder-18620bde-da65-4deb-823c-625134fcc6e4-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:02:27 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-6cc8c5c8-b350-4cfd-8e60-62f91691293c tempest-CinderUnicodeTest-847668735 None] Lock "cinder-18620bde-da65-4deb-823c-625134fcc6e4-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:02:27 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-6cc8c5c8-b350-4cfd-8e60-62f91691293c tempest-CinderUnicodeTest-847668735 None] Acquiring lock "cinder-quobyte-18620bde-da65-4deb-823c-625134fcc6e4" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:02:27 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-6cc8c5c8-b350-4cfd-8e60-62f91691293c tempest-CinderUnicodeTest-847668735 None] Lock "cinder-quobyte-18620bde-da65-4deb-823c-625134fcc6e4" acquired by "delete_volume" :: waited 0.012s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:02:28 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3917b94-b39e-400f-9a91-3ac15a2017bf]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:02:28 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6cc8c5c8-b350-4cfd-8e60-62f91691293c tempest-CinderUnicodeTest-847668735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-18620bde-da65-4deb-823c-625134fcc6e4 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:28 devstack sudo[91153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-18620bde-da65-4deb-823c-625134fcc6e4
Apr 15 16:02:28 devstack sudo[91153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:28 devstack sudo[91149]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:28 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-bb226783-0165-4651-b936-bb5e5b53fa66 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-4fc416b4-dbe6-4645-921b-6ce1291e4b0c 1073741824" returned: 0 in 0.633s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:28 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-bb226783-0165-4651-b936-bb5e5b53fa66 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-4fc416b4-dbe6-4645-921b-6ce1291e4b0c {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:28 devstack sudo[91156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-4fc416b4-dbe6-4645-921b-6ce1291e4b0c
Apr 15 16:02:28 devstack sudo[91156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:28 devstack sudo[91153]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:28 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6cc8c5c8-b350-4cfd-8e60-62f91691293c tempest-CinderUnicodeTest-847668735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-18620bde-da65-4deb-823c-625134fcc6e4" returned: 0 in 0.530s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:28 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6cc8c5c8-b350-4cfd-8e60-62f91691293c tempest-CinderUnicodeTest-847668735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-18620bde-da65-4deb-823c-625134fcc6e4 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:28 devstack sudo[91161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-18620bde-da65-4deb-823c-625134fcc6e4
Apr 15 16:02:28 devstack sudo[91161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:28 devstack sudo[91156]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:28 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-bb226783-0165-4651-b936-bb5e5b53fa66 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-4fc416b4-dbe6-4645-921b-6ce1291e4b0c" returned: 0 in 0.486s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:28 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-bb226783-0165-4651-b936-bb5e5b53fa66 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:02:28 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-bb226783-0165-4651-b936-bb5e5b53fa66 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:02:28 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-a5c81016-6568-489b-976e-3dba4421e55f tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.023s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:02:28 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-a5c81016-6568-489b-976e-3dba4421e55f tempest-CreateVolumesFromSourceVolumeTest-900302410 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:02:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-13792134',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6500eb95-eeaa-4117-8e75-a6d2f38248fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72c166a37cdf40dbaf86294cd75cbe31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:02:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:02:27Z,use_quota=True,user_id='69ea27617db748609db32495a9885578',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:02:28 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-a5c81016-6568-489b-976e-3dba4421e55f tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Creating volume 6500eb95-eeaa-4117-8e75-a6d2f38248fd {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:02:28 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-a5c81016-6568-489b-976e-3dba4421e55f tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:02:28 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-a5c81016-6568-489b-976e-3dba4421e55f tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:02:28 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-a5c81016-6568-489b-976e-3dba4421e55f tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:02:28 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-a5c81016-6568-489b-976e-3dba4421e55f tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:02:28 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-a5c81016-6568-489b-976e-3dba4421e55f tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:02:28 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-a5c81016-6568-489b-976e-3dba4421e55f tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:02:28 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-a5c81016-6568-489b-976e-3dba4421e55f tempest-CreateVolumesFromSourceVolumeTest-900302410 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 16:02:28 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-a5c81016-6568-489b-976e-3dba4421e55f tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6500eb95-eeaa-4117-8e75-a6d2f38248fd 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:28 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-bb226783-0165-4651-b936-bb5e5b53fa66 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83d0d19a-e001-4324-8d95-63464c6aca1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fc416b4-dbe6-4645-921b-6ce1291e4b0c', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:02:28 devstack sudo[91164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6500eb95-eeaa-4117-8e75-a6d2f38248fd 1073741824
Apr 15 16:02:28 devstack sudo[91164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:28 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-bb226783-0165-4651-b936-bb5e5b53fa66 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0bb8d40-d45f-43d6-9ae2-6b64a4082bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:02:28 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-bb226783-0165-4651-b936-bb5e5b53fa66 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Volume volume-4fc416b4-dbe6-4645-921b-6ce1291e4b0c (4fc416b4-dbe6-4645-921b-6ce1291e4b0c): created successfully
Apr 15 16:02:28 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-bb226783-0165-4651-b936-bb5e5b53fa66 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0bb8d40-d45f-43d6-9ae2-6b64a4082bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:02:28 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-bb226783-0165-4651-b936-bb5e5b53fa66 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Flow 'volume_create_manager' (d60d968f-1c2a-400e-bbb9-ddc0613a064d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:02:28 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-bb226783-0165-4651-b936-bb5e5b53fa66 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Created volume successfully.
Apr 15 16:02:28 devstack sudo[91161]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:28 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6cc8c5c8-b350-4cfd-8e60-62f91691293c tempest-CinderUnicodeTest-847668735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-18620bde-da65-4deb-823c-625134fcc6e4" returned: 0 in 0.425s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:28 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-6cc8c5c8-b350-4cfd-8e60-62f91691293c tempest-CinderUnicodeTest-847668735 None] Lock "cinder-quobyte-18620bde-da65-4deb-823c-625134fcc6e4" released by "delete_volume" :: held 1.003s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:02:29 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-6cc8c5c8-b350-4cfd-8e60-62f91691293c tempest-CinderUnicodeTest-847668735 None] Created reservations ['30c35930-e196-45ea-bcc5-10942de2f795', 'ee3d9017-6860-4beb-8858-35242335b08f', '4ed60977-56b9-4144-9394-fa4e79e316cc', 'dffd7cf5-0b5e-413c-991b-c3aa70b779ef'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:02:29 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-6cc8c5c8-b350-4cfd-8e60-62f91691293c tempest-CinderUnicodeTest-847668735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:02:29 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-6cc8c5c8-b350-4cfd-8e60-62f91691293c tempest-CinderUnicodeTest-847668735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:02:29 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-6cc8c5c8-b350-4cfd-8e60-62f91691293c tempest-CinderUnicodeTest-847668735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:02:29 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-6cc8c5c8-b350-4cfd-8e60-62f91691293c tempest-CinderUnicodeTest-847668735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:02:29 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-6cc8c5c8-b350-4cfd-8e60-62f91691293c tempest-CinderUnicodeTest-847668735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:02:29 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6cc8c5c8-b350-4cfd-8e60-62f91691293c tempest-CinderUnicodeTest-847668735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:29 devstack sudo[91170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 16:02:29 devstack sudo[91170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:29 devstack sudo[91164]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:29 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-a5c81016-6568-489b-976e-3dba4421e55f tempest-CreateVolumesFromSourceVolumeTest-900302410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6500eb95-eeaa-4117-8e75-a6d2f38248fd 1073741824" returned: 0 in 0.501s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:29 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-a5c81016-6568-489b-976e-3dba4421e55f tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6500eb95-eeaa-4117-8e75-a6d2f38248fd {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:29 devstack sudo[91172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6500eb95-eeaa-4117-8e75-a6d2f38248fd
Apr 15 16:02:29 devstack sudo[91172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:29 devstack sudo[91170]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:29 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-6cc8c5c8-b350-4cfd-8e60-62f91691293c tempest-CinderUnicodeTest-847668735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.432s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:29 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-6cc8c5c8-b350-4cfd-8e60-62f91691293c tempest-CinderUnicodeTest-847668735 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:02:29 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-6cc8c5c8-b350-4cfd-8e60-62f91691293c tempest-CinderUnicodeTest-847668735 None] Deleted volume successfully.
Apr 15 16:02:29 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-6cc8c5c8-b350-4cfd-8e60-62f91691293c tempest-CinderUnicodeTest-847668735 None] Lock "cinder-18620bde-da65-4deb-823c-625134fcc6e4-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:02:29 devstack sudo[91172]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:29 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-a5c81016-6568-489b-976e-3dba4421e55f tempest-CreateVolumesFromSourceVolumeTest-900302410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6500eb95-eeaa-4117-8e75-a6d2f38248fd" returned: 0 in 0.407s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:29 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-a5c81016-6568-489b-976e-3dba4421e55f tempest-CreateVolumesFromSourceVolumeTest-900302410 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:02:29 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-a5c81016-6568-489b-976e-3dba4421e55f tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:02:29 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-f6024f82-63e7-4e1e-9395-7d2097ec88a3 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.834s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:02:29 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-f6024f82-63e7-4e1e-9395-7d2097ec88a3 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:02:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1678157585',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b6eba61-1017-4154-8c7e-1423f4fc5e41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72c166a37cdf40dbaf86294cd75cbe31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:02:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:02:27Z,use_quota=True,user_id='69ea27617db748609db32495a9885578',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:02:29 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-f6024f82-63e7-4e1e-9395-7d2097ec88a3 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Creating volume 0b6eba61-1017-4154-8c7e-1423f4fc5e41 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:02:29 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-f6024f82-63e7-4e1e-9395-7d2097ec88a3 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:02:29 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-f6024f82-63e7-4e1e-9395-7d2097ec88a3 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:02:29 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-f6024f82-63e7-4e1e-9395-7d2097ec88a3 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:02:29 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-f6024f82-63e7-4e1e-9395-7d2097ec88a3 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:02:29 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-f6024f82-63e7-4e1e-9395-7d2097ec88a3 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:02:29 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-f6024f82-63e7-4e1e-9395-7d2097ec88a3 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:02:29 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-f6024f82-63e7-4e1e-9395-7d2097ec88a3 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 16:02:29 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-f6024f82-63e7-4e1e-9395-7d2097ec88a3 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-0b6eba61-1017-4154-8c7e-1423f4fc5e41 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:29 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-a5c81016-6568-489b-976e-3dba4421e55f tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0500c67c-7c57-4906-8869-6f1d417c9ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6500eb95-eeaa-4117-8e75-a6d2f38248fd', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:02:29 devstack sudo[91176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-0b6eba61-1017-4154-8c7e-1423f4fc5e41 1073741824
Apr 15 16:02:29 devstack sudo[91176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:29 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-a5c81016-6568-489b-976e-3dba4421e55f tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fee5d838-b127-4200-9ab6-f8263e4411e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:02:29 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-a5c81016-6568-489b-976e-3dba4421e55f tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Volume volume-6500eb95-eeaa-4117-8e75-a6d2f38248fd (6500eb95-eeaa-4117-8e75-a6d2f38248fd): created successfully
Apr 15 16:02:29 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-a5c81016-6568-489b-976e-3dba4421e55f tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fee5d838-b127-4200-9ab6-f8263e4411e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:02:29 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-a5c81016-6568-489b-976e-3dba4421e55f tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Flow 'volume_create_manager' (27cf9e9f-bc97-433f-85d1-ae1f2947c901) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:02:29 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-a5c81016-6568-489b-976e-3dba4421e55f tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Created volume successfully.
Apr 15 16:02:30 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-bb26bbb1-4068-4331-84c2-5da63a53eb5c tempest-CinderUnicodeTest-847668735 None] Acquiring lock "cinder-576aa65e-0d77-4e02-aa72-296dc1d2ee51-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:02:30 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-bb26bbb1-4068-4331-84c2-5da63a53eb5c tempest-CinderUnicodeTest-847668735 None] Lock "cinder-576aa65e-0d77-4e02-aa72-296dc1d2ee51-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:02:30 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-bb26bbb1-4068-4331-84c2-5da63a53eb5c tempest-CinderUnicodeTest-847668735 None] Acquiring lock "cinder-quobyte-576aa65e-0d77-4e02-aa72-296dc1d2ee51" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:02:30 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-bb26bbb1-4068-4331-84c2-5da63a53eb5c tempest-CinderUnicodeTest-847668735 None] Lock "cinder-quobyte-576aa65e-0d77-4e02-aa72-296dc1d2ee51" acquired by "delete_volume" :: waited 0.008s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:02:30 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f91e314-0e1d-459f-b1eb-85077fa9692c]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:02:30 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-bb26bbb1-4068-4331-84c2-5da63a53eb5c tempest-CinderUnicodeTest-847668735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-576aa65e-0d77-4e02-aa72-296dc1d2ee51 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:30 devstack sudo[91176]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:30 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-f6024f82-63e7-4e1e-9395-7d2097ec88a3 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-0b6eba61-1017-4154-8c7e-1423f4fc5e41 1073741824" returned: 0 in 0.530s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:30 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-f6024f82-63e7-4e1e-9395-7d2097ec88a3 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-0b6eba61-1017-4154-8c7e-1423f4fc5e41 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:30 devstack sudo[91181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-576aa65e-0d77-4e02-aa72-296dc1d2ee51
Apr 15 16:02:30 devstack sudo[91181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:30 devstack sudo[91182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-0b6eba61-1017-4154-8c7e-1423f4fc5e41
Apr 15 16:02:30 devstack sudo[91182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:30 devstack sudo[91182]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:30 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-f6024f82-63e7-4e1e-9395-7d2097ec88a3 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-0b6eba61-1017-4154-8c7e-1423f4fc5e41" returned: 0 in 0.445s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:30 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-f6024f82-63e7-4e1e-9395-7d2097ec88a3 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:02:30 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-f6024f82-63e7-4e1e-9395-7d2097ec88a3 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:02:30 devstack sudo[91181]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:30 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-dbf186f9-b60a-4c17-bfca-b09f9e88cf7b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.638s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:02:30 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-dbf186f9-b60a-4c17-bfca-b09f9e88cf7b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f154a261b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T14:02:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-774888572',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89de11c3-05f1-4b08-b220-0e332cb4f298,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72c166a37cdf40dbaf86294cd75cbe31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T14:02:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T14:02:27Z,use_quota=True,user_id='69ea27617db748609db32495a9885578',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d57df8b-0418-420b-bc89-618a7c40727f),volume_type_id=9d57df8b-0418-420b-bc89-618a7c40727f)}" {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 16:02:30 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.remotefs [None req-dbf186f9-b60a-4c17-bfca-b09f9e88cf7b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Creating volume 89de11c3-05f1-4b08-b220-0e332cb4f298 {{(pid=82485) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 16:02:30 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-dbf186f9-b60a-4c17-bfca-b09f9e88cf7b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:02:30 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-dbf186f9-b60a-4c17-bfca-b09f9e88cf7b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:02:30 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-dbf186f9-b60a-4c17-bfca-b09f9e88cf7b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:02:30 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-dbf186f9-b60a-4c17-bfca-b09f9e88cf7b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:02:30 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-dbf186f9-b60a-4c17-bfca-b09f9e88cf7b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:02:30 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-dbf186f9-b60a-4c17-bfca-b09f9e88cf7b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Selected osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c as target Quobyte volume. {{(pid=82485) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 16:02:30 devstack cinder-volume[82485]: INFO cinder.volume.drivers.remotefs [None req-dbf186f9-b60a-4c17-bfca-b09f9e88cf7b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] casted to osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c
Apr 15 16:02:30 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-dbf186f9-b60a-4c17-bfca-b09f9e88cf7b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-89de11c3-05f1-4b08-b220-0e332cb4f298 1073741824 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:30 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-f6024f82-63e7-4e1e-9395-7d2097ec88a3 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e69e6b6-2cbf-4a65-a77e-e736f6a545ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b6eba61-1017-4154-8c7e-1423f4fc5e41', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:02:30 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-f6024f82-63e7-4e1e-9395-7d2097ec88a3 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cae6ac84-5ce0-460b-bc15-25f52fd31b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:02:30 devstack sudo[91189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-89de11c3-05f1-4b08-b220-0e332cb4f298 1073741824
Apr 15 16:02:30 devstack sudo[91189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:30 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-bb26bbb1-4068-4331-84c2-5da63a53eb5c tempest-CinderUnicodeTest-847668735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-576aa65e-0d77-4e02-aa72-296dc1d2ee51" returned: 0 in 0.545s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:30 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-bb26bbb1-4068-4331-84c2-5da63a53eb5c tempest-CinderUnicodeTest-847668735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-576aa65e-0d77-4e02-aa72-296dc1d2ee51 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:30 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-f6024f82-63e7-4e1e-9395-7d2097ec88a3 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Volume volume-0b6eba61-1017-4154-8c7e-1423f4fc5e41 (0b6eba61-1017-4154-8c7e-1423f4fc5e41): created successfully
Apr 15 16:02:30 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-f6024f82-63e7-4e1e-9395-7d2097ec88a3 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cae6ac84-5ce0-460b-bc15-25f52fd31b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:02:30 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-f6024f82-63e7-4e1e-9395-7d2097ec88a3 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Flow 'volume_create_manager' (693d6e32-9d8b-4259-8b84-2a24cedc377f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:02:30 devstack sudo[91191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-576aa65e-0d77-4e02-aa72-296dc1d2ee51
Apr 15 16:02:30 devstack sudo[91191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:30 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-f6024f82-63e7-4e1e-9395-7d2097ec88a3 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Created volume successfully.
Apr 15 16:02:31 devstack sudo[91191]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:31 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-bb26bbb1-4068-4331-84c2-5da63a53eb5c tempest-CinderUnicodeTest-847668735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-576aa65e-0d77-4e02-aa72-296dc1d2ee51" returned: 0 in 0.437s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:31 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-bb26bbb1-4068-4331-84c2-5da63a53eb5c tempest-CinderUnicodeTest-847668735 None] Lock "cinder-quobyte-576aa65e-0d77-4e02-aa72-296dc1d2ee51" released by "delete_volume" :: held 1.025s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:02:31 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-bb26bbb1-4068-4331-84c2-5da63a53eb5c tempest-CinderUnicodeTest-847668735 None] Created reservations ['1cba01cc-80b7-49ed-a1ae-b23f1921d6a0', 'adcd9ff3-ef0f-4c97-b817-79287518b470', '7ca0ce98-de90-4bca-a4e3-6a3578e7881d', '91f6a4fb-9ae4-46b3-8dd8-573d0bf9cf91'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:02:31 devstack sudo[91189]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:31 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-dbf186f9-b60a-4c17-bfca-b09f9e88cf7b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-89de11c3-05f1-4b08-b220-0e332cb4f298 1073741824" returned: 0 in 0.563s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:31 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-bb26bbb1-4068-4331-84c2-5da63a53eb5c tempest-CinderUnicodeTest-847668735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:02:31 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-bb26bbb1-4068-4331-84c2-5da63a53eb5c tempest-CinderUnicodeTest-847668735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:02:31 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-bb26bbb1-4068-4331-84c2-5da63a53eb5c tempest-CinderUnicodeTest-847668735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:02:31 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-bb26bbb1-4068-4331-84c2-5da63a53eb5c tempest-CinderUnicodeTest-847668735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:02:31 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-bb26bbb1-4068-4331-84c2-5da63a53eb5c tempest-CinderUnicodeTest-847668735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:02:31 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-bb26bbb1-4068-4331-84c2-5da63a53eb5c tempest-CinderUnicodeTest-847668735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:31 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-dbf186f9-b60a-4c17-bfca-b09f9e88cf7b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-89de11c3-05f1-4b08-b220-0e332cb4f298 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:31 devstack sudo[91197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 16:02:31 devstack sudo[91197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:31 devstack sudo[91198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-89de11c3-05f1-4b08-b220-0e332cb4f298
Apr 15 16:02:31 devstack sudo[91198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:31 devstack sudo[91197]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:31 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-bb26bbb1-4068-4331-84c2-5da63a53eb5c tempest-CinderUnicodeTest-847668735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.403s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:31 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-bb26bbb1-4068-4331-84c2-5da63a53eb5c tempest-CinderUnicodeTest-847668735 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:02:31 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-bb26bbb1-4068-4331-84c2-5da63a53eb5c tempest-CinderUnicodeTest-847668735 None] Deleted volume successfully.
Apr 15 16:02:31 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-bb26bbb1-4068-4331-84c2-5da63a53eb5c tempest-CinderUnicodeTest-847668735 None] Lock "cinder-576aa65e-0d77-4e02-aa72-296dc1d2ee51-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:02:31 devstack sudo[91198]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:31 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-dbf186f9-b60a-4c17-bfca-b09f9e88cf7b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-89de11c3-05f1-4b08-b220-0e332cb4f298" returned: 0 in 0.415s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:31 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-dbf186f9-b60a-4c17-bfca-b09f9e88cf7b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'} {{(pid=82485) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 16:02:31 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-dbf186f9-b60a-4c17-bfca-b09f9e88cf7b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:02:31 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-dbf186f9-b60a-4c17-bfca-b09f9e88cf7b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d4327a4-fd34-4c92-9973-bcd9b6c8e7ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89de11c3-05f1-4b08-b220-0e332cb4f298', 'volume_size': 1}' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:02:31 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-dbf186f9-b60a-4c17-bfca-b09f9e88cf7b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c33931ac-c988-47f1-b7df-d28eba53b8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 16:02:31 devstack cinder-volume[82485]: INFO cinder.volume.flows.manager.create_volume [None req-dbf186f9-b60a-4c17-bfca-b09f9e88cf7b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Volume volume-89de11c3-05f1-4b08-b220-0e332cb4f298 (89de11c3-05f1-4b08-b220-0e332cb4f298): created successfully
Apr 15 16:02:31 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-dbf186f9-b60a-4c17-bfca-b09f9e88cf7b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c33931ac-c988-47f1-b7df-d28eba53b8a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82485) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 16:02:31 devstack cinder-volume[82485]: DEBUG cinder.volume.manager [None req-dbf186f9-b60a-4c17-bfca-b09f9e88cf7b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Flow 'volume_create_manager' (60926494-e3e0-4ff0-a3a8-39c4dbacf1f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82485) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 16:02:31 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-dbf186f9-b60a-4c17-bfca-b09f9e88cf7b tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Created volume successfully.
Apr 15 16:02:32 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-093a633e-20fa-4f86-984d-8f2d611de184 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Acquiring lock "cinder-89de11c3-05f1-4b08-b220-0e332cb4f298-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:02:32 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-093a633e-20fa-4f86-984d-8f2d611de184 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Lock "cinder-89de11c3-05f1-4b08-b220-0e332cb4f298-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:02:32 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-093a633e-20fa-4f86-984d-8f2d611de184 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Acquiring lock "cinder-quobyte-89de11c3-05f1-4b08-b220-0e332cb4f298" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:02:32 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-093a633e-20fa-4f86-984d-8f2d611de184 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Lock "cinder-quobyte-89de11c3-05f1-4b08-b220-0e332cb4f298" acquired by "delete_volume" :: waited 0.009s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:02:32 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[46469395-6aa4-4cbb-8baf-e60e0175c195]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:02:32 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-093a633e-20fa-4f86-984d-8f2d611de184 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-89de11c3-05f1-4b08-b220-0e332cb4f298 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:32 devstack sudo[91203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-89de11c3-05f1-4b08-b220-0e332cb4f298
Apr 15 16:02:32 devstack sudo[91203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:33 devstack sudo[91203]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:33 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-093a633e-20fa-4f86-984d-8f2d611de184 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-89de11c3-05f1-4b08-b220-0e332cb4f298" returned: 0 in 0.545s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:33 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-093a633e-20fa-4f86-984d-8f2d611de184 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-89de11c3-05f1-4b08-b220-0e332cb4f298 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:33 devstack sudo[91208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-89de11c3-05f1-4b08-b220-0e332cb4f298
Apr 15 16:02:33 devstack sudo[91208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:33 devstack sudo[91208]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:33 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-093a633e-20fa-4f86-984d-8f2d611de184 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-89de11c3-05f1-4b08-b220-0e332cb4f298" returned: 0 in 0.444s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:33 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-093a633e-20fa-4f86-984d-8f2d611de184 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Lock "cinder-quobyte-89de11c3-05f1-4b08-b220-0e332cb4f298" released by "delete_volume" :: held 1.012s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:02:33 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-093a633e-20fa-4f86-984d-8f2d611de184 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Created reservations ['99be26f5-6bae-40a5-96ea-2f4a787949a4', '181473b8-7f6b-4dd2-8263-e4e25c6d7ff4', '48f97011-df7b-4185-9070-726d87499c8e', 'ffcc9c19-91ae-40c6-835f-15bb3493fb73'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:02:33 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-093a633e-20fa-4f86-984d-8f2d611de184 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:02:33 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-093a633e-20fa-4f86-984d-8f2d611de184 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:02:33 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-093a633e-20fa-4f86-984d-8f2d611de184 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:02:33 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-093a633e-20fa-4f86-984d-8f2d611de184 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:02:33 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-093a633e-20fa-4f86-984d-8f2d611de184 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:02:33 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-093a633e-20fa-4f86-984d-8f2d611de184 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:33 devstack sudo[91211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 16:02:33 devstack sudo[91211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:34 devstack sudo[91211]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:34 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-093a633e-20fa-4f86-984d-8f2d611de184 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.401s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:34 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-093a633e-20fa-4f86-984d-8f2d611de184 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:02:34 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-093a633e-20fa-4f86-984d-8f2d611de184 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Deleted volume successfully.
Apr 15 16:02:34 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-093a633e-20fa-4f86-984d-8f2d611de184 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Lock "cinder-89de11c3-05f1-4b08-b220-0e332cb4f298-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:02:34 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-511cb5f2-2ec7-48c1-af47-ed7c1aa78e28 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Acquiring lock "cinder-0b6eba61-1017-4154-8c7e-1423f4fc5e41-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:02:34 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-511cb5f2-2ec7-48c1-af47-ed7c1aa78e28 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Lock "cinder-0b6eba61-1017-4154-8c7e-1423f4fc5e41-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:02:34 devstack cinder-volume[82485]: DEBUG dbcounter [-] [82485] Writing DB stats cinder:SELECT=192,cinder:UPDATE=257,cinder:INSERT=47,cinder:DELETE=28 {{(pid=82485) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 16:02:34 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-511cb5f2-2ec7-48c1-af47-ed7c1aa78e28 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Acquiring lock "cinder-quobyte-0b6eba61-1017-4154-8c7e-1423f4fc5e41" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:02:34 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-511cb5f2-2ec7-48c1-af47-ed7c1aa78e28 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Lock "cinder-quobyte-0b6eba61-1017-4154-8c7e-1423f4fc5e41" acquired by "delete_volume" :: waited 0.011s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:02:34 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6a8448-e477-4da3-9548-ddebcb30809b]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:02:34 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-511cb5f2-2ec7-48c1-af47-ed7c1aa78e28 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-0b6eba61-1017-4154-8c7e-1423f4fc5e41 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:34 devstack sudo[91215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-0b6eba61-1017-4154-8c7e-1423f4fc5e41
Apr 15 16:02:34 devstack sudo[91215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:35 devstack sudo[91215]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:35 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-511cb5f2-2ec7-48c1-af47-ed7c1aa78e28 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-0b6eba61-1017-4154-8c7e-1423f4fc5e41" returned: 0 in 0.481s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:35 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-511cb5f2-2ec7-48c1-af47-ed7c1aa78e28 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-0b6eba61-1017-4154-8c7e-1423f4fc5e41 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:35 devstack sudo[91226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-0b6eba61-1017-4154-8c7e-1423f4fc5e41
Apr 15 16:02:35 devstack sudo[91226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:35 devstack sudo[91226]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:35 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-511cb5f2-2ec7-48c1-af47-ed7c1aa78e28 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-0b6eba61-1017-4154-8c7e-1423f4fc5e41" returned: 0 in 0.407s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:35 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-511cb5f2-2ec7-48c1-af47-ed7c1aa78e28 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Lock "cinder-quobyte-0b6eba61-1017-4154-8c7e-1423f4fc5e41" released by "delete_volume" :: held 0.924s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:02:35 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-511cb5f2-2ec7-48c1-af47-ed7c1aa78e28 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Created reservations ['7f565991-730b-45f7-a74e-1171bd3fdae6', 'e4240404-bfbb-4dce-ac6b-6183acd21c9e', '15f6da2b-7dce-4c2a-8094-05b940540fec', 'cd1fad92-8762-458e-a732-63c9881d807c'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:02:35 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-511cb5f2-2ec7-48c1-af47-ed7c1aa78e28 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:02:35 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-511cb5f2-2ec7-48c1-af47-ed7c1aa78e28 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:02:35 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-511cb5f2-2ec7-48c1-af47-ed7c1aa78e28 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:02:35 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-511cb5f2-2ec7-48c1-af47-ed7c1aa78e28 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:02:35 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-511cb5f2-2ec7-48c1-af47-ed7c1aa78e28 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:02:35 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-511cb5f2-2ec7-48c1-af47-ed7c1aa78e28 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:35 devstack sudo[91229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 16:02:35 devstack sudo[91229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:35 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-16dc45e0-3215-4665-8947-b87c24cb4a07 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Acquiring lock "cinder-6500eb95-eeaa-4117-8e75-a6d2f38248fd-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:02:35 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-16dc45e0-3215-4665-8947-b87c24cb4a07 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Lock "cinder-6500eb95-eeaa-4117-8e75-a6d2f38248fd-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:02:35 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-16dc45e0-3215-4665-8947-b87c24cb4a07 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Acquiring lock "cinder-quobyte-6500eb95-eeaa-4117-8e75-a6d2f38248fd" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:02:35 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-16dc45e0-3215-4665-8947-b87c24cb4a07 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Lock "cinder-quobyte-6500eb95-eeaa-4117-8e75-a6d2f38248fd" acquired by "delete_volume" :: waited 0.008s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:02:35 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b0b251-19e2-4940-a7b0-d97c6a9af20f]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:02:35 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-16dc45e0-3215-4665-8947-b87c24cb4a07 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6500eb95-eeaa-4117-8e75-a6d2f38248fd {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:35 devstack sudo[91231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6500eb95-eeaa-4117-8e75-a6d2f38248fd
Apr 15 16:02:35 devstack sudo[91231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:36 devstack sudo[91229]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:36 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-511cb5f2-2ec7-48c1-af47-ed7c1aa78e28 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.444s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:36 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-511cb5f2-2ec7-48c1-af47-ed7c1aa78e28 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:02:36 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-511cb5f2-2ec7-48c1-af47-ed7c1aa78e28 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Deleted volume successfully.
Apr 15 16:02:36 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-511cb5f2-2ec7-48c1-af47-ed7c1aa78e28 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Lock "cinder-0b6eba61-1017-4154-8c7e-1423f4fc5e41-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:02:36 devstack sudo[91231]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:36 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-16dc45e0-3215-4665-8947-b87c24cb4a07 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6500eb95-eeaa-4117-8e75-a6d2f38248fd" returned: 0 in 0.489s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:36 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-16dc45e0-3215-4665-8947-b87c24cb4a07 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6500eb95-eeaa-4117-8e75-a6d2f38248fd {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:36 devstack sudo[91237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6500eb95-eeaa-4117-8e75-a6d2f38248fd
Apr 15 16:02:36 devstack sudo[91237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:36 devstack sudo[91237]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:36 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-16dc45e0-3215-4665-8947-b87c24cb4a07 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-6500eb95-eeaa-4117-8e75-a6d2f38248fd" returned: 0 in 0.398s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:36 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-16dc45e0-3215-4665-8947-b87c24cb4a07 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Lock "cinder-quobyte-6500eb95-eeaa-4117-8e75-a6d2f38248fd" released by "delete_volume" :: held 0.912s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:02:36 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-16dc45e0-3215-4665-8947-b87c24cb4a07 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Created reservations ['ae49b48e-58c0-43d4-a40c-49815a96e91c', '688b4583-2774-4d81-ac2e-fd1134cedc76', 'bdbf1607-f1b4-4246-91c3-70680a806258', 'd67450bb-6db9-4b2a-891d-c99188852a6b'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:02:36 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-16dc45e0-3215-4665-8947-b87c24cb4a07 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:02:36 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-16dc45e0-3215-4665-8947-b87c24cb4a07 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:02:36 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-16dc45e0-3215-4665-8947-b87c24cb4a07 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:02:36 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-16dc45e0-3215-4665-8947-b87c24cb4a07 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:02:36 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-16dc45e0-3215-4665-8947-b87c24cb4a07 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:02:36 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-16dc45e0-3215-4665-8947-b87c24cb4a07 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:36 devstack sudo[91240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 16:02:36 devstack sudo[91240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:36 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-df02a670-51fd-45e6-9818-edd8d23ae2de tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Acquiring lock "cinder-4fc416b4-dbe6-4645-921b-6ce1291e4b0c-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:02:36 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-df02a670-51fd-45e6-9818-edd8d23ae2de tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Lock "cinder-4fc416b4-dbe6-4645-921b-6ce1291e4b0c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:02:36 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-df02a670-51fd-45e6-9818-edd8d23ae2de tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Acquiring lock "cinder-quobyte-4fc416b4-dbe6-4645-921b-6ce1291e4b0c" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:02:36 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-df02a670-51fd-45e6-9818-edd8d23ae2de tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Lock "cinder-quobyte-4fc416b4-dbe6-4645-921b-6ce1291e4b0c" acquired by "delete_volume" :: waited 0.009s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:02:36 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d68713-4bd0-4ea4-bd07-b6ab4404e7fb]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:02:36 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-df02a670-51fd-45e6-9818-edd8d23ae2de tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-4fc416b4-dbe6-4645-921b-6ce1291e4b0c {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:37 devstack sudo[91242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-4fc416b4-dbe6-4645-921b-6ce1291e4b0c
Apr 15 16:02:37 devstack sudo[91242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:37 devstack sudo[91240]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:37 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-16dc45e0-3215-4665-8947-b87c24cb4a07 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.435s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:37 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-16dc45e0-3215-4665-8947-b87c24cb4a07 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:02:37 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-16dc45e0-3215-4665-8947-b87c24cb4a07 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Deleted volume successfully.
Apr 15 16:02:37 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-16dc45e0-3215-4665-8947-b87c24cb4a07 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Lock "cinder-6500eb95-eeaa-4117-8e75-a6d2f38248fd-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:02:37 devstack sudo[91242]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:37 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-df02a670-51fd-45e6-9818-edd8d23ae2de tempest-CreateVolumesFromSourceVolumeTest-900302410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-4fc416b4-dbe6-4645-921b-6ce1291e4b0c" returned: 0 in 0.473s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:37 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-df02a670-51fd-45e6-9818-edd8d23ae2de tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-4fc416b4-dbe6-4645-921b-6ce1291e4b0c {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:37 devstack sudo[91248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-4fc416b4-dbe6-4645-921b-6ce1291e4b0c
Apr 15 16:02:37 devstack sudo[91248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:37 devstack sudo[91248]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:37 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-df02a670-51fd-45e6-9818-edd8d23ae2de tempest-CreateVolumesFromSourceVolumeTest-900302410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-4fc416b4-dbe6-4645-921b-6ce1291e4b0c" returned: 0 in 0.399s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:37 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-df02a670-51fd-45e6-9818-edd8d23ae2de tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Lock "cinder-quobyte-4fc416b4-dbe6-4645-921b-6ce1291e4b0c" released by "delete_volume" :: held 0.895s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:02:37 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-df02a670-51fd-45e6-9818-edd8d23ae2de tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Created reservations ['5bf85bb7-1c62-4ff7-823a-95504129bf10', 'b02b7e41-cb3a-4a69-8937-7b81aab98b52', '43dd9652-d373-470f-a348-b68927becc83', 'df526aa1-0612-4db1-8903-b51ccccb8446'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:02:37 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-df02a670-51fd-45e6-9818-edd8d23ae2de tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:02:37 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-df02a670-51fd-45e6-9818-edd8d23ae2de tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:02:37 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-df02a670-51fd-45e6-9818-edd8d23ae2de tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:02:37 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-df02a670-51fd-45e6-9818-edd8d23ae2de tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:02:37 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-df02a670-51fd-45e6-9818-edd8d23ae2de tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:02:37 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-df02a670-51fd-45e6-9818-edd8d23ae2de tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:37 devstack sudo[91251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 16:02:37 devstack sudo[91251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:38 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-591b274c-528c-4f99-a31d-2db0867fcdda tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Acquiring lock "cinder-b8b48386-956c-4ad6-a677-4d45844cb93a-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:02:38 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-591b274c-528c-4f99-a31d-2db0867fcdda tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Lock "cinder-b8b48386-956c-4ad6-a677-4d45844cb93a-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:02:38 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-591b274c-528c-4f99-a31d-2db0867fcdda tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Acquiring lock "cinder-quobyte-b8b48386-956c-4ad6-a677-4d45844cb93a" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:02:38 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-591b274c-528c-4f99-a31d-2db0867fcdda tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Lock "cinder-quobyte-b8b48386-956c-4ad6-a677-4d45844cb93a" acquired by "delete_volume" :: waited 0.007s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:02:38 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e4e19a-02e4-4e2a-aba4-a4832dbbdae3]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:02:38 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-591b274c-528c-4f99-a31d-2db0867fcdda tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8b48386-956c-4ad6-a677-4d45844cb93a {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:38 devstack sudo[91253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8b48386-956c-4ad6-a677-4d45844cb93a
Apr 15 16:02:38 devstack sudo[91253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:38 devstack sudo[91251]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:38 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-df02a670-51fd-45e6-9818-edd8d23ae2de tempest-CreateVolumesFromSourceVolumeTest-900302410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.484s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:38 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-df02a670-51fd-45e6-9818-edd8d23ae2de tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:02:38 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-df02a670-51fd-45e6-9818-edd8d23ae2de tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Deleted volume successfully.
Apr 15 16:02:38 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-df02a670-51fd-45e6-9818-edd8d23ae2de tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Lock "cinder-4fc416b4-dbe6-4645-921b-6ce1291e4b0c-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:02:38 devstack sudo[91253]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:38 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-591b274c-528c-4f99-a31d-2db0867fcdda tempest-CreateVolumesFromSourceVolumeTest-900302410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8b48386-956c-4ad6-a677-4d45844cb93a" returned: 0 in 0.457s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:38 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-591b274c-528c-4f99-a31d-2db0867fcdda tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8b48386-956c-4ad6-a677-4d45844cb93a {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:38 devstack sudo[91259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8b48386-956c-4ad6-a677-4d45844cb93a
Apr 15 16:02:38 devstack sudo[91259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:38 devstack sudo[91259]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:38 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-591b274c-528c-4f99-a31d-2db0867fcdda tempest-CreateVolumesFromSourceVolumeTest-900302410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-b8b48386-956c-4ad6-a677-4d45844cb93a" returned: 0 in 0.391s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:38 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-591b274c-528c-4f99-a31d-2db0867fcdda tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Lock "cinder-quobyte-b8b48386-956c-4ad6-a677-4d45844cb93a" released by "delete_volume" :: held 0.872s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:02:38 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-591b274c-528c-4f99-a31d-2db0867fcdda tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Created reservations ['8e21ac0d-4588-44e2-99f7-0ba18acd6559', '88a3e99f-78a1-442c-9f9c-a8442e26903d', '35e8eeee-c4f5-4296-a4ef-6a6a472a465f', 'c864edc7-7fc4-43a4-8920-871cb7a6e13f'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:02:39 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-591b274c-528c-4f99-a31d-2db0867fcdda tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:02:39 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-591b274c-528c-4f99-a31d-2db0867fcdda tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:02:39 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-591b274c-528c-4f99-a31d-2db0867fcdda tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:02:39 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-591b274c-528c-4f99-a31d-2db0867fcdda tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:02:39 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-591b274c-528c-4f99-a31d-2db0867fcdda tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:02:39 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-591b274c-528c-4f99-a31d-2db0867fcdda tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:39 devstack sudo[91262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 16:02:39 devstack sudo[91262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:39 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-9bf53bd6-3abf-4f99-b6ce-16ff5b33aa34 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Acquiring lock "cinder-fe65e87d-511b-445c-bd18-a09ddaa6e1bf-delete_volume" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:02:39 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-9bf53bd6-3abf-4f99-b6ce-16ff5b33aa34 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Lock "cinder-fe65e87d-511b-445c-bd18-a09ddaa6e1bf-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:02:39 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-9bf53bd6-3abf-4f99-b6ce-16ff5b33aa34 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Acquiring lock "cinder-quobyte-fe65e87d-511b-445c-bd18-a09ddaa6e1bf" by "delete_volume" {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 16:02:39 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-9bf53bd6-3abf-4f99-b6ce-16ff5b33aa34 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Lock "cinder-quobyte-fe65e87d-511b-445c-bd18-a09ddaa6e1bf" acquired by "delete_volume" :: waited 0.009s {{(pid=82485) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 16:02:39 devstack cinder-volume[82485]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7169e5-f793-4030-b17d-39af5b6a5129]: (4, 'qcow2') {{(pid=83401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 16:02:39 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9bf53bd6-3abf-4f99-b6ce-16ff5b33aa34 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fe65e87d-511b-445c-bd18-a09ddaa6e1bf {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:39 devstack sudo[91264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fe65e87d-511b-445c-bd18-a09ddaa6e1bf
Apr 15 16:02:39 devstack sudo[91264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:39 devstack sudo[91262]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:39 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-591b274c-528c-4f99-a31d-2db0867fcdda tempest-CreateVolumesFromSourceVolumeTest-900302410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.470s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:39 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-591b274c-528c-4f99-a31d-2db0867fcdda tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:02:39 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-591b274c-528c-4f99-a31d-2db0867fcdda tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Deleted volume successfully.
Apr 15 16:02:39 devstack cinder-volume[82485]: DEBUG dbcounter [-] [82485] Writing DB stats cinder:SELECT=199,cinder:INSERT=80,cinder:UPDATE=292,cinder:DELETE=22 {{(pid=82485) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 16:02:39 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-591b274c-528c-4f99-a31d-2db0867fcdda tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Lock "cinder-b8b48386-956c-4ad6-a677-4d45844cb93a-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:02:39 devstack sudo[91264]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:39 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9bf53bd6-3abf-4f99-b6ce-16ff5b33aa34 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fe65e87d-511b-445c-bd18-a09ddaa6e1bf" returned: 0 in 0.466s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:39 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9bf53bd6-3abf-4f99-b6ce-16ff5b33aa34 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fe65e87d-511b-445c-bd18-a09ddaa6e1bf {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:39 devstack sudo[91270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fe65e87d-511b-445c-bd18-a09ddaa6e1bf
Apr 15 16:02:39 devstack sudo[91270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:40 devstack sudo[91270]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:40 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9bf53bd6-3abf-4f99-b6ce-16ff5b33aa34 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154/volume-fe65e87d-511b-445c-bd18-a09ddaa6e1bf" returned: 0 in 0.394s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:40 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-9bf53bd6-3abf-4f99-b6ce-16ff5b33aa34 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Lock "cinder-quobyte-fe65e87d-511b-445c-bd18-a09ddaa6e1bf" released by "delete_volume" :: held 0.884s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:02:40 devstack cinder-volume[82485]: DEBUG cinder.quota [None req-9bf53bd6-3abf-4f99-b6ce-16ff5b33aa34 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Created reservations ['2b106d79-de8a-46e4-97a1-8ef12e699518', 'fad89a12-2065-452f-bb05-369c1e30a15e', 'e526dca6-58a6-486f-b918-a5094a9c277b', '0d8358bd-264e-4f46-a56c-580eee50d81e'] {{(pid=82485) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 16:02:40 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-9bf53bd6-3abf-4f99-b6ce-16ff5b33aa34 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:02:40 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-9bf53bd6-3abf-4f99-b6ce-16ff5b33aa34 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:02:40 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-9bf53bd6-3abf-4f99-b6ce-16ff5b33aa34 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:02:40 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-9bf53bd6-3abf-4f99-b6ce-16ff5b33aa34 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:02:40 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-9bf53bd6-3abf-4f99-b6ce-16ff5b33aa34 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:02:40 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9bf53bd6-3abf-4f99-b6ce-16ff5b33aa34 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:40 devstack sudo[91273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 16:02:40 devstack sudo[91273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:40 devstack sudo[91273]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:40 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-9bf53bd6-3abf-4f99-b6ce-16ff5b33aa34 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.459s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:40 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-9bf53bd6-3abf-4f99-b6ce-16ff5b33aa34 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:02:40 devstack cinder-volume[82485]: INFO cinder.volume.manager [None req-9bf53bd6-3abf-4f99-b6ce-16ff5b33aa34 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Deleted volume successfully.
Apr 15 16:02:40 devstack cinder-volume[82485]: DEBUG cinder.coordination [None req-9bf53bd6-3abf-4f99-b6ce-16ff5b33aa34 tempest-CreateVolumesFromSourceVolumeTest-900302410 None] Lock "cinder-fe65e87d-511b-445c-bd18-a09ddaa6e1bf-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=82485) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 16:02:44 devstack cinder-volume[82485]: DEBUG oslo_service.periodic_task [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82485) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 15 16:02:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 16:02:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 16:02:44 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c': None} {{(pid=82485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 16:02:44 devstack cinder-volume[82485]: DEBUG cinder.volume.drivers.quobyte [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e07dc7b7-cde2-4b05-b6ae-acfbdbc3e53c'] {{(pid=82485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 16:02:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.lockutils [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82485) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 16:02:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154 {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 16:02:44 devstack sudo[91314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154
Apr 15 16:02:44 devstack sudo[91314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 16:02:44 devstack sudo[91314]: pam_unix(sudo:session): session closed for user root
Apr 15 16:02:44 devstack cinder-volume[82485]: DEBUG oslo_concurrency.processutils [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/680455a7f456f356f86e67efe1f32154" returned: 0 in 0.423s {{(pid=82485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 16:02:44 devstack cinder-volume[82485]: DEBUG cinder.manager [None req-cd251237-9fcb-48c2-8327-2b49e87f74bd None None] Notifying Schedulers of capabilities ... {{(pid=82485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 16:02:50 devstack cinder-volume[82485]: DEBUG dbcounter [-] [82485] Writing DB stats cinder:SELECT=25,cinder:INSERT=13,cinder:UPDATE=35,cinder:DELETE=1 {{(pid=82485) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 16:02:50 devstack cinder-volume[82485]: DEBUG dbcounter [-] [82485] Writing DB stats cinder:SELECT=2,cinder:INSERT=2,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=82485) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}